28.8 About practical importance and statistical significance
Hypothesis tests assess statistical significance, which answers the question: ‘Is there evidence of a difference between the value of the statistic and the value of the assumed parameter?’ Even very small differences between the sample statistic and the population parameter can be statistically different if the sample size is large enough.
In contrast, practical importance asks the question:
Is the difference between the value of the statistic and the value of the assumed parameter of any practical importance?
‘Practical importance’ and ‘statistical significance’ are two separate (but both important) issues. Whether a results is of practical significance depends upon the context: what the data are being used for, by whom, and for what purpose.
Example 28.2 (Practical importance) In the body-temperature study, very strong evidence exists that the mean body temperature had changed (‘statistical significance’).
But the change was so small, that for most purposes it has no practical importance. (There may be other (e.g. medical) situations where it does have practical importance however.)