Search All of the Math Forum:

Views expressed in these public forums are not endorsed by NCTM or The Math Forum.

Notice: We are no longer accepting new posts, but the forums will continue to be readable.

Topic: For nonrejection of H0, don't we want high signifance?
Replies: 7   Last Post: Apr 26, 2013 12:11 PM

 Messages: [ Previous | Next ]
 Paul Posts: 517 Registered: 2/23/10
For nonrejection of H0, don't we want high signifance?
Posted: Apr 23, 2013 3:15 PM

I'm perusing http://en.wikipedia.org/wiki/Anderson%E2%80%93Darling_test#Test_for_normality
for a statistical test of normality for my residuals. H0 is normality
of the residuals.

For typical hypothesis testing, we want small significance, which
means a small rejection region. Thus, and value of the statistic that
falls in the rejection region is less likely due to chance (in
combination with the truth of H0). In testing a drug for a medical
effect, that makes sense because we often want to demonstrate an
effect, and H0 is typically the absence of an effect. For values of
the statistic that fall in the small rejection region, we can say that
if H0 is true, it is highly unlikely for us to get this value for the
statistic. The smaller the significance, the smaller the rejection
region, and less we are able to attribute the chance any values in the
rejection region.

For normality, we often want the opposite. We want H0, which is
normality of the residuals. We can not accept H0 to any degree of
confidence using this setup of hypothesis testing, but at least we can
make it very easy to reject H0 so any non-rejection of H0 is seen to
be well founded. This implies large rejection region and high
significance. In fact, we might want to a 95% rejection region, the
counterpart of the wanting a 5% rejection region when the intent is to
demonstrate that rejection of H0 is not due to chance.

Is this reasonable? I ask because the table in the above link shows
significance values 1%, 2.5%, 5%, 10%, and 15%. These small values
seem more like the values that one might be interested in when wanting
to demonstrate valid rejection of H0.

Date Subject Author
4/23/13 Paul
4/23/13 Richard Ulrich
4/23/13 Paul
4/23/13 David Jones
4/25/13 Jeff Miller
4/26/13 David Jones
4/26/13 Herman Rubin
4/24/13 Luis A. Afonso