Search All of the Math Forum:

Views expressed in these public forums are not endorsed by NCTM or The Math Forum.

Notice: We are no longer accepting new posts, but the forums will continue to be readable.

Topic: For nonrejection of H0, don't we want high signifance?
Replies: 7   Last Post: Apr 26, 2013 12:11 PM

 Messages: [ Previous | Next ]
 Jeff Miller Posts: 99 Registered: 12/18/04
Re: For nonrejection of H0, don't we want high signifance?
Posted: Apr 25, 2013 8:37 PM

On Wednesday, April 24, 2013 11:31:11 AM UTC+12, Paul wrote:

> from a conceptual standpoint, say H0 was some generic hypothesis
> rather than residual normality. My question about whether the
> significance should be small or large depending on whether I'm
> interested resoundingly showing the resonableness of rejecting or not
> rejecting H0 still seems to hold.

I think your basic intuition is right: Other things being equal, a _larger_ p value tends to indicate that the data are _less discrepant_ from what Ho would predict.

But this view is so oversimplified that it can easily be misleading. For example, the p value might be large because there isn't much data or because there is lots of random error, and in neither case should you conclude that the data provide good support for Ho.

When the research goal is to show that Ho is true to a good approximation, Ho testing is just not a good method. The confidence interval approach is much more informative in most such situations, because they allow conclusions of the form "Ho is not wrong by more than X units". CIs are not easily adapted to your original question of checking for normality, though, AFAIK.

Date Subject Author
4/23/13 Paul
4/23/13 Richard Ulrich
4/23/13 Paul
4/23/13 David Jones
4/25/13 Jeff Miller
4/26/13 David Jones
4/26/13 Herman Rubin
4/24/13 Luis A. Afonso