The Math Forum

Search All of the Math Forum:

Views expressed in these public forums are not endorsed by NCTM or The Math Forum.

Math Forum » Discussions » sci.math.* » sci.stat.math

Notice: We are no longer accepting new posts, but the forums will continue to be readable.

Topic: Trying to understand Bayes and Hypothesis
Replies: 11   Last Post: Feb 22, 2013 3:09 AM

Advanced Search

Back to Topic List Back to Topic List Jump to Tree View Jump to Tree View   Messages: [ Previous | Next ]
David Jones

Posts: 80
Registered: 2/9/12
Re: Trying to understand Bayes and Hypothesis
Posted: Feb 18, 2013 9:16 AM
  Click to see the message monospaced in plain text Plain Text   Click to reply to this topic Reply

"Cagdas Ozgenc" wrote in message


I am confused with the usage of Bayes with model selection.

I frequently see the following notation:

P(H | D) = P(D | H)*P(H) / P(D) where H is hypothesis and D is data.

It's Bayes rule. What I don't understand is the following. If in reality D ~
N(m,v) and my hypothesis is that D ~ (m',v) where m is different from m' and
if all hypothesis are equally likely

P(D) = sum P(D|H)*P(H)dH is not equal to true P(D), or is it?


The standard notation is sloppy notation. If you use "K" to represent what
is known before observing data "D", then

P(H | D,K) = P(D | H,K)*P(H|K) / P(D|K)

and then go on as you were, you get

P(D |K) = sum P(D|H,K)*P(H|K) dH

... which at least illustrates your concern.

"True P(D)" can be thought of as P(D | infinite pre-knowledge), while Bayes'
Rule requires P(D |K)=P(D |actual pre-knowledge).

David Jones

Point your RSS reader here for a feed of the latest messages in this topic.

[Privacy Policy] [Terms of Use]

© The Math Forum at NCTM 1994-2018. All Rights Reserved.