The Math Forum

Search All of the Math Forum:

Views expressed in these public forums are not endorsed by NCTM or The Math Forum.

Math Forum » Discussions » sci.math.* » sci.stat.math

Notice: We are no longer accepting new posts, but the forums will continue to be readable.

Topic: Please critique my scheme for re-weighting source data
Replies: 7   Last Post: May 27, 2012 11:57 AM

Advanced Search

Back to Topic List Back to Topic List Jump to Tree View Jump to Tree View   Messages: [ Previous | Next ]

Posts: 1,677
Registered: 12/1/07
Re: Please critique my scheme for re-weighting source data
Posted: Feb 23, 2012 6:19 PM
  Click to see the message monospaced in plain text Plain Text   Click to reply to this topic Reply

On Feb 23, 11:20 am, Jennifer Murphy <JenMur...@jm.invalid> wrote:
> On Thu, 23 Feb 2012 13:56:58 -0500, Rich Ulrich
> <> wrote:

> >You give no hint, that I notice, of what it is that you
> >are trying to accomplish.

> >For most purposes of inference that come to my mind,
> >the extreme cases -- the ones that you seem to propose
> >to drop -- are the most informative and most interesting.
> >So I conclude that your interests are probably the opposite
> >(in some fashion) from what my naive interests would be.

> >I repeat-- What are you trying to do?
> I am trying to calculate for each word the relative likeliness that it
> would be encountered by an average well-educated person in their daily
> activities: reading the paper, listening to the news, attending classes,
> talking to other people, reading books, etc.
> The raw scores that I have already do that, but I question the
> weighting.I do not think that the average person encounters the types of
> words typically found in academic journals at the same frequency as they
> would those found in newspapers or magazines. Therefore, I want to
> re-weight the five sources to reflect a more average experience.

The "average" well-educated person will never read an academic
journal. Whether or not a well-educated person will read a novel (or
fiction in general) will depend strongly on whether that person is
male or female.


Point your RSS reader here for a feed of the latest messages in this topic.

[Privacy Policy] [Terms of Use]

© The Math Forum at NCTM 1994-2018. All Rights Reserved.