Search All of the Math Forum:

Views expressed in these public forums are not endorsed by Drexel University or The Math Forum.

Topic: information theory?
Replies: 83   Last Post: Dec 22, 2011 5:14 AM

 Messages: [ Previous | Next ]
 Peter Webb Posts: 151 Registered: 5/1/11
Re: information theory?
Posted: Nov 4, 2011 7:14 AM

<kym@kymhorsell.com> wrote in message
news:4eb3c38a\$0\$22471\$afc38c87@news.optusnet.com.au...
> In sci.math Robert Wessel <robertwessel2@yahoo.com> wrote:
> ...

>> Consider that high keystroke rates pretty much require chords, and a
>> chord is most certainly not three or four random keys, pressed at
>> different times and forces - rather they're a small subset of the
>> possible combinations of keys within a hand-span (or two hand-spans in
>> some cases), hit at the same time, and with the same force (in fact
>> there are less than about 10,000 chords). And just like English, you
>> can't really have random sequences, or you'd just have noise.
>>
>> Still, 40bps intuitively feels a bit light, but not by that much. I
>> expect that if Shannon said something like that, he was considering
>> music to be more along the lines of a MIDI stream than a digitized
>> sound file.

> ...
>
> Perhaps we could use spoken language as a guide to the auditory bidrate
> we've evolved to process. As Shannon estimated, each letter in English
> has only a couple bits of entropy, with normal reading speed (that
> uses the auditory processing -- the reason you can't count the number
> of words in a limerick without using your fingers) around 150 wpm.
> Let's call that 25 bps.
>
> 40 bps is then about the "square" (in log terms :) of our evolved language
> processing speeds.
>
> Maybe not such a bad estimate.
>
> The same disparity is then seen between normal good voice compression
> and the actually bitrate we operate on. I.e. 25 bps "back-end" processing
> speed, yet voice compression being still 1000s of bps.
>
> In some applications over the years I've used speach-to-text and
> text-to-speach
> over very low speed lines as a slap-dash compression method. With a bit
> of a phoneme "nomenclator" it wasn't too bad. No doubt the idea is still
> in
> use, but I don't think I've heard of it in preference to straight dsp
> methods.
>

I had a play with a TI phoneme generator chip hooked up to a 6502
microproceesor in 1979 or 80. Couldn't get a decent "fuck" out of it - came
out as a flat "fut". Times have changed.

> --
> co2 has no climate forcing effect and is not a greenhouse gas and, for
> that
> matter, neither is water vapour.
> -- BONZO@27-32-240-172 [100s of nyms], 5 Sep 2009
>
> Earth's atmosphere contains natural greenhouse gases (mostly water
> vapor, carbon dioxide, and methane) which act to keep the lower layers
> of the atmosphere warmer than they otherwise would be without those gases.
> -- Dr Roy W. Spencer, "Global Warming", 2008
>
> This is what the real climate scientist Dr Roy Spencer said.
> -- BONZO@27-32-240-172 [daily nymshifter], 3 Mar 2011 16:29 +1100

Date Subject Author
10/31/11 Rich Delaney
11/1/11 Eric Jacobsen
11/1/11 Chris
11/1/11 Rich Delaney
11/1/11 jim
11/1/11 jim
11/1/11 Cindy
11/1/11 BJACOBY@teranews.com
11/2/11 jim
11/2/11 BJACOBY@teranews.com
11/2/11 jim
11/2/11 Cindy
11/2/11 jim
11/3/11 Cindy
11/1/11 BJACOBY@teranews.com
11/2/11 Les Cargill
11/3/11 Andrew Haley
11/3/11 gdewilde@gmail.com
11/2/11 Martin Brown
11/2/11 JohnF
11/2/11 Martin Brown
11/2/11 Martin Brown
11/2/11 Bernd Jendrissek
11/2/11 David Eather
11/2/11 Bill Unruh
11/24/11 J. Clarke
11/24/11 Martin Brown
11/25/11 Richard Outerbridge
11/25/11 Les Cargill
11/2/11 Rich Delaney
11/3/11 Martin Brown
11/2/11 Chris
11/2/11 robert bristow-johnson
11/2/11 Rich Delaney
11/2/11 VWWall
11/2/11 Richard Outerbridge
11/4/11 Frederick Williams
11/4/11 krw@att.bizzzzzzzzzzzz
11/4/11 jim
11/4/11 Jerry Avins
11/4/11 Greg Rose
11/5/11 Frederick Williams
11/5/11 Mike Terry
11/5/11 MrTallyman
11/5/11 R Kym Horsell
11/5/11 MrTallyman
11/5/11 unruh
11/5/11 krw@att.bizzzzzzzzzzzz
11/7/11 JW
11/7/11 krw@att.bizzzzzzzzzzzz
11/7/11 MrTallyman
11/7/11 krw@att.bizzzzzzzzzzzz
11/4/11 FigureItOut
11/6/11 jim
11/4/11 Rich Delaney
11/4/11 BJACOBY@teranews.com
11/4/11 Peter Webb
11/4/11 robertwessel2@yahoo.com
11/4/11 R Kym Horsell
11/4/11 Peter Webb
11/4/11 VWWall
11/4/11 jim
11/4/11 jim
11/4/11 Androcles
11/4/11 Martin Brown
11/4/11 Peter Webb
11/4/11 BJACOBY@teranews.com
11/4/11 Jerry Avins
12/21/11 Rich Delaney
12/21/11 Les Cargill
12/22/11 Richard Outerbridge
12/22/11 Martin Brown
12/22/11 Peter Webb
11/4/11 Androcles
11/4/11 Casper H.S. Dik
11/4/11 Bill Unruh
11/6/11 jim
11/7/11 jim
11/7/11 jim
11/8/11 jim
11/8/11 Michael A. Terrell
11/3/11 BJACOBY@teranews.com
11/3/11 Chris
11/3/11 Chris