On Nov 2, VWWall <vw...@large.invalid> wrote: > > I strongly suggest, if you have some > > free neurons and time and nothing's good on > > tv, read Shannon's original paper. It's > > utterly fucking brilliant. There's no doubt, > > in Valhalla, Shannon shares a table with Einstein. > > I was at Bell Labs in 1949, and Betty Moore, Claude > Shannon's wife, worked in the same department.
Holy Methuselah, Batman! Did you get to shake Abe Lincoln's hand, too?
> > It's sort of funny, he called it communication > > theory, it was his disciples who popularized > > 'information theory'. > > Shannon took a very practical outlook on "information". > I recall how he would stop people in the halls and ask > them to guess the next letter in a sentence he'd show >them. I remember one as: "A motorcycle has no > reverse; it can not back up." He used this method > to determine the redundancy in the English language.
He estimated music contains 40 bits/second entropy. How close is MP3 to that?