Search All of the Math Forum:
Views expressed in these public forums are not endorsed by
NCTM or The Math Forum.



Re: What am I missing here?
Posted:
Jan 26, 2013 8:53 PM


Gautam Sethi <gautamsethi@gmail.com> wrote in message <e0cb6636306e4239a3c6be062decdcea@googlegroups.com>... > Folks, this is driving me nuts! Can someone explain what may be going on? ......          Welcome to the world of binary arithmetic, which is what your computer is using. It cannot get an exact result for .1, .2, .3, and .4, just as your decimal calculator cannot get an exact result for 1/3. All of your findings stem from that and the different roundings that are a consequence. Remember that the "==" and 'intersect' operations expect exact equality right down to the smallest bit.
Roger Stafford



