The Math Forum

Search All of the Math Forum:

Views expressed in these public forums are not endorsed by NCTM or The Math Forum.

Math Forum » Discussions » Software » comp.soft-sys.matlab

Notice: We are no longer accepting new posts, but the forums will continue to be readable.

Topic: Floating Point Error? Maybe Bug?
Replies: 3   Last Post: Dec 30, 1997 12:44 PM

Advanced Search

Back to Topic List Back to Topic List Jump to Tree View Jump to Tree View   Messages: [ Previous | Next ]
James Rice

Posts: 1
Registered: 12/7/04
Floating Point Error? Maybe Bug?
Posted: Dec 29, 1997 2:39 PM
  Click to see the message monospaced in plain text Plain Text   Click to reply to this topic Reply

In a function I have written to create Non-Integer bit rate, I receive the
following problem.

fix(9*8.1+8.1)=80 this should be fix(9*8.1+8.1)=81 since (9*8.1+8.1) =81.0
but matlab comes up with 80.9999999999.

Is this me, or what? I have a Pentium 200 MMX. Is there a fix for this?

Change the AT in my e-mail address to @ to respond. I am trying to slow
down the automated spam.



Point your RSS reader here for a feed of the latest messages in this topic.

[Privacy Policy] [Terms of Use]

© The Math Forum at NCTM 1994-2018. All Rights Reserved.