The Math Forum

Search All of the Math Forum:

Views expressed in these public forums are not endorsed by NCTM or The Math Forum.

Math Forum » Discussions » Software » comp.soft-sys.matlab

Notice: We are no longer accepting new posts, but the forums will continue to be readable.

Topic: How to avoid wrong answers in simple arithmetic expressions.
Replies: 13   Last Post: Jan 20, 2013 7:18 AM

Advanced Search

Back to Topic List Back to Topic List Jump to Tree View Jump to Tree View   Messages: [ Previous | Next ]

Posts: 9,850
Registered: 6/7/07
Re: How to avoid wrong answers in simple arithmetic expressions.
Posted: Jan 19, 2013 8:53 AM
  Click to see the message monospaced in plain text Plain Text   Click to reply to this topic Reply

On 1/19/2013 1:04 AM, SK wrote:

> But, due to rounding error, this gives a wrong answer for example for a
> = 135.01.
> The problem does not go away even if I replace the last line by a =
> rem(a, v(i)).
> How does one avoid such issues in general?

Scaling and/or fixed point are common techniques...


Point your RSS reader here for a feed of the latest messages in this topic.

[Privacy Policy] [Terms of Use]

© The Math Forum at NCTM 1994-2018. All Rights Reserved.