Drexel dragonThe Math ForumDonate to the Math Forum



Search All of the Math Forum:

Views expressed in these public forums are not endorsed by Drexel University or The Math Forum.


Math Forum » Discussions » Software » comp.soft-sys.matlab

Topic: How to avoid wrong answers in simple arithmetic expressions.
Replies: 13   Last Post: Jan 20, 2013 7:18 AM

Advanced Search

Back to Topic List Back to Topic List Jump to Tree View Jump to Tree View   Messages: [ Previous | Next ]
dpb

Posts: 8,231
Registered: 6/7/07
Re: How to avoid wrong answers in simple arithmetic expressions.
Posted: Jan 19, 2013 8:53 AM
  Click to see the message monospaced in plain text Plain Text   Click to reply to this topic Reply

On 1/19/2013 1:04 AM, SK wrote:
...

> But, due to rounding error, this gives a wrong answer for example for a
> = 135.01.
> The problem does not go away even if I replace the last line by a =
> rem(a, v(i)).
> How does one avoid such issues in general?


Scaling and/or fixed point are common techniques...

--





Point your RSS reader here for a feed of the latest messages in this topic.

[Privacy Policy] [Terms of Use]

© Drexel University 1994-2014. All Rights Reserved.
The Math Forum is a research and educational enterprise of the Drexel University School of Education.