Drexel dragonThe Math ForumDonate to the Math Forum



Search All of the Math Forum:

Views expressed in these public forums are not endorsed by Drexel University or The Math Forum.


Math Forum » Discussions » Software » comp.soft-sys.matlab

Topic: Computation precision on command line and in scripts
Replies: 8   Last Post: Feb 11, 2013 6:59 AM

Advanced Search

Back to Topic List Back to Topic List Jump to Tree View Jump to Tree View   Messages: [ Previous | Next ]
Bruno Luong

Posts: 8,573
Registered: 7/26/08
Re: Computation precision on command line and in scripts
Posted: Feb 7, 2013 9:42 AM
  Click to see the message monospaced in plain text Plain Text   Click to reply to this topic Reply

Should read:

>> 0.4+0.1+0.1+0.1+uint8(1)

ans =

2

>> uint8(1)+0.4+0.1+0.1+0.1

ans =

1

% Bruno



Point your RSS reader here for a feed of the latest messages in this topic.

[Privacy Policy] [Terms of Use]

© Drexel University 1994-2014. All Rights Reserved.
The Math Forum is a research and educational enterprise of the Drexel University School of Education.