error (rounding or user) in simple math op
5 Ansichten (letzte 30 Tage)
Ältere Kommentare anzeigen
I just noticed odd behavior in R2012b that really seems like an error though perhaps I'm making a foolish error?
I enter the following >> 2.7+1.8*[1,2,3,4,5,6,7,8,9]
I expect 4.5 6.3 8.1 9.9 11.7 13.5 15.3 17.1 18.9
I get: ans =
Columns 1 through 5
4.500000000000000 6.300000000000001 8.100000000000001 9.900000000000000 11.699999999999999
Columns 6 through 9
13.500000000000000 15.300000000000001 17.100000000000001 18.899999999999999
This seems odd to me for obvious reasons. Even something simple like
>> 1.8*9
ans =
16.199999999999999
how could this be happening?
Thank you
(p.s. its 8.0.0.783 R2012b)
0 Kommentare
Akzeptierte Antwort
Azzi Abdelmalek
am 8 Jan. 2013
Bearbeitet: Azzi Abdelmalek
am 8 Jan. 2013
Use
format short
The problem is simply caused by the way, real data are stored in memory
0 Kommentare
Weitere Antworten (1)
José-Luis
am 8 Jan. 2013
It is due to numerical precision, and is expected behavior.
Siehe auch
Kategorien
Mehr zu Logical finden Sie in Help Center und File Exchange
Produkte
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!