primary school question!

17 Ansichten (letzte 30 Tage)
Wenjuan
Wenjuan am 28 Nov. 2020
Beantwortet: Image Analyst am 28 Nov. 2020
well, a silly question
why 0.07*400 is not equal to 28?
see screenshot;

Melden Sie sich an, um diese Frage zu beantworten.

Antworten (1)

Image Analyst
Image Analyst am 28 Nov. 2020
Truncation error due to double's only using 64 bits instead of an infinite number of bits. It will be off a very small amount, eps(28). See the FAQ for a thorough discussion:
https://matlab.fandom.com/wiki/FAQ#Why_is_0.3_-_0.2_-_0.1_.28or_similar.29_not_equal_to_zero.3F

Kategorien

Mehr zu MATLAB finden Sie in Help Center und File Exchange

Tags

Produkte


Version

R2020a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by