How is the division of two numbers carried out in Matlab?
127 Ansichten (letzte 30 Tage)
Ältere Kommentare anzeigen
The behavior is as expected when both the denominator and the numerator are in 'double' precision. If either of the two are integer, as in the example below, the rounding error yields unexpected division results.
double(475904) / double(512) = 929.5
int32(475904) / int32(512) = 930
int32(475904) / double(512) = 930
double(475904) / int32(512) = 930
Antworten (1)
John D'Errico
am 23 Mär. 2018
Bearbeitet: John D'Errico
am 23 Mär. 2018
Think about what the class of the result is. If you don't know how to use the class function to check that, then learn to read the output of the whos command. (In fact, in newer MATLAB releases, just displaying a variable at the command line tells you the class, if it is not a double.)
Then consider if the result is stored in an integer variable, then why would you expect a non-integer result? That is, an int32 cannot represent non-integers. So MATLAB stores only the integer part, essentially rounding to the nearest integer.
double(4) / int32(3)
ans =
int32
1
double(5) / int32(3)
ans =
int32
2
Siehe auch
Kategorien
Mehr zu Logical finden Sie in Help Center und File Exchange
Produkte
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!