Modulo of realmax in matlab
5 Ansichten (letzte 30 Tage)
Ältere Kommentare anzeigen
Mayank Bajpai
am 31 Okt. 2020
Kommentiert: Ameer Hamza
am 31 Okt. 2020
I am getting the same results for the following:
mod(realmax,10^9 + 7) and mod(realmax-10000,10^9 + 7) or subtracting any other number from realmax.
What is the reason for this and how to resolve it?
0 Kommentare
Akzeptierte Antwort
Ameer Hamza
am 31 Okt. 2020
MATLAB double datatype is based on IEEE-754 format: https://en.wikipedia.org/wiki/Double-precision_floating-point_format. This is a finite precision datatype, and you cannot represent all possible integer values accurately in this format.
flintmax
gives the maximum consecutive integer values, which can be accurately represented in this format. Above that, only a few integer values are precisely represented. In your case, realmax-10000 will just round off to realmax since double() data type does not have the precision to represent it.
2 Kommentare
Weitere Antworten (0)
Siehe auch
Kategorien
Mehr zu Numeric Types finden Sie in Help Center und File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!