How to limit rounding in matrix division
2 Ansichten (letzte 30 Tage)
Ältere Kommentare anzeigen
I've a 2D matrix with values ranging from about 40 to 100. I'm dividing each entry value by 98 and for some reason, it's rounding my answers to 0 and 1. How can I limit this and get more decimal places? Or even better, how can I store each entry as a fraction? The matrix dimensions are 3456x5184 uint8.
0 Kommentare
Antworten (1)
Chris Turnes
am 15 Mär. 2016
Your last sentence has the answer: your data type is uint8. Dividing a uint8 by a uint8 is going to give you another integer, so you won't get any decimal places.
Your options are to convert to either double or single and do the operation, or as you said you can store each entry as a fraction. Since they are uint8, every entry of the matrix will contain the numerator, and every denominator is 98 -- so you already have all of the information.
0 Kommentare
Siehe auch
Kategorien
Mehr zu Logical finden Sie in Help Center und File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!