That fixed it. Thanks!I think it’s due to the 1.13*100 being treated as a float ie it’s not the same as the integer value 113.
You could test this by using the int() function on 1.13*100 to see if that fixes it.
Here's the documentation for the gcd function in Excel:In Microsoft Excel, if I type in the formula =GCD(113,100) then it gives me the correct answer of 1. However, if I type in =GCD(1.13*100,100), which means the same thing, it tells me 4. What's going on and how can I fix it? Thanks
Due to the way that floating point numbers are stored, the value 1.13*100 turns out to be a little less than 113. This is true of computers in general, and isn't some bug in Excel. You can verify this by the formulaGCD(number1, [number2], ...)
The GCD function syntax has the following arguments:
- Number1, number2, ... Number1 is required, subsequent numbers are optional. 1 to 255 values. If any value is not an integer, it is truncated.
-(1.13*100 - 113)*10^6