Recent content by mathnewb99

Thanks for the reply. That makes a lot of sense. In the example I have the team is dividing a dollar value with 2 decimal places by a decimal that has 3 decimal places. In this case applying "round to the worst precision" would mean the final result should be reported with 2 decimal places to...

We have some people trying to report four places to the right of the decimal with inputs that rounded to 2 and 3 decimal places. Can you please articulate why it is impossible to guarantee four decimal precision? I have been unsuccessful in my attempts and am looking for help from someone with a...