The answer of a 2 sig calculation 0,098 = 0,10 ?

  • Context: High School 
  • Thread starter Thread starter QED-Kasper
  • Start date Start date
  • Tags Tags
    Calculation
Click For Summary

Discussion Overview

The discussion revolves around the treatment of significant figures in calculations, specifically addressing the case of an answer calculated as 0.098 and its comparison to a rounded answer of 0.10. Participants explore the implications of significant figures in the context of a university examination problem, questioning the correctness of both representations.

Discussion Character

  • Debate/contested
  • Mathematical reasoning

Main Points Raised

  • One participant notes that both 0.098 and 0.10 have two significant figures, raising the question of which is the correct representation.
  • Another participant argues that 0.098 is more informative and adheres to the significant figure rules, while 0.10 is a rounded version.
  • Concerns are raised about the accuracy of answers in relation to the number of significant figures, suggesting that rounding may lead to a loss of precision.
  • Some participants discuss the nature of significant figures as a method of error propagation, indicating that the context of measurement uncertainty is important.
  • A later reply questions the need to round a number that is already presented in two significant figures, suggesting that rounding could lead to a misrepresentation of precision.

Areas of Agreement / Disagreement

Participants express differing views on whether 0.098 or 0.10 is the more appropriate answer, indicating that there is no consensus on the matter. The discussion remains unresolved regarding the best practice for reporting significant figures in this context.

Contextual Notes

Participants highlight the potential for loss of accuracy with multiple steps in calculations and the importance of understanding how significant figures relate to measurement uncertainty. There is also mention of the variability in exam answer correctness.

QED-Kasper
Messages
32
Reaction score
0
the answer of a "2 sig" calculation 0,098 = 0,10 ?

I did some university entry examination questions. There were values of some properties like mass, gravity etc given, they all had 2 significant figures. After using them in my calculations for some problem, I got the following answer on my calculator: 0.098. So sticking to the rule of giving your answer to the same sig. figures as the measurement with the least sig. figures I left that as my answer. However the answer on the solution sheet was rounded to 0.10, which also has 2 sig figures.

Both answers having the same amount of sig figures, which one is correct and why? Thanks :)
 
Last edited:
Physics news on Phys.org


0.098 is 2 sig figures, 9.8E-2
 


You must have raced trough my post very fast, haha. I know what significant figures are without any problem. The problem is that the solution sheet gives the answer to some question as 0,10. But I left my answer as 0,098. Which is what i got on my calculator after doing the calculation (involving only multiplication and division) for the problem. I did that because this answer has two significant figures so it complies with the "sig. fig. rule".

So the problem is that both answers have two sig. figs., but one has been rounded from 0,098 (which is the answer on the calculator) to 0,10 and the other is the answer calculated without rounding. I was wondering why the book gives the answer as 0.10 if 0,098 has two significant figures already and needs no rounding.
 


You could argue that if you have a lot of steps with only 2sf then your answer loses 1% accuracy at each stop so quoting 2sf when the answer is so close to 0.1 is a bit optimistic.
But in that case the answer should be 0.1

Exams answers aren;t always correct - TAs are human too.
 


I'd be inclined to agree with you that 0.098 is correct, or at least better, since it's more informative. Both answers do follow the "rule" of keeping the fewest significant figures in a product.

To be honest, the whole significant figure system is just a time-saving approximation for error propagation. In a real experiment you'd probably quote your answer plus-or-minus some calculated uncertainty, and the uncertainty would tell you how many digits are meaningful.
 


Ok guys, that should do. Thank you for helping me :)
 


diazona said:
To be honest, the whole significant figure system is just a time-saving approximation for error propagation.

Which is a very good point: 0.10 means "between 0.095 and 0.105", i.e. you know it to +/- 5%. 0.98 means "between 0.975 and 0.985", or +/- 0.5%. This could be important.
 


So what is the convention in these type of situations? Do you leave it to be 0.098 (i.e. +/- 0,0005) as was the exact result on the calculator (with all values used in the calculation having two significant figures), or do you round up to 0.10 (i.e. +/- 0,005)?
Both answers are correct to two significant figures. It's a special situation because the result on the calculator is so close to the number 10.
 


Question is, why are you even touching a number which is already in 2 s.f. format?write the answer as 9.8e-2; then rounding to 10e-2 is actually making it one significant figure.
 
Last edited:

Similar threads

Replies
13
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 4 ·
Replies
4
Views
4K
Replies
7
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 19 ·
Replies
19
Views
7K
  • · Replies 10 ·
Replies
10
Views
7K
Replies
1
Views
2K
  • · Replies 4 ·
Replies
4
Views
4K
Replies
7
Views
3K