Sig Fig Question Homework: What's Wrong?

  • Thread starter Thread starter ThatDude
  • Start date Start date
Click For Summary
SUMMARY

The discussion centers on the application of significant figures (sig figs) in calculations involving scientific notation. The user presents a subtraction problem: 1.00 x 10^-3 - 4.35 x 10^-5, leading to two different results based on the method used. The correct approach emphasizes rounding based on the least precise measurement, which in this case should yield 9.6 x 10^-4. The conclusion highlights that the last two digits in the subtraction do not provide meaningful precision due to the limitations of the original values.

PREREQUISITES
  • Understanding of significant figures in scientific calculations
  • Knowledge of scientific notation
  • Basic arithmetic operations with decimals
  • Familiarity with rounding rules in mathematics
NEXT STEPS
  • Study the rules of significant figures in detail
  • Practice converting between scientific notation and decimal form
  • Learn about precision and accuracy in measurements
  • Explore common pitfalls in calculations involving sig figs
USEFUL FOR

Students in science and mathematics, educators teaching significant figures, and anyone needing to perform precise calculations in scientific contexts.

ThatDude
Messages
33
Reaction score
0

Homework Statement


So basically, for a lab, I have to make a calculation abiding by the rules of sig figs, and it involves the subtraction of two numbers in scientific notation:

1.00 x10^-3 - 4.35 x10^-5

= 1.00 x10^-3 - 0.0435 x10^-3 ; therefore, we should round the final answer to two decimal places... which equals 9.57 x10^-4

But, when I do it the long way, like 0.00100 - 0.0000435, I get 0.0009565, this means we should round to 5 digits after the decimal point (from 0.00100), therefore the answer should be 9.6 x 10^-4.

So, both methods give me different values, where am I going wrong?
 
Physics news on Phys.org
When you wrote it out in terms of the largest number, you were at 10^(-3), so round to 2 digits in that place--then adjust for scientific notation, and you will end up with the same result you found "the long way".
 
0.00100
0.0000435-
0.0009565

Last two digits you get after subtraction (65) make no sense - you know nothing about what 35 was subtracted from. Final answer can be - at best - of the
0.000XX form.

Don't worry too much about sigfigs, while they are better than nothing when it comes with reporting accuracy, they are not used anywhere outside of the school.
 

Similar threads

  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 8 ·
Replies
8
Views
6K
Replies
4
Views
1K
  • · Replies 6 ·
Replies
6
Views
3K
Replies
13
Views
4K
  • · Replies 7 ·
Replies
7
Views
3K
Replies
3
Views
3K