Sig Fig Question Homework: What's Wrong?

  • Thread starter Thread starter ThatDude
  • Start date Start date
Click For Summary
The discussion centers on a homework problem involving significant figures in a subtraction calculation using scientific notation. The initial calculation yields two different results based on the method used: one suggests rounding to two decimal places, while the other indicates rounding to five digits after the decimal. The confusion arises from the treatment of significant figures and the precision of the numbers involved. The consensus is that the final answer should reflect the least precise measurement, leading to a result of 9.6 x 10^-4. Additionally, there is a note that while significant figures are important in academic settings, they are less relevant in practical applications outside of school.
ThatDude
Messages
33
Reaction score
0

Homework Statement


So basically, for a lab, I have to make a calculation abiding by the rules of sig figs, and it involves the subtraction of two numbers in scientific notation:

1.00 x10^-3 - 4.35 x10^-5

= 1.00 x10^-3 - 0.0435 x10^-3 ; therefore, we should round the final answer to two decimal places... which equals 9.57 x10^-4

But, when I do it the long way, like 0.00100 - 0.0000435, I get 0.0009565, this means we should round to 5 digits after the decimal point (from 0.00100), therefore the answer should be 9.6 x 10^-4.

So, both methods give me different values, where am I going wrong?
 
Physics news on Phys.org
When you wrote it out in terms of the largest number, you were at 10^(-3), so round to 2 digits in that place--then adjust for scientific notation, and you will end up with the same result you found "the long way".
 
0.00100
0.0000435-
0.0009565

Last two digits you get after subtraction (65) make no sense - you know nothing about what 35 was subtracted from. Final answer can be - at best - of the
0.000XX form.

Don't worry too much about sigfigs, while they are better than nothing when it comes with reporting accuracy, they are not used anywhere outside of the school.
 

Similar threads

  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 8 ·
Replies
8
Views
5K
Replies
4
Views
1K
  • · Replies 6 ·
Replies
6
Views
3K
Replies
13
Views
3K
  • · Replies 7 ·
Replies
7
Views
3K
Replies
3
Views
3K