Excel + Calculations

  1. StevieTNZ

    StevieTNZ 1,168
    Gold Member

    Hi there,

    If I perform the following calculation in Excel:

    I get: 100,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000

    Shouldn't the answer be:
  2. jcsd
  3. No, the answer will be constrained by the number of bits used by the computer to represent the numbers, and you've got WAY more than it can handle, so the 50 gets dropped as a rounding error.
  4. jtbell

    Staff: Mentor

  5. StevieTNZ

    StevieTNZ 1,168
    Gold Member

    Is there any other program out there that will present the result given in my original post?
  6. Lots of other programs can do that.
    Computer Algebra Systems, like Mathematica, Sage, Maxima, Reduce, Maple... all do that.

    Some calculator programs, like bc and many others do that.

    Many programming languages, like Icon, Java... do that, don't be fooled by those who think 64 bits is big.
  7. Chronos

    Chronos 10,348
    Science Advisor
    Gold Member

    64 bits is chump change for deep calculations. You need a monster computer to process calculations beyond a few hundred decimal points. That is why numerical analysis takes so long and is so incredibly expensive.
  8. harborsparrow

    harborsparrow 423
    Gold Member

    Just for grins, try putting the smaller number first.
  9. Do you really think that's going to have any effect on the fact that the larger number is WAY bigger than Excel can handle as an integer?
  10. harborsparrow

    harborsparrow 423
    Gold Member

    Sometimes it does help to prevent loss of precision by putting the smaller number first, when there is a huge range of magnitude difference between two operands.
  11. Yes, and that does not answer my question at all. I am asking about a specific case.
Know someone interested in this topic? Share this thead via email, Google+, Twitter, or Facebook

Have something to add?

Draft saved Draft deleted