Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Prove that information is either increasing or remaining constant with time.

  1. Dec 3, 2011 #1
    Can you Prove that information is either increasing or remaining constant with time.
  2. jcsd
  3. Dec 3, 2011 #2


    User Avatar
    Gold Member

    In what context do you mean this?

    What do YOU think?
  4. Dec 3, 2011 #3
    I'm not sure about PROVE...but
    You might find Charles Seife's DECODING THE UNIVERSE an interesting read.
    here are a few insights from pages 71-87:

    For a view of bits versus entropy, see Landauer's principle
  5. Dec 3, 2011 #4
    1) Information as in physics.( Using which you can construct a just-destroyed building again.)
    2) As Entropy is a measure of information , can we say "as entropy increases, information too increase". ? If it is so, then information must be governed by laws of the universe, thus information in our universe may behave differently than information in other universe?
  6. Dec 3, 2011 #5
    First you would define information, which is not a physical property.

    Some guys define information as minus entropy. Then, using the second law, it is proved that information decreases or remains constant for isolated systems.
  7. Dec 3, 2011 #6
    Maybe you've already read this but I thought I'd post it:

    Computational capacity of the universe
  8. Dec 4, 2011 #7
    Information is not negative entropy , its like H(x) = E(I(x)).
    H, E, I are entropy, Expected value, Information respectively of a random variable x.

    Btw, it can never decrease. Its a known physical fact. (Even Steven Hawking accepted the mistake when once he said it is destroyed in black holes)
  9. Dec 4, 2011 #8
    As said it depends how you define information, because information is not a physical property. A very common definition

    but, of course, there are many more definitions.

    For the above common definition, information decreases when entropy increases. This is a well-known fact.

    Hawking notorious mistake about information in black holes was not referred to the definition of information that he used (which decreases when entropy increases), but to his silly attempt to obtain a non-unitary evolution from the unitary laws of theories as GR and QM. Indeed, in rigor his definition (as yours) would remain constant under the unitary laws of QM and GR.

    You continue without giving us a definition of information, but from your expressions I assume that you mean something as I(x)=-log p(x). This definition of information increases or remains constant because H≥0.
    Last edited: Dec 4, 2011
  10. Dec 4, 2011 #9
    What I understand by 'amount of information in the universe' is everything that had happened since the conception of the universe and everything currently exist. Which can be summed up as 'what currently exist'.
    Information can not 'die', but it can transform into other information. One can argue that new information is continuously created with time proving information is 'increasing'.
    But if you look deeper, the systems (or objects) that create new information had the POTENTIAL to create new information BURIED in them. In other words, it is actually transformation of one information into another.
    My conclusion? Total Information in the universe remain the SAME.

    Thanks [Bohm2] for the link. It's an interesting read. I'd be happy to argue with anyone who thinks the Universe is NOT a computer.
    Computational capacity of the universe
    http://arxiv.org/PS_cache/quant-ph/p.../0110141v1.pdf [Broken]
    Last edited by a moderator: May 5, 2017
  11. Dec 4, 2011 #10
    Now I am wondering why people are asking me to define information.
    I assume they might have seen different definitions in different fields. But are they really different! How can "information" be different from "information" just because its a part of different subject (scientific).
    Science should be able to define information in one precise way, so that even an 8 year old can understand in a crystal clear way.

    So, Can somebody define information for me from scientific point of view ?


    P.S. : I hate when people say - "forces" in chemistry is different than forces" in physics u know.
  12. Dec 4, 2011 #11
    Stephen Hawking and Kip Thorne had a bet going with John Preskill regarding whether or not information could be lost from the universe forever as it enters a black hole. Eventually, Stephen Hawking threw in the towel on "the black hole information paradox." Kip Thorne remains unconvinced that it has been proven that a black hole does not permanently remove information from the universe.

    So, to address your question, I don't think that anyone has mathematically proven (beyond a shadow of a doubt) that information is not decreasing (even locally, i.e. in the vicinity of a black hole)... or as you phrased it... that "information is either increasing or remaining the same."
  13. Dec 5, 2011 #12
    My mistake. H≥0 does not prove anything about information I(x) as defined above.

    I have been thinking about this and it can be proved that the positive definite character of the H function is compatible with I(x) increasing, decreasing, or remaining constant.
  14. Dec 5, 2011 #13
    As has been said to you information is not a physical property.

    In the International system of units you can find units for physical properties as energy, mass, length, time, electric charge, heat flux density, force, temperature, chemical composition and so on. But there is not SI unit for «information» because there is not such physical property.

    Information is a human concept. You can believe that something is information and other can believe the contrary.
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook