Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Entropy and information: Do physicists still believe so?

  1. Dec 8, 2007 #1


    User Avatar

    The entropy of a system is
    S = k*ln W
    If we obtain some information about the microstates, e.g. know the location and velocities of some of the molecules, then W is decreased by a amount w, so
    S1 = k*ln(W-w)
    That is an decrease in entropy, i.e. S1 < S.

    Do physicists still "believe" so?
  2. jcsd
  3. Dec 8, 2007 #2


    User Avatar
    Staff Emeritus
    Science Advisor
    Gold Member

    Yes, at least for von Neumann entropy. The point is that to "know" this microstate information, means that you've limited the number of states the system can be in because now it are those microstates that are compatible with your information: the only way to know that information, is by forcing it somehow in a subset of states.
    In practice this doesn't make any difference, because for a statistically significant number of particles (from the moment it starts making sense doing thermodynamics), the amount of knowledge you'd need to gather is so huge before it starts influencing the numerical value of entropy, that it is not feasible.

    The reason why this lowers entropy is that you can USE that information to go to a "real" lower-entropy state.

    Imagine a gas in a box, which is a mixture of two components A and B. Now, you know that the entropy of this mixture is higher than if component A was in the left half of the box and component B in the right half (eventually with a wall in between). It is the entropy of mixture.
    But imagine that somehow, we know all the microstates of motion of all the particles A and B. Imagine that we have still a wall in the box, but this time with a tiny shutter. We could use all that information to pilot the "Maxwell demon", each time we KNOW that a molecule A is going to the left, or a molecule B is going to the right.
    So we could go back to the state before the mixture, without (with an ideal demon) spending any "entropy" elsewhere.
    Last edited: Dec 8, 2007
  4. Dec 9, 2007 #3


    User Avatar

    But also in "classical" entropy?

    So what is preventing us from being such a demon? Do you imply that the act of information acquisition increases the entropy?
  5. Dec 9, 2007 #4


    User Avatar
    Science Advisor
    Gold Member

    No, as it turns out it is the act of ERASING information that increases the entropy by an amount kb ln 2. This can actually be shown experimentally. There is a whole field called "reversible computing" where people study circuits where information is never erased which actually reduces the energy consumption somewhat.
    It is also a field that has become increasingly important over the past decade or so since it turns out that quantum computers must be reversible in order to work; meaning many results from reversible computing are also applicable also to quantum computing.

    The "Maxwell's demon" paradox was one of the great unsolved mysteries in physics until it was solved about 80 years ago.
  6. Dec 9, 2007 #5


    User Avatar

    I agree.

    Really? - How? AFAIK "normal" computers don't come anywhere near that lower limit.

    More likely 40 years, Landauer published his paper in 1961, Bennett published his solution to MS in the same decade.
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook