Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Bayesian Stat Mech reverses Entropy?

  1. Oct 5, 2004 #1

    selfAdjoint

    User Avatar
    Staff Emeritus
    Gold Member
    Dearly Missed

    Cosma Shalizi has a brief paper in the arxiv:

    http://www.arxiv.org/PS_cache/cond-mat/pdf/0410/0410063.pdf

    containing a proof that if you use Bayesian degree of belief oriented probability in forming statistical mechanics a la Jaynes, entropy comes out non-increasing; the arrow of time points backwards! Even if you replace full Bayesian statistics with the maximum entropy formalism, the result still holds. It looks like Shalizi himself is stunned by the result; he has noted on the paper "Comments unusually welcome".
     
  2. jcsd
  3. Oct 5, 2004 #2
    A fascinating paper. Although I am not overly familiar with statistical mechanics, the paper isn't that hard to follow. I suspect his suggestion that Assumption 3 is invalid is correct.

    It reminds me of the old axiom we had in the control room of a nuclear power plant when something went wrong "Whatever you just did, undo it."
     
  4. Oct 5, 2004 #3

    selfAdjoint

    User Avatar
    Staff Emeritus
    Gold Member
    Dearly Missed

    Yes I agree. For those who can't read the paper the three assumptions from which Shalizi derives the reverse arrow of time are:
    1. The microcanonical probability function is time-symmetric.
    2. Physical evolution proceeds according to Bayesian statistics.
    3. The information-theoretic entropy of the microcanonical proibability distribution is equal to the thermodynamic entropy of the macrocanonical system.
     
  5. Oct 5, 2004 #4
    You know the more I think about it, the more obvious it seems to me that assumption 3 is flawed. The connection between the two entropies seems pretty tenuous at best.
     
  6. Oct 8, 2004 #5

    selfAdjoint

    User Avatar
    Staff Emeritus
    Gold Member
    Dearly Missed

    Shalizi has now provided a discussion in ordinary language of his result on his blog.
    He repeats the preference for statement 3 to go, but it turns out his real target is using Bayesian philosophy in physics. Does water boil because I believe it will? Or because some ideal well informed observer (God?) does? Cutting the link between information entropy and thermodynamic entropy will advance his program to knock this stuff on the head.
     
  7. Oct 9, 2004 #6
    At the risk of getting this thread moved to the philosophy section, I'll comment on Bayesian philosophy in physics. In my humble opinion, it is an overinterpretation of what Bayes' Theorem means. Bayes' Theorem allows you to determine the probability of causes. Given an event, and several possible causes, you can determine, using Bayes' Theorem which is the most likely cause. That's it. To read more into it is a mistake.

    I see overintrepretation of results as a big problem in physics today, particularly in quantum mechanics.
     
  8. Oct 9, 2004 #7

    selfAdjoint

    User Avatar
    Staff Emeritus
    Gold Member
    Dearly Missed

    I agree, geometer. Reification of mathematical objects has e'er been the shortcoming of physicists.
     
  9. Oct 9, 2004 #8

    pervect

    User Avatar
    Staff Emeritus
    Science Advisor

    Frequentism is IMO too restrictive, however. One often wishes to apply probability theory in situations that occur only once. It's a lot simpler IMO to get rid of the idea of "ensembles", and just go with Bayes rule as the necessary and sufficient condition to be able to apply probability theory to a problem.

    Thermodynamics is a lot trickier than it looks. There are other flaws with the idea that thermodynamics arises simply from probability theory, IMO, the main one being Poincaire recurrence.

    Anyway, that's my $.02.
     
  10. Oct 9, 2004 #9

    Chronos

    User Avatar
    Science Advisor
    Gold Member
    2015 Award

    I agree with pervect. In some respects, this treatment strikes me as a backdoor Maxwell's demon. Information is negentropy and increasing the amount of information collected increases negentropy - which superficially appears to reduce the total entropy of the system [i.e., reverses the arrow of time]. The information, however, is not free. Obtaining it imparts enough entropy to the system to offset the negentropy gains. This suggests the problem is not necessarily with the assumptions.
     
Know someone interested in this topic? Share this thread via Reddit, Google+, Twitter, or Facebook

Have something to add?



Similar Discussions: Bayesian Stat Mech reverses Entropy?
  1. Reversing Entropy (Replies: 13)

  2. Entropy reversals (Replies: 21)

Loading...