Von Neumann Entropy: Temperature & Info Explained

Click For Summary

Discussion Overview

The discussion centers on the differences and relationships between thermodynamic entropy and von Neumann entropy, particularly in the context of temperature and information theory. It explores theoretical aspects and conceptual clarifications regarding these types of entropy.

Discussion Character

  • Exploratory
  • Technical explanation
  • Conceptual clarification
  • Debate/contested

Main Points Raised

  • Some participants assert that thermodynamic entropy is equivalent to Shannon entropy, which measures information in a probability distribution.
  • Others argue that von Neumann entropy does not generally relate to a meaningful notion of temperature, especially for states not in thermal equilibrium.
  • One participant highlights that while there are similarities in the formulas for thermodynamic and von Neumann entropy, they are not equivalent, emphasizing the misleading nature of such a statement.
  • There is mention of the relationship between information theory and thermodynamics, particularly referencing the works of Jaynes and others.
  • A later reply discusses the erasure of quantum information through thermalization and indicates where temperature is relevant in this context.

Areas of Agreement / Disagreement

Participants express differing views on the relationship between thermodynamic and von Neumann entropy, with no consensus on whether they can be considered equivalent or analogous. The discussion remains unresolved regarding the implications of temperature in relation to von Neumann entropy.

Contextual Notes

Some claims depend on specific interpretations of entropy and temperature, and there are unresolved mathematical steps regarding the definitions and applications of these concepts.

touqra
Messages
284
Reaction score
0
What's the difference between thermodynamic entropy and von Neumann entropy? In particular, how is temperature related to the von Neumann entropy?
Also, what has information got to do with these two entropies?
 
Physics news on Phys.org
touqra said:
What's the difference between thermodynamic entropy and von Neumann entropy? In particular, how is temperature related to the von Neumann entropy?
Also, what has information got to do with these two entropies?
Hi, thermodynamic entropy is the entropy of the Gibbs equilibrium state
s := exp( - beta H)/trace(exp( - beta H)/) where beta is to be interpreted as the inverse temperature and H as the Hamiltonian. The Von Neumann entropy equals - trace (s log s). It is just that this last formula makes sense for ALL states (ie. semi positive definite matrices with trace equal to unity). Therefore Von Neumann entropy does NOT relate in general to any meaningful notion of temperature.

Cheers,

Careful
 
Thermodynamic entropy is the same as Shannon Entropy (see http://en.wikipedia.org/wiki/Shannon_entropy) , and it is a measure of how much information is encoded in a probability distribution. The relationship between Information Theory and Thermodynamics indicated by the equality of Shannon and Boltzmann entropy were beautifully described in the papers of Jaynes (see http://en.wikipedia.org/wiki/Edwin_Jaynes) .

The von Neumann entropy is the QM analogous and its relation to Quantum Information Theory is explained in a very simple way in a paper by Plenio and Vitelli that you can find in

http://arxiv.org/abs/quant-ph/0103108
 
Last edited by a moderator:
Alamino said:
Thermodynamic entropy is the same as Shannon Entropy (see http://en.wikipedia.org/wiki/Shannon_entropy) , and it is a measure of how much information is encoded in a probability distribution. The relationship between Information Theory and Thermodynamics indicated by the equality of Shannon and Boltzmann entropy were beautifully described in the papers of Jaynes (see http://en.wikipedia.org/wiki/Edwin_Jaynes) .

The question touqra posed was how Von Neumann entropy relates to a *physical* temperature. There exists no good physical notion of temperature for a general state which is not a thermal equilibrium (ie. Gibbs) state AFAIK. Therefore, the statement that thermodynamic entropy equals Von Neumann entropy is extremely misleading to say the very least.
 
Last edited by a moderator:
I don't remembered saying "that thermodynamic entropy equals Von Neumann entropy"... I said "analogous", what can be esily seen by the similarity of both formulas. And I remembered that he also asked about the relation of both entropies with respect to information, which was what my post was about.

Anyway, the last paper I indicated talks about the erasure of quantum information by thermalization and indicates where temperature enters in this matter (particualrly, look at equation (47)).
 

Similar threads

  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 7 ·
Replies
7
Views
3K