Von Neumann Entropy: Temperature & Info Explained

Click For Summary
SUMMARY

The discussion clarifies the distinction between thermodynamic entropy and von Neumann entropy, emphasizing that thermodynamic entropy is defined in the context of Gibbs equilibrium states, while von Neumann entropy applies to all quantum states. The relationship between temperature and von Neumann entropy is highlighted as non-existent for non-equilibrium states. Additionally, the connection between information theory and thermodynamics is explored, particularly through the equivalence of Shannon and Boltzmann entropy, as discussed in Edwin Jaynes' work.

PREREQUISITES
  • Understanding of Gibbs equilibrium states and Hamiltonians
  • Familiarity with von Neumann entropy and its mathematical formulation
  • Knowledge of Shannon entropy and its relation to probability distributions
  • Basic concepts of quantum information theory
NEXT STEPS
  • Study the mathematical formulation of Gibbs equilibrium states and their significance
  • Explore the relationship between Shannon entropy and Boltzmann entropy in detail
  • Read the paper by Plenio and Vitelli on quantum information and von Neumann entropy
  • Investigate the implications of thermalization on quantum information as discussed in the indicated paper
USEFUL FOR

Physicists, quantum information theorists, and anyone interested in the intersection of thermodynamics and information theory will benefit from this discussion.

touqra
Messages
284
Reaction score
0
What's the difference between thermodynamic entropy and von Neumann entropy? In particular, how is temperature related to the von Neumann entropy?
Also, what has information got to do with these two entropies?
 
Physics news on Phys.org
touqra said:
What's the difference between thermodynamic entropy and von Neumann entropy? In particular, how is temperature related to the von Neumann entropy?
Also, what has information got to do with these two entropies?
Hi, thermodynamic entropy is the entropy of the Gibbs equilibrium state
s := exp( - beta H)/trace(exp( - beta H)/) where beta is to be interpreted as the inverse temperature and H as the Hamiltonian. The Von Neumann entropy equals - trace (s log s). It is just that this last formula makes sense for ALL states (ie. semi positive definite matrices with trace equal to unity). Therefore Von Neumann entropy does NOT relate in general to any meaningful notion of temperature.

Cheers,

Careful
 
Thermodynamic entropy is the same as Shannon Entropy (see http://en.wikipedia.org/wiki/Shannon_entropy) , and it is a measure of how much information is encoded in a probability distribution. The relationship between Information Theory and Thermodynamics indicated by the equality of Shannon and Boltzmann entropy were beautifully described in the papers of Jaynes (see http://en.wikipedia.org/wiki/Edwin_Jaynes) .

The von Neumann entropy is the QM analogous and its relation to Quantum Information Theory is explained in a very simple way in a paper by Plenio and Vitelli that you can find in

http://arxiv.org/abs/quant-ph/0103108
 
Last edited by a moderator:
Alamino said:
Thermodynamic entropy is the same as Shannon Entropy (see http://en.wikipedia.org/wiki/Shannon_entropy) , and it is a measure of how much information is encoded in a probability distribution. The relationship between Information Theory and Thermodynamics indicated by the equality of Shannon and Boltzmann entropy were beautifully described in the papers of Jaynes (see http://en.wikipedia.org/wiki/Edwin_Jaynes) .

The question touqra posed was how Von Neumann entropy relates to a *physical* temperature. There exists no good physical notion of temperature for a general state which is not a thermal equilibrium (ie. Gibbs) state AFAIK. Therefore, the statement that thermodynamic entropy equals Von Neumann entropy is extremely misleading to say the very least.
 
Last edited by a moderator:
I don't remembered saying "that thermodynamic entropy equals Von Neumann entropy"... I said "analogous", what can be esily seen by the similarity of both formulas. And I remembered that he also asked about the relation of both entropies with respect to information, which was what my post was about.

Anyway, the last paper I indicated talks about the erasure of quantum information by thermalization and indicates where temperature enters in this matter (particualrly, look at equation (47)).
 

Similar threads

  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 7 ·
Replies
7
Views
3K