Entropy, Relative entropy, Mutual information

Click For Summary
SUMMARY

The discussion centers on the concepts of Bekenstein-Hawking entropy, relative entropy, and mutual information within the realms of statistical mechanics and quantum gravity. It asserts that while classical entropy is derived from discrete states, relative entropy is more fundamental due to its applicability in continuous probability densities. The conversation highlights the significance of mutual information as a tool for analyzing entanglement structures in quantum field theories, particularly noting its finiteness in the continuum limit.

PREREQUISITES
  • Understanding of Bekenstein-Hawking entropy
  • Familiarity with relative entropy and mutual information
  • Knowledge of classical statistical mechanics and canonical coordinates
  • Basic concepts of quantum field theories and entanglement
NEXT STEPS
  • Research the derivation of Bekenstein-Hawking entropy in various contexts
  • Explore the mathematical foundations of relative entropy
  • Study the role of mutual information in quantum field theories
  • Investigate the implications of entropy in string theory and quantum gravity
USEFUL FOR

Researchers in theoretical physics, particularly those focused on quantum gravity, statistical mechanics, and quantum information theory.

atyy
Science Advisor
Messages
15,170
Reaction score
3,378
The Bekenstein-Hawking entropy is expected to be, and has been shown to be in some cases, derived from counting states.

However, entropy is not defined for continuous probability densities, and so I have heard it said that relative entropy (of which the mutual information is a form) is more fundamental.

I think in classical statistical mechanics, the entropy is computed using canonical coordinates, since the phase space is continuous, which is one way to get round the need for discrete probability distributions.

In the context of string theory and quantum gravity, is entropy or the relative entropy more fundamental?Some possibly related comments:
"the mutual information offers a more refined probe of the entanglement structure of quantum field theories because it remains finite in the continuum limit" http://arxiv.org/abs/1010.4038
 

Similar threads

  • · Replies 9 ·
Replies
9
Views
3K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 21 ·
Replies
21
Views
6K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 3 ·
Replies
3
Views
4K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 3 ·
Replies
3
Views
3K