Entropy, Relative entropy, Mutual information

  • Thread starter atyy
  • Start date

atyy

Science Advisor
13,549
1,645
The Bekenstein-Hawking entropy is expected to be, and has been shown to be in some cases, derived from counting states.

However, entropy is not defined for continuous probability densities, and so I have heard it said that relative entropy (of which the mutual information is a form) is more fundamental.

I think in classical statistical mechanics, the entropy is computed using canonical coordinates, since the phase space is continuous, which is one way to get round the need for discrete probability distributions.

In the context of string theory and quantum gravity, is entropy or the relative entropy more fundamental?


Some possibly related comments:
"the mutual information offers a more refined probe of the entanglement structure of quantum field theories because it remains finite in the continuum limit" http://arxiv.org/abs/1010.4038
 

Want to reply to this thread?

"Entropy, Relative entropy, Mutual information" You must log in or register to reply here.

Related Threads for: Entropy, Relative entropy, Mutual information

Replies
2
Views
746
Replies
3
Views
3K
Replies
65
Views
13K
Replies
1
Views
981
  • Posted
Replies
5
Views
2K
  • Posted
Replies
4
Views
2K
  • Posted
Replies
2
Views
3K
  • Posted
Replies
9
Views
4K

Physics Forums Values

We Value Quality
• Topics based on mainstream science
• Proper English grammar and spelling
We Value Civility
• Positive and compassionate attitudes
• Patience while debating
We Value Productivity
• Disciplined to remain on-topic
• Recognition of own weaknesses
• Solo and co-op problem solving

Hot Threads

Top