Is 0^0 indefinite in Von Neuman Entropy?

  • Context: High School 
  • Thread starter Thread starter anuttarasammyak
  • Start date Start date
Click For Summary

Discussion Overview

The discussion centers on the mathematical treatment of the expression \(0^0\) in the context of Von Neumann entropy, specifically examining whether it is appropriate to define \(p_j \log_e p_j\) as zero when \(p_j = 0\). Participants explore the implications of this definition for entropy calculations.

Discussion Character

  • Technical explanation
  • Mathematical reasoning
  • Debate/contested

Main Points Raised

  • Some participants question the mathematical validity of defining \(0^0\) as zero in the context of Von Neumann entropy.
  • One participant suggests that the limit \(\lim_{x \to 0} x \log(x) = 0\) supports the idea that defining the expression as zero is plausible, as it prevents impossible states from contributing to entropy.
  • Another participant attempts to derive the limit using a substitution \(y = 1/x\) and applies L'Hôpital's rule, expressing uncertainty about the validity of this approach for infinite limits.
  • A participant expresses confusion about a step in the derivation involving logarithms but later clarifies their understanding of the negative sign in the logarithmic transformation.
  • Further calculations are presented, with one participant confirming the correctness of the limit derived using L'Hôpital's rule.

Areas of Agreement / Disagreement

Participants do not reach a consensus on the treatment of \(0^0\) in Von Neumann entropy, with some supporting the definition as zero and others expressing uncertainty or questioning its validity.

Contextual Notes

There are unresolved mathematical steps and assumptions regarding the treatment of limits and the definition of \(0^0\) that may affect the discussion.

anuttarasammyak
Gold Member
Messages
3,098
Reaction score
1,571
TL;DR
Shannon and Von Neumann entropy assume x log_a x = 0 for limit of small x. Is it justified in mathematics ?
Hello. In Von Neuman Entropy
[tex]S(\rho):=-k_B \ \Sigma_j \ p_j \ \log_e \ p_j[/tex]
It is assumed that for ##p_j=0##
[tex]p_j \ \log_e p_j=0[/tex]
Is it correct mathematics though ##0^0## is indefinite.
 
Mathematics news on Phys.org
For positive real x you get ##\displaystyle \lim_{x \to 0} x log(x) = 0##. It's plausible to define the expression to be zero at x=0. That way impossible states do not contribute to the entropy, as expected.
 
  • Like
Likes   Reactions: dextercioby and anuttarasammyak
Thanks. I would derive it. Let y=1/x
[tex]\lim_{x \rightarrow +0} \ x \log x= - \lim_{y \rightarrow +\infty} \frac{\log y}{y} = - \lim_{y \rightarrow +\infty} \frac{1}{y} = -0[/tex]
At the last step I used L'Hopital's rule though I am not certain for this infinite limit. I should appreciate your advice.
 
I'm a bit confused on the first step you did, shouldn't you get ##\log (1/y)##?

Edit: oh, that's where the minus sign is from. Looks fine

I think you can just leave it as x also.

$$ x\log(x) = \frac{\log(x)}{ 1/x}.$$
 
Thanks. Yes, ##\log \frac{1}{y} = - \log y ## , I made.
Following your way
[tex]\lim \frac{\log x}{1/x}=\lim \frac{1/x}{-1/x^2} = - \lim x = -0[/tex]
Again I used L'hopital's rule.
 
Last edited:
That looks right to me!
 
  • Like
Likes   Reactions: anuttarasammyak

Similar threads

  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 9 ·
Replies
9
Views
3K
  • · Replies 4 ·
Replies
4
Views
3K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
Replies
2
Views
2K
Replies
4
Views
5K
  • · Replies 46 ·
2
Replies
46
Views
9K
  • · Replies 7 ·
Replies
7
Views
2K
Replies
4
Views
2K