B Is 0^0 indefinite in Von Neuman Entropy?

  • B
  • Thread starter Thread starter anuttarasammyak
  • Start date Start date
AI Thread Summary
The discussion centers on the treatment of the expression 0^0 in the context of Von Neumann entropy, specifically regarding the term p_j log_e p_j when p_j equals zero. It is argued that defining 0^0 as zero is mathematically plausible, as it aligns with the limit of x log(x) as x approaches zero, which equals zero. The use of L'Hôpital's rule is discussed to evaluate the limit, confirming that the expression behaves as expected in this context. Participants clarify the steps taken in their derivations, ultimately agreeing on the validity of the approach. The conversation concludes with a consensus on the mathematical treatment of the limit and its implications for entropy calculations.
anuttarasammyak
Gold Member
Messages
2,931
Reaction score
1,521
TL;DR Summary
Shannon and Von Neumann entropy assume x log_a x = 0 for limit of small x. Is it justified in mathematics ?
Hello. In Von Neuman Entropy
S(\rho):=-k_B \ \Sigma_j \ p_j \ \log_e \ p_j
It is assumed that for ##p_j=0##
p_j \ \log_e p_j=0
Is it correct mathematics though ##0^0## is indefinite.
 
Mathematics news on Phys.org
For positive real x you get ##\displaystyle \lim_{x \to 0} x log(x) = 0##. It's plausible to define the expression to be zero at x=0. That way impossible states do not contribute to the entropy, as expected.
 
  • Like
Likes dextercioby and anuttarasammyak
Thanks. I would derive it. Let y=1/x
\lim_{x \rightarrow +0} \ x \log x= - \lim_{y \rightarrow +\infty} \frac{\log y}{y} = - \lim_{y \rightarrow +\infty} \frac{1}{y} = -0
At the last step I used L'Hopital's rule though I am not certain for this infinite limit. I should appreciate your advice.
 
I'm a bit confused on the first step you did, shouldn't you get ##\log (1/y)##?

Edit: oh, that's where the minus sign is from. Looks fine

I think you can just leave it as x also.

$$ x\log(x) = \frac{\log(x)}{ 1/x}.$$
 
Thanks. Yes, ##\log \frac{1}{y} = - \log y ## , I made.
Following your way
\lim \frac{\log x}{1/x}=\lim \frac{1/x}{-1/x^2} = - \lim x = -0
Again I used L'hopital's rule.
 
Last edited:
That looks right to me!
 
  • Like
Likes anuttarasammyak
Suppose ,instead of the usual x,y coordinate system with an I basis vector along the x -axis and a corresponding j basis vector along the y-axis we instead have a different pair of basis vectors ,call them e and f along their respective axes. I have seen that this is an important subject in maths My question is what physical applications does such a model apply to? I am asking here because I have devoted quite a lot of time in the past to understanding convectors and the dual...
Insights auto threads is broken atm, so I'm manually creating these for new Insight articles. In Dirac’s Principles of Quantum Mechanics published in 1930 he introduced a “convenient notation” he referred to as a “delta function” which he treated as a continuum analog to the discrete Kronecker delta. The Kronecker delta is simply the indexed components of the identity operator in matrix algebra Source: https://www.physicsforums.com/insights/what-exactly-is-diracs-delta-function/ by...
Back
Top