B Is 0^0 indefinite in Von Neuman Entropy?

  • B
  • Thread starter Thread starter anuttarasammyak
  • Start date Start date
AI Thread Summary
The discussion centers on the treatment of the expression 0^0 in the context of Von Neumann entropy, specifically regarding the term p_j log_e p_j when p_j equals zero. It is argued that defining 0^0 as zero is mathematically plausible, as it aligns with the limit of x log(x) as x approaches zero, which equals zero. The use of L'Hôpital's rule is discussed to evaluate the limit, confirming that the expression behaves as expected in this context. Participants clarify the steps taken in their derivations, ultimately agreeing on the validity of the approach. The conversation concludes with a consensus on the mathematical treatment of the limit and its implications for entropy calculations.
anuttarasammyak
Gold Member
Messages
2,939
Reaction score
1,521
TL;DR Summary
Shannon and Von Neumann entropy assume x log_a x = 0 for limit of small x. Is it justified in mathematics ?
Hello. In Von Neuman Entropy
S(\rho):=-k_B \ \Sigma_j \ p_j \ \log_e \ p_j
It is assumed that for ##p_j=0##
p_j \ \log_e p_j=0
Is it correct mathematics though ##0^0## is indefinite.
 
Mathematics news on Phys.org
For positive real x you get ##\displaystyle \lim_{x \to 0} x log(x) = 0##. It's plausible to define the expression to be zero at x=0. That way impossible states do not contribute to the entropy, as expected.
 
  • Like
Likes dextercioby and anuttarasammyak
Thanks. I would derive it. Let y=1/x
\lim_{x \rightarrow +0} \ x \log x= - \lim_{y \rightarrow +\infty} \frac{\log y}{y} = - \lim_{y \rightarrow +\infty} \frac{1}{y} = -0
At the last step I used L'Hopital's rule though I am not certain for this infinite limit. I should appreciate your advice.
 
I'm a bit confused on the first step you did, shouldn't you get ##\log (1/y)##?

Edit: oh, that's where the minus sign is from. Looks fine

I think you can just leave it as x also.

$$ x\log(x) = \frac{\log(x)}{ 1/x}.$$
 
Thanks. Yes, ##\log \frac{1}{y} = - \log y ## , I made.
Following your way
\lim \frac{\log x}{1/x}=\lim \frac{1/x}{-1/x^2} = - \lim x = -0
Again I used L'hopital's rule.
 
Last edited:
That looks right to me!
 
  • Like
Likes anuttarasammyak
Thread 'Video on imaginary numbers and some queries'
Hi, I was watching the following video. I found some points confusing. Could you please help me to understand the gaps? Thanks, in advance! Question 1: Around 4:22, the video says the following. So for those mathematicians, negative numbers didn't exist. You could subtract, that is find the difference between two positive quantities, but you couldn't have a negative answer or negative coefficients. Mathematicians were so averse to negative numbers that there was no single quadratic...
Insights auto threads is broken atm, so I'm manually creating these for new Insight articles. In Dirac’s Principles of Quantum Mechanics published in 1930 he introduced a “convenient notation” he referred to as a “delta function” which he treated as a continuum analog to the discrete Kronecker delta. The Kronecker delta is simply the indexed components of the identity operator in matrix algebra Source: https://www.physicsforums.com/insights/what-exactly-is-diracs-delta-function/ by...
Thread 'Unit Circle Double Angle Derivations'
Here I made a terrible mistake of assuming this to be an equilateral triangle and set 2sinx=1 => x=pi/6. Although this did derive the double angle formulas it also led into a terrible mess trying to find all the combinations of sides. I must have been tired and just assumed 6x=180 and 2sinx=1. By that time, I was so mindset that I nearly scolded a person for even saying 90-x. I wonder if this is a case of biased observation that seeks to dis credit me like Jesus of Nazareth since in reality...
Back
Top