Why Is Entropy Defined as the Logarithm of Multiplicity in Thermodynamics?

  • Context: Graduate 
  • Thread starter Thread starter aaaa202
  • Start date Start date
  • Tags Tags
    Entropy Thermodynamics
Click For Summary
SUMMARY

Entropy in thermodynamics is defined as S = k lnΩ, where Ω represents the multiplicity of microstates. The logarithmic function is utilized to ensure the additive property of entropy, which is essential for extensive quantities. This definition aligns with the principles of statistical mechanics, where entropy is consistent across various contexts, including thermodynamic entropy, Shannon entropy in information theory, and the Boltzmann H-theorem. The inclusion of the Boltzmann constant (k) ensures that entropy has the correct thermodynamic dimensions of energy per degree Kelvin.

PREREQUISITES
  • Understanding of thermodynamic principles
  • Familiarity with statistical mechanics concepts
  • Knowledge of logarithmic functions and their properties
  • Basic grasp of information theory and its relation to entropy
NEXT STEPS
  • Study the microcanonical ensemble in statistical mechanics
  • Explore the relationship between entropy and probability distribution functions
  • Investigate the implications of Shannon entropy in information theory
  • Learn about the Boltzmann H-theorem and its significance in thermodynamics
USEFUL FOR

Students and professionals in physics, particularly those focused on thermodynamics, statistical mechanics, and information theory, will benefit from this discussion.

aaaa202
Messages
1,144
Reaction score
2
Entropy is in my book defined as:

S = k ln[itex]\Omega[/itex] , where [itex]\Omega[/itex] is the multiplicity of the microstates.

Now I have several questions regarding this definition (please try to answer them all! :) )

1) Why do you take the log of the multiplicity? Is it just because additivity as well as the fact that even for a lot of particles S is still a small number, just makes it a lot more convenient to work with this definition?
At first I thought so, but then ln increases less per step the farther you are on the x axis. So wouldn't that make problems?

2) I can understand that generally thermodynamics is more deeply described in statistical mechanics. Is entropy then on a deeper level still defined as the the above, or is that just something that also appears to be true? I'm asking this because, the k factor seems to indicate, that there's more to it than at first glance.
Also I have seen a few videos, which discuss entropy in information theory, and here it seems that entropy is something more deep than just an expression for the multiplicity of a system.

That covers all. Thanks :)
 
Physics news on Phys.org
(1) As you already said , the natural log grantees the additive property which is anticipated for an extensive quantity such as entropy. However, more generally you can define the entropy for any probability distribution function. In the microcanonical ensemble (Fixed, N,V,E) , the probability of any state of energy E is just 1/Ω (E). For this PDF , S has to be lnΩ. The extra factor of kB was added to match the thermodynamic dimensions of entropy (energy unit/degree kelvin).

(2) Up to a constant , the thermodynamic entropy, Shanon entropy (information theory), statistical mechanics entropy, and H in Boltzmann H-theorem are equivalent.
In statistical mechanics, the entropy in the microcanonical ensemble is given by the expression you wrote.
 

Similar threads

  • · Replies 6 ·
Replies
6
Views
5K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 12 ·
Replies
12
Views
3K
Replies
4
Views
3K
  • · Replies 22 ·
Replies
22
Views
3K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
Replies
10
Views
4K
  • · Replies 9 ·
Replies
9
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K