From shannon's entropy to thermodynamics

  • Context: Graduate 
  • Thread starter Thread starter enricfemi
  • Start date Start date
  • Tags Tags
    Entropy Thermodynamics
Click For Summary
SUMMARY

The discussion focuses on the relationship between Shannon's entropy and Boltzmann's entropy, specifically the equation S = k ln W. The user explores the implications of setting the probability p as constant, leading to the microcanonical ensemble where all microstates consistent with total energy are equally probable. This connection highlights the foundational principles linking information theory and thermodynamics.

PREREQUISITES
  • Understanding of Shannon's entropy and its formula, S = -Σ(p log p)
  • Familiarity with Boltzmann's entropy equation, S = k ln W
  • Knowledge of statistical mechanics, particularly the microcanonical ensemble
  • Basic concepts of probability theory
NEXT STEPS
  • Research the derivation of Shannon's entropy in the context of statistical mechanics
  • Study the implications of the microcanonical ensemble in thermodynamics
  • Explore the relationship between information theory and physical systems
  • Investigate applications of entropy in various scientific fields, including physics and information science
USEFUL FOR

Students and professionals in physics, information theory researchers, and anyone interested in the intersection of thermodynamics and information science.

enricfemi
Messages
195
Reaction score
0
i am trying to figure out the relationship between shannon's entropy and boltzmann's s=kInw.

can anyone help me?
 
Science news on Phys.org
Shannon=sum(-plnp)

Set p=constant (all possibilities are equal) and you get the microcanonical ensemble where all microstates consistent with the total energy are equally possible.
 
Thank you!
 

Similar threads

Undergrad Boltzmann Entropy Formula – Derivation
  • · Replies 18 ·
Replies
18
Views
6K
Graduate History - Evolution of ideas in the field of thermodynamics (statistics in mechanical and gas dynamics)
  • · Replies 4 ·
Replies
4
Views
1K
Undergrad Confusion about the entropy of mixing
  • · Replies 3 ·
Replies
3
Views
3K
High School Entropy change for reversible and irreversible processes
  • · Replies 12 ·
Replies
12
Views
3K
High School Does gravity defy the 2nd Law?
  • · Replies 33 ·
2
Replies
33
Views
4K
Graduate Meaning of thermodynamic probability
  • · Replies 4 ·
Replies
4
Views
3K
Graduate Definition of a system in Boltzmann entropy
  • · Replies 1 ·
Replies
1
Views
2K
Undergrad Understand the Thermodynamic Identity: Is This Correct?
  • · Replies 3 ·
Replies
3
Views
2K
Undergrad Why does the entropy of a closed system remain constant in a reversible process?
  • · Replies 10 ·
Replies
10
Views
4K
Undergrad How can the maximum entropy and minimum energy principles be physical?
  • · Replies 13 ·
Replies
13
Views
4K