Thermodynamics and information theory

Click For Summary
SUMMARY

The discussion focuses on the relationship between thermodynamics and information theory, specifically the works of Clausius and Shannon, as well as the concept of Maxwell's demon. The participant seeks concise and accessible resources to understand these topics without extensive mathematical background. Recommendations include Pierce's book as an introductory text on information theory, while cautioning that Shannon's original paper may be complex. The goal is to efficiently gather information for academic work while managing time constraints.

PREREQUISITES
  • Understanding of thermodynamics principles, particularly those related to Clausius' work.
  • Familiarity with information theory concepts, especially Shannon's contributions.
  • Basic knowledge of Maxwell's demon and its implications in thermodynamics.
  • Ability to analyze academic texts for relevant information without extensive mathematical derivation.
NEXT STEPS
  • Read Pierce's book on information theory for a foundational understanding.
  • Review Clausius' and Shannon's original papers for direct insights into their theories.
  • Research Maxwell's demon and its relevance in the context of information theory.
  • Explore modern interpretations and applications of thermodynamics in information theory.
USEFUL FOR

Students and researchers in physics, information theory, and thermodynamics, particularly those looking to understand the intersection of these fields without delving into complex mathematics.

Geranimo
Messages
19
Reaction score
2
Hello, I have to work on the relation between the thermodynamics and the information theory on both historical and theoretical aspects. My work will not contain proof. It will contain the most important equations and descriptive paragraphs. I need to talk about the relation between Clausius and Shannon's work. I also need to talk about Maxwell's demon.

My problem is I do not know a good book where I can find the information I need. A book I could read fast and write my work at the same time I understand from the book without having to do too much things to understand what is presented in the book. I would need max 3 books just to put in the references because with all my other courses my time to work on this is very limited and the faster I can produce it the better grades I will get in my other courses.

Anyone got recommendations on the most complete book on the thermodynamics of information theory and vis-versa? Should I just grab Clausius and Shannon papers and compare them or it will be too long? I already found some texts but they are often too old to contain Maxwell's demon, or they are too mathematical.

Thanks
 
Last edited:
Physics news on Phys.org
Pierce's book is generally recommended as the easiest introduction to information theory (disclosure: I have not read it). Shannon's paper is quite complicated so beware.
 

Similar threads

  • · Replies 10 ·
Replies
10
Views
5K
Replies
1
Views
1K
  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 5 ·
Replies
5
Views
3K
  • · Replies 3 ·
Replies
3
Views
4K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 9 ·
Replies
9
Views
5K
  • · Replies 2 ·
Replies
2
Views
2K
Replies
34
Views
5K
  • · Replies 3 ·
Replies
3
Views
3K