Entropy increase,coarse-grained vs. Landauer's principle justification

  • Context: Graduate 
  • Thread starter Thread starter Evaristo
  • Start date Start date
  • Tags Tags
    Entropy Principle
Click For Summary

Discussion Overview

The discussion centers on the justification for entropy increase in the context of the second law of thermodynamics, specifically comparing two different approaches: one involving Landauer's principle and Maxwell's demon, and the other focusing on the implications of Liouville's Theorem and coarse-grained versus fine-grained entropy. The scope includes theoretical interpretations and conceptual clarifications.

Discussion Character

  • Conceptual clarification
  • Debate/contested

Main Points Raised

  • One participant questions the justification for entropy increase, presenting two differing approaches: one involving the complexity of controlling particle dynamics and the implications of Landauer's principle, and the other focusing on the reversibility of physical laws and the effects of coarse-graining.
  • Another participant suggests that in both scenarios, entropy increases when information is erased or lost, noting that Landauer's principle implies that without erasure, entropy would not increase.
  • A participant expresses understanding that while theoretically, entropy could remain unchanged, real-life limitations prevent this from occurring, highlighting a connection between information loss and entropy increase.

Areas of Agreement / Disagreement

Participants acknowledge that both approaches theoretically allow for scenarios where entropy does not increase, but they also recognize that practical limitations lead to an increase in entropy. There is no consensus on how to reconcile the two justifications, indicating ongoing debate.

Contextual Notes

The discussion reflects uncertainty regarding the relationship between information theory and thermodynamics, particularly in the context of different entropy definitions and the implications of theoretical principles versus practical realities.

Evaristo
Messages
2
Reaction score
0
First off, just clarify that I have a very, very superficial knowledge of Physics, so my apologies if my question is based on an obvious misunderstanding of the basic principles underlying the second law of thermodynamics or if it has a rather simple answer.

The doubt that I have is related to the justification behind the entropy increase, in particular, the fact that I have read two different approaches that in my view appear to arrive at completely different conclusions.

One of them is related to the idea of the complexity required to selectively control the dynamics of the different particles of the system in order to decrease the entropy, i.e. the Maxwell's demon thought experiment, and the fact that this would require to keep record of an increasingly long set of parameters regarding the location of each particle in the phase space and that in the long run bit of information of this long list would have to be deleted in order to make room for new data and that according to the Landauer's principle the bit erasure produces an entropy increase of the total system including the storage space for keeping these parameters. According to this justification, the apparent decrease of the entropy would be only an illusion, because actually there is an overall increase of entropy of the whole system, which must necessarily include the demon interacting and modifying the dynamics of the particles and the storage space used for keeping track of the dynamics of the system.

The second justification is completely different. It is argued that the reversibility of the Laws of Physics and in particular the Liouville's Theorem prevents that the entropy increases at all, but due to the complexity character of the dynamics of most physical systems, each point gets separated according to the Lyapunov exponent in a fractal like manner and it gets progressively more difficult to track the exact position of the different particles in the phase space, and therefore in a real situation it becomes impossible, after a certain time has elapsed, to have accurate enough information of the system as to reverse the process and decrease the entropy. A coarse grained entropy is for this reason defined with a summation over the phase-space of all possible states with a unit size corresponding to the maximum resolution of the measurements and this is the entropy that is increased in all cases, whereas the fine grained entropy is left unvaried due to Liouville's Theorem.

Therefore, according to the first justification the entropy is increased whereas according to the second, at least the fine grained entropy is kept unchanged. Any idea regarding how to make this two justification with this apparent contradiction consistent with each other?

Thank you very much in advance for your help!
 
Science news on Phys.org
I can't provide a rigourous argument, but heuristically, entropy increases in both cases when information is erased or lost. In the first case, Landauer argued that if the demon did not erase information, entropy would not increase. In the second case, if one never loses information at the fine grained level, entropy does not decrease. However, the coarse grained description inherently loses information compared to the fine grained case.
 
Thanks, Atvy! Your answered has helped me. I understand now that in both cases there is a theoretical manner to achieve a "no increase" in entropy, but that real-life limitations make it impossible to be realized. I did not want anyway a rigorous argument. It is actually my getting lost in the details of the argumentation of the Landauer's principle that made me see this principle in a different light that the coarse grained argumentation, when actually there is a clear analogy between loss of information and erasure. Now I have a better image of the bigger picture, which is what really mattered to me!
 
You're welcome. I'm glad you got the idea, even though there's a terrible typo in my post!
 

Similar threads

  • · Replies 19 ·
Replies
19
Views
4K
  • · Replies 5 ·
Replies
5
Views
1K
  • · Replies 10 ·
Replies
10
Views
3K
  • · Replies 7 ·
Replies
7
Views
4K
  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 3 ·
Replies
3
Views
3K