Undergrad Information Theory and Entropy

Click For Summary
Entropy and information are inversely related; increased information about a system results in lower entropy. The concept that entropy always increases suggests that some information may be lost during interactions, particularly when particles exchange energy and momentum, leading to wavefunction collapse. While there is debate about whether information is conserved, some argue that unitarity and CPT symmetry imply that information about the past is contained in the current state of a system. However, wavefunction collapse is not a unitary process, indicating that information may not be conserved in all scenarios. The discussion touches on complex topics like the black hole information paradox, suggesting that while information may not disappear, it can become difficult to describe after certain interactions.
Arman777
Insights Author
Gold Member
Messages
2,163
Reaction score
191
1-Whats the relationship between entropy and İnformation ?
2-Can Entrophy always increases statement imply information lost ?
3-If it implies how its lost ?
 
Physics news on Phys.org
1. Entropy and information are basically opposites. Entropy tells you how many quantum states are consistent with the information you have. If you have more information about the state, then there are fewer states that match the description, so the entropy is less.
2. Yes.
3. When two particles interact, they trade some energy and momentum. The amount of energy/momentum transfer is in superposition. Somehow, the wavefunction collapses, and the amount of transfer takes on some random value. So, if we initially knew the energy/momentum of each particle before the interaction, afterwards we only know the total. So some information was lost. It's not clear how this wavefunction collapse occurs.
 
Last edited by a moderator:
  • Like
Likes Arman777
Khashishi said:
1. Entropy and information are basically opposites. Entropy tells you how many quantum states are consistent with the information you have. If you have more information about the state, then there are fewer states that match the description, so the entropy is less.
2. Yes.
3. When two particles interact, they trade some energy and momentum. The amount of energy/momentum transfer is in superposition. Somehow, the wavefunction collapses, and the amount of transfer takes on some random value. So, if we initially knew the energy/momentum of each particle before the interaction, afterwards we only know the total. So some information was lost. It's not clear how this wavefunction collapse occurs.

I understand thanks, "So some information was lost" , I remembered now that I heard İnformation never lost, never vanishes. Is this true ?
Like Conservation of Information ?
 
Last edited by a moderator:
I searched a bit and says there's no such conservation but From unitarity or cpt there could be
"CPT seems to imply it. You can reverse the system evolution by applying charge, parity and time conjugation, so the information about the past must be contained in the present state. That implies conservation of information by the evolution.

This may not be the answer you wanted, because it does not imply unitarity, but it is the only relationship between symmetry and information conservation that I can think of. Unitarity seems to be a very fundamental assumption though, and there is not much more fundamental mathematical structure you could use to argue about its necessity." (A.O.Tell,Physics Stack Exchange,https://physics.stackexchange.com/q...associated-to-the-conservation-of-information)
 
But, wavefunction collapse is not a unitary transformation.
 
Khashishi said:
But, wavefunction collapse is not a unitary transformation.
I don't know much things about wavefunction actually I am freshman at physics :)
So it doesn't conserved.
Like energy,momentum etc is even not conserved in macroscopic states,like galaxy clusters scale etc.So It make sense to me that its not conserved.Maybe we can say the information about the system is lost during the time.It never disappeares but it just turns something that we can't describe the full system after a period of time using previous information
 
Arman777 said:
I searched a bit and says there's no such conservation but From unitarity or cpt there could be
"CPT seems to imply it. You can reverse the system evolution by applying charge, parity and time conjugation, so the information about the past must be contained in the present state. That implies conservation of information by the evolution.
/QUOTE]

Sure, that's fine if it doesn't interact with anything.
 
  • #10
Makes sense...
 
  • #11
Well I read the article and says information is conserved.It can not be copied or lost.Which Complementarity came from that.
 

Similar threads

  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 15 ·
Replies
15
Views
2K
  • · Replies 5 ·
Replies
5
Views
1K
  • · Replies 7 ·
Replies
7
Views
1K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 10 ·
Replies
10
Views
2K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 18 ·
Replies
18
Views
4K
  • · Replies 19 ·
Replies
19
Views
3K