Information Theory and Entropy

  • I
  • Thread starter Arman777
  • Start date
  • #1
2,133
179
1-Whats the relationship between entrophy and İnformation ?
2-Can Entrophy always increases statement imply information lost ?
3-If it implies how its lost ?
 

Answers and Replies

  • #2
Khashishi
Science Advisor
2,815
493
1. Entropy and information are basically opposites. Entropy tells you how many quantum states are consistent with the information you have. If you have more information about the state, then there are fewer states that match the description, so the entropy is less.
2. Yes.
3. When two particles interact, they trade some energy and momentum. The amount of energy/momentum transfer is in superposition. Somehow, the wavefunction collapses, and the amount of transfer takes on some random value. So, if we initially knew the energy/momentum of each particle before the interaction, afterwards we only know the total. So some information was lost. It's not clear how this wavefunction collapse occurs.
 
Last edited by a moderator:
  • #3
2,133
179
1. Entropy and information are basically opposites. Entropy tells you how many quantum states are consistent with the information you have. If you have more information about the state, then there are fewer states that match the description, so the entropy is less.
2. Yes.
3. When two particles interact, they trade some energy and momentum. The amount of energy/momentum transfer is in superposition. Somehow, the wavefunction collapses, and the amount of transfer takes on some random value. So, if we initially knew the energy/momentum of each particle before the interaction, afterwards we only know the total. So some information was lost. It's not clear how this wavefunction collapse occurs.

I understand thanks, "So some information was lost" , I remembered now that I heard İnformation never lost, never vanishes. Is this true ?
Like Conservation of Information ?
 
Last edited by a moderator:
  • #4
2,133
179
I searched a bit and says theres no such conservation but From unitarity or cpt there could be
"CPT seems to imply it. You can reverse the system evolution by applying charge, parity and time conjugation, so the information about the past must be contained in the present state. That implies conservation of information by the evolution.

This may not be the answer you wanted, because it does not imply unitarity, but it is the only relationship between symmetry and information conservation that I can think of. Unitarity seems to be a very fundamental assumption though, and there is not much more fundamental mathematical structure you could use to argue about its necessity." (A.O.Tell,Physics Stack Exchange,https://physics.stackexchange.com/q...associated-to-the-conservation-of-information)
 
  • #5
Khashishi
Science Advisor
2,815
493
But, wavefunction collapse is not a unitary transformation.
 
  • #6
2,133
179
But, wavefunction collapse is not a unitary transformation.
I dont know much things about wavefunction actually I am freshman at physics :)
So it doesnt conserved.
Like energy,momentum etc is even not conserved in macroscopic states,like galaxy clusters scale etc.So It make sense to me that its not conserved.Maybe we can say the information about the system is lost during the time.It never disappeares but it just turns something that we cant describe the full system after a period of time using previous information
 
  • #8
1,116
72
I searched a bit and says theres no such conservation but From unitarity or cpt there could be
"CPT seems to imply it. You can reverse the system evolution by applying charge, parity and time conjugation, so the information about the past must be contained in the present state. That implies conservation of information by the evolution.
/QUOTE]

Sure, that's fine if it doesn't interact with anything.
 
  • #11
2,133
179
Well I read the article and says information is conserved.It can not be copied or lost.Which Complementarity came from that.
 

Related Threads on Information Theory and Entropy

  • Last Post
Replies
9
Views
1K
  • Last Post
Replies
2
Views
2K
  • Last Post
Replies
3
Views
2K
Replies
5
Views
2K
Replies
26
Views
872
Replies
2
Views
1K
  • Last Post
Replies
3
Views
1K
Replies
18
Views
3K
Replies
3
Views
2K
Top