Does Entropy Mean Less Information or More Complexity?

AI Thread Summary
Entropy is often associated with the tendency of systems to move from ordered to disordered states, which relates to the concept of probability. The discussion highlights a debate on whether entropy signifies a loss of information or an increase in complexity, using the example of a glass and its broken shards. While a whole glass has specific, structured information, broken glass may appear to possess more complexity due to its randomness. This raises questions about the distinction between the information required to describe an object and the information inherent within the object itself. Ultimately, the relationship between entropy, information, and complexity remains a nuanced topic requiring deeper exploration.
dhruv.tara
Messages
45
Reaction score
0

Homework Statement


I haven't studied thermodynamics and we have just a very brief use of thermo in my power plants course.

I have read that entropy always increases, universe tends to disorderly state from an orderly state. The teacher related this to probability that nature tends to go from less probable state to more probable state.

All these statements were fine.

Then they related this to the information contained within the system. I was told that nature tends to go from more information states to less information states. Things tend to lose information.

E.g. A glass -> Has information associated with it, its structure and other properties.
A broken glass -> Completely random. Not much information associated with it.

I cannot convince myself of the above. Can't we say the opposite?
A glass had much lesser information associated with it or most of the properties were redundant that given a few parameters it was possible to give a complete description of the object.
Broken glass-> Has too much information. We just can't classify or find parameters (or need way too many parameters) to describe a broken glass. (Rather than saying that its just random)

My guess is that it can have something to do with the difference between data and information, but that's only a guess...

Thanks... Any help is appreciated.
 
Physics news on Phys.org
I think you might be mixing up the "information" needed to describe an object with the information the object itself does possess. Take some more time to think about the glass and the broken chards of glass and which has more structured information.
 

Similar threads

Replies
2
Views
1K
Replies
1
Views
2K
Replies
4
Views
2K
Replies
1
Views
1K
Replies
7
Views
2K
Back
Top