B Entropy & Information Content: Examining the Difference

AI Thread Summary
Entropy in information theory refers to the measure of uncertainty or unpredictability in a set of data, while information content quantifies the amount of information conveyed. In the example discussed, the photograph of the sky has higher entropy and information content compared to the detailed painting, illustrating that less complex images can carry more information in certain contexts. The term "entropy" is indeed more technical and specific than "information content," as it relates to the statistical properties of data. Understanding these distinctions is crucial for grasping concepts in information theory. The discussion emphasizes the importance of context when interpreting these terms.
louislaolu
Messages
15
Reaction score
0
What does entropy in the following sentence means? Does it mean the same as the term "information content" before it? Is entropy more technical a term than information content?

He remembered taking a class in information theory as a third-year student in college. The professor had put up two pictures: One was the famous Song Dynasty painting, full of fine, rich details; the other was a photograph of the sky on a sunny day, the deep blue expanse broken only by a wisp of cloud that one couldn't even be sure was there. The professor asked the class which picture contained more information. The answer was that the photograph's information content--its entropy exceeded the painting's by one or two orders of magnitude.
 
Last edited:
Physics news on Phys.org
Google for a formal definition of entropy in the context of information theory.
 
  • Like
Likes sophiecentaur
Borek said:
Google for a formal definition of entropy in the context of information theory.
... or Shannon entropy.
 
  • Like
Likes sophiecentaur and Borek
So I know that electrons are fundamental, there's no 'material' that makes them up, it's like talking about a colour itself rather than a car or a flower. Now protons and neutrons and quarks and whatever other stuff is there fundamentally, I want someone to kind of teach me these, I have a lot of questions that books might not give the answer in the way I understand. Thanks
I think it's easist first to watch a short vidio clip I find these videos very relaxing to watch .. I got to thinking is this being done in the most efficient way? The sand has to be suspended in the water to move it to the outlet ... The faster the water , the more turbulance and the sand stays suspended, so it seems to me the rule of thumb is the hose be aimed towards the outlet at all times .. Many times the workers hit the sand directly which will greatly reduce the water...
Back
Top