B Entropy & Information Content: Examining the Difference

Click For Summary
Entropy in information theory refers to the measure of uncertainty or unpredictability in a set of data, while information content quantifies the amount of information conveyed. In the example discussed, the photograph of the sky has higher entropy and information content compared to the detailed painting, illustrating that less complex images can carry more information in certain contexts. The term "entropy" is indeed more technical and specific than "information content," as it relates to the statistical properties of data. Understanding these distinctions is crucial for grasping concepts in information theory. The discussion emphasizes the importance of context when interpreting these terms.
louislaolu
Messages
15
Reaction score
0
What does entropy in the following sentence means? Does it mean the same as the term "information content" before it? Is entropy more technical a term than information content?

He remembered taking a class in information theory as a third-year student in college. The professor had put up two pictures: One was the famous Song Dynasty painting, full of fine, rich details; the other was a photograph of the sky on a sunny day, the deep blue expanse broken only by a wisp of cloud that one couldn't even be sure was there. The professor asked the class which picture contained more information. The answer was that the photograph's information content--its entropy exceeded the painting's by one or two orders of magnitude.
 
Last edited:
Physics news on Phys.org
Google for a formal definition of entropy in the context of information theory.
 
  • Like
Likes sophiecentaur
Borek said:
Google for a formal definition of entropy in the context of information theory.
... or Shannon entropy.
 
  • Like
Likes sophiecentaur and Borek
Quick question that I haven't been able to find the answer to. Greenhouse gasses both warm and cool the atmosphere by slowing heat loss to space. But what would happen without GHGs? I read that the earth would be colder (though still relatively warm), but why? Without GHGs the atmosphere would still be a similar mass and still warmed by conduction from the surface, yet without a means to radiate that heat to space. Why wouldn't the atmosphere accumulate heat over time, becoming warmer? How...