B Entropy & Information Content: Examining the Difference

AI Thread Summary
Entropy in information theory refers to the measure of uncertainty or unpredictability in a set of data, while information content quantifies the amount of information conveyed. In the example discussed, the photograph of the sky has higher entropy and information content compared to the detailed painting, illustrating that less complex images can carry more information in certain contexts. The term "entropy" is indeed more technical and specific than "information content," as it relates to the statistical properties of data. Understanding these distinctions is crucial for grasping concepts in information theory. The discussion emphasizes the importance of context when interpreting these terms.
louislaolu
Messages
15
Reaction score
0
What does entropy in the following sentence means? Does it mean the same as the term "information content" before it? Is entropy more technical a term than information content?

He remembered taking a class in information theory as a third-year student in college. The professor had put up two pictures: One was the famous Song Dynasty painting, full of fine, rich details; the other was a photograph of the sky on a sunny day, the deep blue expanse broken only by a wisp of cloud that one couldn't even be sure was there. The professor asked the class which picture contained more information. The answer was that the photograph's information content--its entropy exceeded the painting's by one or two orders of magnitude.
 
Last edited:
Physics news on Phys.org
Google for a formal definition of entropy in the context of information theory.
 
  • Like
Likes sophiecentaur
Borek said:
Google for a formal definition of entropy in the context of information theory.
... or Shannon entropy.
 
  • Like
Likes sophiecentaur and Borek
Thread 'Is there a white hole inside every black hole?'
This is what I am thinking. How much feasible is it? There is a white hole inside every black hole The white hole spits mass/energy out continuously The mass/energy that is spit out of a white hole drops back into it eventually. This is because of extreme space time curvature around the white hole Ironically this extreme space time curvature of the space around a white hole is caused by the huge mass/energy packed in the white hole Because of continuously spitting mass/energy which keeps...
Back
Top