B Entropy & Information Content: Examining the Difference

Click For Summary
Entropy in information theory refers to the measure of uncertainty or unpredictability in a set of data, while information content quantifies the amount of information conveyed. In the example discussed, the photograph of the sky has higher entropy and information content compared to the detailed painting, illustrating that less complex images can carry more information in certain contexts. The term "entropy" is indeed more technical and specific than "information content," as it relates to the statistical properties of data. Understanding these distinctions is crucial for grasping concepts in information theory. The discussion emphasizes the importance of context when interpreting these terms.
louislaolu
Messages
15
Reaction score
0
What does entropy in the following sentence means? Does it mean the same as the term "information content" before it? Is entropy more technical a term than information content?

He remembered taking a class in information theory as a third-year student in college. The professor had put up two pictures: One was the famous Song Dynasty painting, full of fine, rich details; the other was a photograph of the sky on a sunny day, the deep blue expanse broken only by a wisp of cloud that one couldn't even be sure was there. The professor asked the class which picture contained more information. The answer was that the photograph's information content--its entropy exceeded the painting's by one or two orders of magnitude.
 
Last edited:
Physics news on Phys.org
Google for a formal definition of entropy in the context of information theory.
 
  • Like
Likes sophiecentaur
Borek said:
Google for a formal definition of entropy in the context of information theory.
... or Shannon entropy.
 
  • Like
Likes sophiecentaur and Borek
Abstract The gravitational effects of a Primordial Black Hole (PBH) passing through the human body are examined, with the goal of determining the minimum mass necessary to produce significant injury or death. Two effects are examined: The damage caused by a shock wave propagating outward from the black hole trajectory, and the dissociation of brain cells from tidal forces produced by the black hole on its passage through the human body. It is found that the former is the dominant effect...

Similar threads

  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 9 ·
Replies
9
Views
4K
  • · Replies 18 ·
Replies
18
Views
3K
Replies
62
Views
14K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 4 ·
Replies
4
Views
3K
  • · Replies 13 ·
Replies
13
Views
10K
Replies
7
Views
2K
Replies
2
Views
14K