Shannons :calculating simple uncertainty

  • Context: Undergrad 
  • Thread starter Thread starter Calmstorm
  • Start date Start date
  • Tags Tags
    Uncertainty
Click For Summary
SUMMARY

The discussion focuses on calculating uncertainty in a two-tone image transmission using Shannon's entropy formula. The uncertainty is defined as H(X) = - W{ Pilog(Pi) } - B{Qj log (Qj)}, where W represents the number of white pixels, Pi is the probability of a white pixel, B is the number of black pixels, and Qj is the probability of a black pixel. The length of the transmitted sequence for an NxN image is also a key consideration. This formula provides a definitive method for quantifying uncertainty in image data transmission.

PREREQUISITES
  • Understanding of Shannon's entropy and information theory
  • Familiarity with pixel representation in digital images
  • Knowledge of probability concepts related to discrete random variables
  • Basic mathematical skills for logarithmic calculations
NEXT STEPS
  • Research Shannon's entropy in detail to understand its applications in data transmission
  • Explore pixel probability calculations for different image types
  • Learn about data compression techniques for two-tone images
  • Investigate the impact of pixel independence on uncertainty measurements
USEFUL FOR

Students and professionals in information theory, digital image processing, and telecommunications who are interested in understanding uncertainty in data transmission and its mathematical foundations.

Calmstorm
Messages
4
Reaction score
0
If I were to use a two-tone image e.g. fax, and were to transmit it line-by-line, where the the individual pixels which make up the line were independent of each other, how would I measure the uncertainty at the transmitter? Also what would the length of the the transmited sequence be if the image was a square NxN image?

I think the uncertainty is H(X)= - W{ Pilog(Pi) } -B{Qj log (Qj)}
where:
W=number of white pixels in the sequence
Pi=probability of a white pixel.
B=number of black pixels in seqence
Qj=probability of a black pixel.

Any ideas would be very helpful...thank you in advance!
 
Physics news on Phys.org
Do not cross-post.
 

Similar threads

  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 7 ·
Replies
7
Views
1K
  • · Replies 18 ·
Replies
18
Views
3K
  • · Replies 6 ·
Replies
6
Views
30K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 7 ·
Replies
7
Views
2K