Shannon's :calculating simple uncertainty

  • Thread starter Thread starter Calmstorm
  • Start date Start date
  • Tags Tags
    Uncertainty
Click For Summary
SUMMARY

The discussion centers on calculating uncertainty in a two-tone image transmission using Shannon's entropy formula. The uncertainty is expressed as H(X) = -W{Pi log(Pi)} - B{Qj log(Qj)}, where W represents the number of white pixels and B represents the number of black pixels. The probabilities Pi and Qj correspond to the likelihood of encountering a white or black pixel, respectively. The length of the transmitted sequence for an NxN image is determined by the total number of pixels, which is N^2.

PREREQUISITES
  • Understanding of Shannon's entropy and uncertainty principles
  • Familiarity with probability theory, specifically discrete outcomes
  • Basic knowledge of image representation in binary format
  • Mathematical skills for logarithmic calculations
NEXT STEPS
  • Study Shannon's entropy in detail, focusing on its applications in information theory
  • Explore the concept of pixel independence in image processing
  • Learn about binary image encoding techniques and their impact on data transmission
  • Investigate the implications of pixel probability distributions on image compression
USEFUL FOR

Students in information theory, computer science majors focusing on image processing, and professionals working in data transmission and compression technologies.

Calmstorm
Messages
4
Reaction score
0

Homework Statement



If I were to use a two-tone image e.g. fax, and were to transmit it line-by-line, where the the individual pixels which make up the line were independent of each other, how would I measure the uncertainty at the transmitter? Also what would the length of the the transmited sequence be if the image was a square NxN image?



The Attempt at a Solution



I think the uncertainty is H(X)= - W{ Pilog(Pi) } -B{Qj log (Qj)}
where:
W=number of white pixels in the sequence
Pi=probability of a white pixel.
B=number of black pixels in seqence
Qj=probability of a black pixel.

Any ideas would be very helpful...thank you in advance!
 
Physics news on Phys.org
How did you come up with the formula "H(X)= - W{ Pilog(Pi) } -B{Qj log (Qj)}"?
 


well the general formula of shannon's uncertainty is:

H(x)= -pi log(base 2) pi summed over all i, since I have 2 outcomes i.e a black or white pixel i have used Pi=probab. of white and Qj=probab. of black

also sorry about the cross-posting, it won't happen again.
 

Similar threads

  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 18 ·
Replies
18
Views
4K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 6 ·
Replies
6
Views
3K
  • · Replies 3 ·
Replies
3
Views
6K
  • · Replies 20 ·
Replies
20
Views
4K