Shannons :calculating simple uncertainty

  • Context: Undergrad 
  • Thread starter Thread starter Calmstorm
  • Start date Start date
  • Tags Tags
    Uncertainty
Join the discussion
Registration is free. Ask a follow-up in this thread, or start your own.
1 reply · 3K views
Calmstorm
Messages
4
Reaction score
0
If I were to use a two-tone image e.g. fax, and were to transmit it line-by-line, where the the individual pixels which make up the line were independent of each other, how would I measure the uncertainty at the transmitter? Also what would the length of the the transmited sequence be if the image was a square NxN image?

I think the uncertainty is H(X)= - W{ Pilog(Pi) } -B{Qj log (Qj)}
where:
W=number of white pixels in the sequence
Pi=probability of a white pixel.
B=number of black pixels in seqence
Qj=probability of a black pixel.

Any ideas would be very helpful...thank you in advance!
 
Physics news on Phys.org