Shannon's :calculating simple uncertainty

  • Thread starter Thread starter Calmstorm
  • Start date Start date
  • Tags Tags
    Uncertainty
Calmstorm
Messages
4
Reaction score
0

Homework Statement



If I were to use a two-tone image e.g. fax, and were to transmit it line-by-line, where the the individual pixels which make up the line were independent of each other, how would I measure the uncertainty at the transmitter? Also what would the length of the the transmited sequence be if the image was a square NxN image?



The Attempt at a Solution



I think the uncertainty is H(X)= - W{ Pilog(Pi) } -B{Qj log (Qj)}
where:
W=number of white pixels in the sequence
Pi=probability of a white pixel.
B=number of black pixels in seqence
Qj=probability of a black pixel.

Any ideas would be very helpful...thank you in advance!
 
Physics news on Phys.org
How did you come up with the formula "H(X)= - W{ Pilog(Pi) } -B{Qj log (Qj)}"?
 


well the general formula of shannon's uncertainty is:

H(x)= -pi log(base 2) pi summed over all i, since I have 2 outcomes i.e a black or white pixel i have used Pi=probab. of white and Qj=probab. of black

also sorry about the cross-posting, it won't happen again.
 
There are two things I don't understand about this problem. First, when finding the nth root of a number, there should in theory be n solutions. However, the formula produces n+1 roots. Here is how. The first root is simply ##\left(r\right)^{\left(\frac{1}{n}\right)}##. Then you multiply this first root by n additional expressions given by the formula, as you go through k=0,1,...n-1. So you end up with n+1 roots, which cannot be correct. Let me illustrate what I mean. For this...

Similar threads

Back
Top