Shannons :calculating simple uncertainty

  • Thread starter Thread starter Calmstorm
  • Start date Start date
  • Tags Tags
    Uncertainty
Click For Summary
To measure the uncertainty at the transmitter for a two-tone image transmitted line-by-line, the formula H(X) = - W{ Pilog(Pi) } - B{Qj log (Qj)} can be used, where W represents the number of white pixels and B the number of black pixels. The probabilities Pi and Qj correspond to the likelihood of encountering a white or black pixel, respectively. For a square NxN image, the total number of pixels is N^2, which informs the length of the transmitted sequence. Understanding these calculations helps in assessing the information content and efficiency of the transmission. Accurate measurement of uncertainty is crucial for optimizing data transmission in digital communications.
Calmstorm
Messages
4
Reaction score
0
If I were to use a two-tone image e.g. fax, and were to transmit it line-by-line, where the the individual pixels which make up the line were independent of each other, how would I measure the uncertainty at the transmitter? Also what would the length of the the transmited sequence be if the image was a square NxN image?

I think the uncertainty is H(X)= - W{ Pilog(Pi) } -B{Qj log (Qj)}
where:
W=number of white pixels in the sequence
Pi=probability of a white pixel.
B=number of black pixels in seqence
Qj=probability of a black pixel.

Any ideas would be very helpful...thank you in advance!
 
Physics news on Phys.org
Do not cross-post.
 
There is a nice little variation of the problem. The host says, after you have chosen the door, that you can change your guess, but to sweeten the deal, he says you can choose the two other doors, if you wish. This proposition is a no brainer, however before you are quick enough to accept it, the host opens one of the two doors and it is empty. In this version you really want to change your pick, but at the same time ask yourself is the host impartial and does that change anything. The host...

Similar threads

  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 4 ·
Replies
4
Views
1K
  • · Replies 7 ·
Replies
7
Views
1K
  • · Replies 18 ·
Replies
18
Views
3K
  • · Replies 6 ·
Replies
6
Views
30K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 14 ·
Replies
14
Views
6K