Shannon's uncertainty question

  • Thread starter Calmstorm
  • Start date
  • Tags
    Uncertainty
This conversation is already being addressed in the other thread.In summary, the question is about measuring uncertainty at the transmitter while transmitting a two-tone image line-by-line, with independent pixels. The proposed solution involves calculating the uncertainty based on the number and probability of white and black pixels in the sequence. Any additional ideas are welcome.
  • #1
Calmstorm
4
0

Homework Statement

:

If I were to use a two-tone image e.g. fax, and were to transmit it line-by-line, where the the individual pixels which make up the line were independent of each other, how would I measure the uncertainty at the transmitter? Also what would the length of the the transmited sequence be if the image was a square NxN image?


2. The attempt at a solution

I think the uncertainty is H(X)= - W{ Pilog(Pi) } -B{Qj log (Qj)}
where:
W=number of white pixels in the sequence
Pi=probability of a white pixel.
B=number of black pixels in seqence
Qj=probability of a black pixel.

Any ideas would be very helpful...thank you in advance!
 
Physics news on Phys.org
  • #2
Please do not cross-post.
 
  • #3


I can confirm that your calculation for uncertainty is correct. The Shannon's uncertainty question deals with the concept of information theory, which is used to measure the amount of uncertainty or randomness in a system. In this case, the system is a two-tone image being transmitted line-by-line. Your equation takes into account the number of white and black pixels, as well as their respective probabilities, to calculate the overall uncertainty in the transmission.

To answer your second question, the length of the transmitted sequence for a square NxN image would be N^2, as there would be N lines with N pixels in each line. This is because each pixel is being transmitted independently, so the total length would be the product of the number of lines and the number of pixels in each line.

I hope this helps clarify the concept of Shannon's uncertainty and how it applies to your specific question. Keep up the good work in exploring and understanding information theory!
 

1. What is Shannon's uncertainty question?

Shannon's uncertainty question, also known as the "noiseless channel coding theorem", is a fundamental concept in information theory that addresses the question of how much information can be reliably transmitted through a communication channel with a finite capacity.

2. Who developed Shannon's uncertainty question?

Claude Shannon, an American mathematician and electrical engineer, developed Shannon's uncertainty question while working at Bell Labs in the late 1940s. His groundbreaking work in information theory laid the foundation for modern communication systems.

3. How does Shannon's uncertainty question relate to entropy?

Shannon's uncertainty question is closely related to the concept of entropy, which measures the amount of uncertainty or randomness in a system. In information theory, the uncertainty of a message is directly proportional to its entropy, and the goal is to minimize this uncertainty to maximize the efficiency of communication.

4. What is the practical application of Shannon's uncertainty question?

Shannon's uncertainty question has numerous practical applications, including the design of communication systems, data compression algorithms, and error-correcting codes. It also plays a crucial role in fields such as cryptography, artificial intelligence, and data science.

5. How does Shannon's uncertainty question impact the field of computer science?

Shannon's uncertainty question has had a significant impact on the field of computer science, particularly in the development of data compression techniques and communication protocols. It has also led to the development of new algorithms and methods for processing, storing, and transmitting information more efficiently.

Similar threads

  • Engineering and Comp Sci Homework Help
Replies
2
Views
4K
  • Computing and Technology
Replies
7
Views
834
  • Set Theory, Logic, Probability, Statistics
Replies
2
Views
3K
  • Calculus and Beyond Homework Help
Replies
2
Views
3K
  • Set Theory, Logic, Probability, Statistics
Replies
2
Views
1K
  • Engineering and Comp Sci Homework Help
Replies
3
Views
4K
  • Set Theory, Logic, Probability, Statistics
Replies
18
Views
2K
  • Engineering and Comp Sci Homework Help
Replies
2
Views
6K
Back
Top