Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Capacity of a discrete channel

  1. Mar 26, 2013 #1
    Well I was reading this " A Mathematical Theory of Communication" paper by Claude Shannon. He says that the capacity of a discrete channel is given by

    [ tex ] C= \ \lim_{T \to +\infty} \ \frac{\log ( N(T) )} {T} [ \tex ]

    Here N(T) is the number of possible sequences in a duration of T seconds.

    He gives one example before talking about this capacity formula. Here's the example- Consider 32 symbols. You have a system where you can transmit 2 symbols per second. Now he says it is clear that if each symbol has 5 bits then we can send 2 x 5 =10 bits per second (or 2 symbols per second). This is the capacity of the channel. But when I tried it out using the above expression I couldn't get the answer as 2 symbols/ second. I got it as 3 symbols per second. Can you help me with this?

    Thanks in advance.


    (As latex doesn't seem to work now I have even attached the image of the formula for Capacity)
     

    Attached Files:

    Last edited: Mar 26, 2013
  2. jcsd
  3. Mar 26, 2013 #2

    eq1

    User Avatar

  4. Mar 26, 2013 #3

    marcusl

    User Avatar
    Science Advisor
    Gold Member

    You must have made an error somewhere. In 2 seconds you transmit 2 symbols, so there are 32^2=1024 possible message combinations. log_2(1024)/2 = 10/2 = 5 bits/second which is one symbol per second, which is correct.
     
  5. Mar 26, 2013 #4
    Ya ya I found it later. Thanks marcusl btw
     
Know someone interested in this topic? Share this thread via Reddit, Google+, Twitter, or Facebook




Similar Discussions: Capacity of a discrete channel
  1. Microphone Channel (Replies: 4)

Loading...