Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Information Theory - Shannon's Self-Information units

  1. Mar 27, 2012 #1
    Information Theory - Shannon's "Self-Information" units

    Hi,

    I'm familiar with information and coding theory, and do know that the units of Shannon information content (-log_2(P(A))) are "bits". Where "bit" is a "binary digit", or a "storage device that has two stable states".

    But, can someone rigorously prove that the units are actually "bits"? Or we should only accept it as a definition and then justify it with coding examples.

    Thanks!
     
  2. jcsd
  3. Apr 8, 2012 #2
    Re: Information Theory - Shannon's "Self-Information" units

    No, you can use what ever logarithmic base. For natural information you could use unit "nat" with base e and for binary information unit "bit" with base 2.
     
Know someone interested in this topic? Share this thread via Reddit, Google+, Twitter, or Facebook




Similar Discussions: Information Theory - Shannon's Self-Information units
Loading...