1. Limited time only! Sign up for a free 30min personal tutor trial with Chegg Tutors
    Dismiss Notice
Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Information Theory - Shannon's Self-Information units

  1. Mar 27, 2012 #1
    Information Theory - Shannon's "Self-Information" units


    I'm familiar with information and coding theory, and do know that the units of Shannon information content (-log_2(P(A))) are "bits". Where "bit" is a "binary digit", or a "storage device that has two stable states".

    But, can someone rigorously prove that the units are actually "bits"? Or we should only accept it as a definition and then justify it with coding examples.

  2. jcsd
  3. Apr 8, 2012 #2
    Re: Information Theory - Shannon's "Self-Information" units

    No, you can use what ever logarithmic base. For natural information you could use unit "nat" with base e and for binary information unit "bit" with base 2.
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook