Register to reply 
Information Theory  Shannon's SelfInformation units 
Share this thread: 
#1
Mar2712, 07:45 AM

P: 1

Hi,
I'm familiar with information and coding theory, and do know that the units of Shannon information content (log_2(P(A))) are "bits". Where "bit" is a "binary digit", or a "storage device that has two stable states". But, can someone rigorously prove that the units are actually "bits"? Or we should only accept it as a definition and then justify it with coding examples. Thanks! 


#2
Apr812, 06:44 AM

P: 3

No, you can use what ever logarithmic base. For natural information you could use unit "nat" with base e and for binary information unit "bit" with base 2.



Register to reply 
Related Discussions  
Is it Information or Interaction that Observes ?  Quantum Physics  9  
Review of Lenny Susskind's Black Holes, Information, String Theory  General Physics  0 