Converting between bits, nats and dits

  • Thread starter Rasalhague
  • Start date
  • Tags
    Bits
In summary, there is a difference between using bits and nats to measure information entropy and these two units are not compatible. However, there is a conversion factor between them, as shown by the relationship between natural logarithms and base 2 logarithms. This means that the result of expressing a given number in bits or nats may differ, but ultimately represent the same quality.
  • #1
Rasalhague
1,387
2
Given a number representing information entropy in some base, is there a well-defined way to convert this to the number which would represent the same entropy according to another base? Most of the definitions I've read so far use bits, but Mathematic uses nats, and Wolfram Alpha says "nats and bits are not compatible" in response to the input "convert nats to bits". But don't the two units measure the same quality? Perhaps, by not compatible, it means only there isn't an affine relationship between them, as between, say Celcius and Fahrenheit.

It seems like there would usually be more than one way to express given number as a sum or integral. Suppose I found one way of expressing an entropy in nats as a sum or integral, then replaced the natural logarithms with base 2 logarithms, would the result be the same whichever way I found of expressing the original number of bits as a sum or integral?
 
Physics news on Phys.org
  • #2
Just a simple conversion factor:

http://en.wikipedia.org/wiki/Bit#Other_information_units

Because

[tex]\log_e(x)=\frac{\log_2(x)}{\log_2(e)},[/tex]

so

[tex]- \sum_{x \in A_X} \log_2(P_X(\left \{ x \right \}))\cdot P_X(\left \{ x \right \})=-\log_2(e)\sum_{x \in A_X}\log_e(P_X(\left \{ x \right \}))\cdot P_X(\left \{ x \right \}).[/tex]
 
Last edited:

1. How do you convert bits to nats?

To convert bits to nats, you can use the formula: nats = bits * ln(2).

2. What is the relationship between bits, nats, and dits?

Bits, nats, and dits are units of measurement for information or entropy. Bits are the basic unit of binary information, while nats are the natural unit of information. Dits, short for decimal digits, are a unit of measurement that is equivalent to bits in base 10 systems.

3. Can you convert between bits and dits?

Yes, you can convert between bits and dits by using the formula: dits = bits * log10(2).

4. Why is it important to convert between bits, nats, and dits?

Converting between these units allows for easier comparison and understanding of information. It also allows for the use of different measurement systems depending on the application or field of study.

5. Are there any practical applications for converting between bits, nats, and dits?

Yes, converting between these units is commonly used in fields such as information theory, communication systems, and data compression. It can also be useful in understanding and analyzing data in various industries such as finance and healthcare.

Similar threads

Replies
85
Views
4K
  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
766
Replies
1
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
11
Views
1K
Replies
9
Views
1K
  • Differential Equations
Replies
1
Views
707
Replies
7
Views
1K
  • Special and General Relativity
Replies
6
Views
981
Replies
1
Views
1K
Replies
50
Views
3K
Back
Top