Proof that all information can be coded in binary?

Click For Summary

Discussion Overview

The discussion revolves around the claim that all information can be coded in binary, as presented in a textbook on abstract algebra. Participants explore the implications of this statement, questioning its validity and the definitions of "information" involved.

Discussion Character

  • Exploratory, Conceptual clarification, Debate/contested

Main Points Raised

  • One participant expresses curiosity about the proof of the claim that any piece of information can be encoded as a binary string, suggesting that it seems intuitively obvious but seeks a rigorous proof.
  • Another participant emphasizes the need to define "information" before attempting to prove the claim.
  • A different viewpoint suggests that the statement may be misinterpreted, arguing that it should refer to "finite information of any type" being representable by a finite binary string, rather than all conceivable information.
  • One participant proposes using Godel numbering as a method to encode symbols and information into binary format, indicating a potential approach to the problem.

Areas of Agreement / Disagreement

Participants do not reach a consensus on the validity of the claim. There are competing views regarding the definition of information and the feasibility of encoding all information in binary.

Contextual Notes

Limitations include the ambiguity in the definition of "information" and the implications of encoding infinite versus finite information. The discussion highlights the complexity of measuring and encoding information in practical terms.

Who May Find This Useful

This discussion may be of interest to those studying abstract algebra, computer science, information theory, or related fields that explore the foundations of information encoding.

jack476
Messages
327
Reaction score
124
I just got Pinter's book, "A Book of Abstract Algebra", for the modern algebra course that I'm taking. It's a very nice book, I'm enjoying reading through it so far.

What's especially interesting is the connections to computer science and controls, mostly because I switched to math and physics out of electrical engineering. Anyway, in its introduction chapter on groups, it makes the following statement:

Groups in Binary Codes
The most basic way of transmitting information is to code it into strings of 0s and 1s, such as 0010111, 1010011, etc. Such strings are called binary words, and the number of 0s and 1s in any binary word is called its length. All information may be coded in this fashion.

(Emphasis mine).

Out of curiosity, I am wondering if there exists a proof of this statement, that is, that any and every single piece of information in the universe, of arbitrary complexity and abstraction, could be encoded as a string of binary digits, assuming one could access that information and had a storage device large enough.

Intuitively, I would say that it's obvious, a piece of information can be stored in every digit and in theory we can always increase the information capacity by adding digits, but I'm wondering if a rigorous proof exists.

(Note: I put this in the abstract algebra section because it came up in an abstract algebra textbook, I will understand if the mods feel it is more appropriate in the computer science section).
 
Physics news on Phys.org
In order to prove it, first you'd have to define "information".
 
I think the statement is intended to convey that "information of any type may be coded in this fashion", or more rigorously "finite information of any type may be represented by a finite binary string", rather than "the set of all sets of information..."

You can't even measure the position and velocity of every proton in a drop of water, let alone encode it.
 
You could, for example, use Godel numbering to assign a number to every symbol, letter, or formula used in stating the "information", then write that number in binary notation.
 

Similar threads

Replies
13
Views
4K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 18 ·
Replies
18
Views
3K
  • · Replies 6 ·
Replies
6
Views
5K
Replies
10
Views
5K
  • · Replies 4 ·
Replies
4
Views
4K
  • · Replies 14 ·
Replies
14
Views
3K
  • · Replies 7 ·
Replies
7
Views
23K
Replies
8
Views
2K
  • · Replies 5 ·
Replies
5
Views
3K