Is there any background independent theory of information?

Click For Summary
SUMMARY

The discussion centers on the concept of information theory, specifically questioning whether a 'bit' exists independently or only in the context of two systems exchanging information. The Shannon-Wiener H, which quantifies information in terms of entropy, is identified as a relevant framework that aligns with this inquiry. The consensus is that bits are relational and cannot be isolated from their communicative context.

PREREQUISITES
  • Understanding of information theory principles
  • Familiarity with Shannon's entropy concept
  • Knowledge of systems theory
  • Basic grasp of communication models
NEXT STEPS
  • Research Shannon's entropy and its applications in information theory
  • Explore systems theory and its relation to information exchange
  • Investigate the implications of relational information in communication models
  • Study the works of Claude Shannon and Norbert Wiener for foundational insights
USEFUL FOR

Researchers in information theory, systems theorists, and professionals in communication technology will benefit from this discussion.

divadwg
Messages
2
Reaction score
0
Is there any theory of information that considers a 'bit' to be something that only exists relative to a pair of systems exchanging information? I.E there is no such thing as an isolated 'bit'.
 
Technology news on Phys.org
Do you mean something like the Shannon-Wiener H? That seems to match what you are asking.
 

Similar threads

  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 14 ·
Replies
14
Views
2K
Replies
27
Views
4K
  • · Replies 9 ·
Replies
9
Views
5K
Replies
3
Views
2K
  • · Replies 32 ·
2
Replies
32
Views
2K
  • · Replies 0 ·
Replies
0
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 37 ·
2
Replies
37
Views
5K