Importance of "A Mathematical Theory of Communication"

AI Thread Summary
"A Mathematical Theory of Communication" is crucial as it introduces the concept of entropy in both mathematics and physics, serving as a measure of disorder. This paper lays the groundwork for information theory, allowing for the characterization of uncertainties in complex systems. Shannon's definition of entropy is pivotal in managing multiple bit and particle systems. The discussion highlights its foundational role in connecting statistical mechanics and information theory. Understanding this paper is essential for grasping the interplay between these fields.
Arman777
Insights Author
Gold Member
Messages
2,163
Reaction score
191
I am not sure this is the right section to ask this question, but here it goes. So, I was studying Stat. Physics and I came across this paper, A Mathematical Theory of Communication. What it's so important about this paper?
 
Mathematics news on Phys.org
Arman777 said:
I am not sure this is the right section to ask this question, but here it goes. So, I was studying Stat. Physics and I came across this paper, A Mathematical Theory of Communication. What it's so important about this paper?
I would say it is the beginning of entropy in mathematics and physics as a measure for the disorder. Both subjects use Shannon's definition of entropy to characterize uncertainties in multiple bit / particle systems. It makes such systems manageable.
 
It’s one of the foundational papers of information theory.

@vanhees71 has recommended the following for the information theory approach to statistical mechanics

vanhees71 said:
A. Katz, Principles of Statistical Mechanics, W. H. Freeman
 
Reply
  • Like
Likes vanhees71 and dextercioby

Thread 'Non-orthogonal bases'

Suppose ,instead of the usual x,y coordinate system with an I basis vector along the x -axis and a corresponding j basis vector along the y-axis we instead have a different pair of basis vectors ,call them e and f along their respective axes. I have seen that this is an important subject in maths My question is what physical applications does such a model apply to? I am asking here because I have devoted quite a lot of time in the past to understanding convectors and the dual...
View full post »

Thread 'Fermat's Last Theorem'

Fermat's Last Theorem has long been one of the most famous mathematical problems, and is now one of the most famous theorems. It simply states that the equation $$ a^n+b^n=c^n $$ has no solutions with positive integers if ##n>2.## It was named after Pierre de Fermat (1607-1665). The problem itself stems from the book Arithmetica by Diophantus of Alexandria. It gained popularity because Fermat noted in his copy "Cubum autem in duos cubos, aut quadratoquadratum in duos quadratoquadratos, et...
View full post »

Thread 'What Exactly is Dirac’s Delta Function? - Insight'

Insights auto threads is broken atm, so I'm manually creating these for new Insight articles. In Dirac’s Principles of Quantum Mechanics published in 1930 he introduced a “convenient notation” he referred to as a “delta function” which he treated as a continuum analog to the discrete Kronecker delta. The Kronecker delta is simply the indexed components of the identity operator in matrix algebra Source: https://www.physicsforums.com/insights/what-exactly-is-diracs-delta-function/ by...
View full post »

Similar threads

MHB Communication in mathematics and physics
Replies
1
Views
2K
Insights Series in Mathematics: From Zeno to Quantum Theory
Replies
2
Views
3K
I System to represent objects in Mathematics
Replies
38
Views
4K
Computer Communication Theory & Information Theory - A name change?
Replies
3
Views
2K
I Questions regarding Kurepa's Conjecture
Replies
1
Views
2K
I Monumental Proof Settles Geometric Langlands Conjecture
Replies
1
Views
2K
Insights Classification of Mathematics by 42 Branches
Replies
25
Views
4K
I Opinion about an introduction of the Lebesgue integral in "Introduction to Hilbert spaces with applications"
Replies
5
Views
1K
A new member
Replies
2
Views
102
I Good introductory book for chaos theory?
Replies
10
Views
6K

Hot Threads

Recent Insights

Back
Top