Importance of "A Mathematical Theory of Communication"

AI Thread Summary
"A Mathematical Theory of Communication" is crucial as it introduces the concept of entropy in both mathematics and physics, serving as a measure of disorder. This paper lays the groundwork for information theory, allowing for the characterization of uncertainties in complex systems. Shannon's definition of entropy is pivotal in managing multiple bit and particle systems. The discussion highlights its foundational role in connecting statistical mechanics and information theory. Understanding this paper is essential for grasping the interplay between these fields.
Arman777
Insights Author
Gold Member
Messages
2,163
Reaction score
191
I am not sure this is the right section to ask this question, but here it goes. So, I was studying Stat. Physics and I came across this paper, A Mathematical Theory of Communication. What it's so important about this paper?
 
Mathematics news on Phys.org
Arman777 said:
I am not sure this is the right section to ask this question, but here it goes. So, I was studying Stat. Physics and I came across this paper, A Mathematical Theory of Communication. What it's so important about this paper?
I would say it is the beginning of entropy in mathematics and physics as a measure for the disorder. Both subjects use Shannon's definition of entropy to characterize uncertainties in multiple bit / particle systems. It makes such systems manageable.
 
It’s one of the foundational papers of information theory.

@vanhees71 has recommended the following for the information theory approach to statistical mechanics

vanhees71 said:
A. Katz, Principles of Statistical Mechanics, W. H. Freeman
 
  • Like
Likes vanhees71 and dextercioby
Seemingly by some mathematical coincidence, a hexagon of sides 2,2,7,7, 11, and 11 can be inscribed in a circle of radius 7. The other day I saw a math problem on line, which they said came from a Polish Olympiad, where you compute the length x of the 3rd side which is the same as the radius, so that the sides of length 2,x, and 11 are inscribed on the arc of a semi-circle. The law of cosines applied twice gives the answer for x of exactly 7, but the arithmetic is so complex that the...
Thread 'Video on imaginary numbers and some queries'
Hi, I was watching the following video. I found some points confusing. Could you please help me to understand the gaps? Thanks, in advance! Question 1: Around 4:22, the video says the following. So for those mathematicians, negative numbers didn't exist. You could subtract, that is find the difference between two positive quantities, but you couldn't have a negative answer or negative coefficients. Mathematicians were so averse to negative numbers that there was no single quadratic...
Thread 'Unit Circle Double Angle Derivations'
Here I made a terrible mistake of assuming this to be an equilateral triangle and set 2sinx=1 => x=pi/6. Although this did derive the double angle formulas it also led into a terrible mess trying to find all the combinations of sides. I must have been tired and just assumed 6x=180 and 2sinx=1. By that time, I was so mindset that I nearly scolded a person for even saying 90-x. I wonder if this is a case of biased observation that seeks to dis credit me like Jesus of Nazareth since in reality...

Similar threads

Back
Top