The Term "Entropy"

  • #1
Jam Smith
13
0
I was reading some articles related to entropy and I come to know that,
The term “Entropy” shows up both in thermodynamics and information theory.

Now my question is :
What’s the relationship between entropy in the information-theory sense and the thermodynamics sense?

I need some clear and short guidance.
 

Answers and Replies

  • #3
Jam Smith
13
0

I can’t think of a best way to signify intuitively that entropy and information theory are essentially the same. Imperatively I found they both are hard to describe.

The amount of information it takes to describe something is proportional to its entropy. Once you have the equations (“I = log2(N)” and “E = k log(N)”) this is pretty obvious. However, the way the word “entropy” is used in common speech is a little misleading.

Right?
 
  • #4
ZapperZ
Staff Emeritus
Science Advisor
Education Advisor
Insights Author
35,994
4,715
owever, the way the word “entropy” is used in common speech is a little misleading.
Right?

The way the word [insert any physics terminology here] is used in common speech is a little misleading. This should not be surprising and it is very common.

However, you did ask this in a physics forum, and we seldom answer such questions using such misleading/mistaken concepts. What you will get is the standard physics answer. Isn't this what you were looking for?

Zz.
 
  • #5
Jam Smith
13
0
The way the word [insert any physics terminology here] is used in common speech is a little misleading. This should not be surprising and it is very common.

However, you did ask this in a physics forum, and we seldom answer such questions using such misleading/mistaken concepts. What you will get is the standard physics answer. Isn't this what you were looking for?

Zz.

You misunderstood me. I was talking about,
In thermodynamics every state is as likely to come up as any other. In information theory,

Why in thermodynamics every state is as likely to come up as any other? Can this be proved?
I am still not clear.
 
  • #7
Jam Smith
13
0

Suggested for: The Term "Entropy"

Replies
12
Views
137
  • Last Post
Replies
18
Views
964
  • Last Post
Replies
3
Views
374
  • Last Post
Replies
10
Views
577
Replies
2
Views
254
  • Last Post
Replies
2
Views
396
Replies
57
Views
2K
Replies
1
Views
313
Replies
2
Views
364
Top