The Term "Entropy"

  • #1
13
0
I was reading some articles related to entropy and I come to know that,
The term “Entropy” shows up both in thermodynamics and information theory.

Now my question is :
What’s the relationship between entropy in the information-theory sense and the thermodynamics sense?

I need some clear and short guidance.
 

Answers and Replies

  • #3
13
0

I can’t think of a best way to signify intuitively that entropy and information theory are essentially the same. Imperatively I found they both are hard to describe.

The amount of information it takes to describe something is proportional to its entropy. Once you have the equations (“I = log2(N)” and “E = k log(N)”) this is pretty obvious. However, the way the word “entropy” is used in common speech is a little misleading.

Right?
 
  • #4
ZapperZ
Staff Emeritus
Science Advisor
Education Advisor
Insights Author
35,977
4,679
owever, the way the word “entropy” is used in common speech is a little misleading.
Right?

The way the word [insert any physics terminology here] is used in common speech is a little misleading. This should not be surprising and it is very common.

However, you did ask this in a physics forum, and we seldom answer such questions using such misleading/mistaken concepts. What you will get is the standard physics answer. Isn't this what you were looking for?

Zz.
 
  • #5
13
0
The way the word [insert any physics terminology here] is used in common speech is a little misleading. This should not be surprising and it is very common.

However, you did ask this in a physics forum, and we seldom answer such questions using such misleading/mistaken concepts. What you will get is the standard physics answer. Isn't this what you were looking for?

Zz.

You misunderstood me. I was talking about,
In thermodynamics every state is as likely to come up as any other. In information theory,

Why in thermodynamics every state is as likely to come up as any other? Can this be proved?
I am still not clear.
 
  • #7
13
0

Related Threads on The Term "Entropy"

  • Last Post
Replies
17
Views
7K
  • Last Post
Replies
0
Views
2K
  • Last Post
Replies
7
Views
1K
  • Last Post
Replies
7
Views
1K
Replies
57
Views
1K
Replies
7
Views
1K
Replies
3
Views
4K
Replies
4
Views
1K
  • Last Post
Replies
4
Views
830
  • Last Post
Replies
4
Views
748
Top