- #1

- 21

- 0

- Thread starter litewave
- Start date

- #1

- 21

- 0

- #2

- 5,428

- 291

Hmm. Can entropy be defined purely as the way energy is distributed in space ?

- #3

- 21

- 0

The total energy passed from the hot region to the cold region is Q, the beginning temperature of the hot region is T1 and the beginning temperature of the cold region is T2. So during the energy transfer, the hot region's entropy decreases by Q/T1 (approximately, since the temperature doesn't drop instantly) and the cold region's entropy increases by Q/T2. Since T1>T2, total entropy of the system increases.

- #4

- 1,707

- 5

- #5

Chris Hillman

Science Advisor

- 2,345

- 8

Note that

More generally, please note that IMO the intersection between information theory and statistical thermodynamics is probably the most difficult thing in modern physics, involving as it does deep philosphical, technical, and interpretive problems. So don't underestimate the importance of being very very careful in how you think and write.

Fortunately, despite some sloppiness of terminology, you appear to have hit upon some correct intuition. First, physical systems which can do useful work must have some (possibly abstract) "inhomogeneity" which can be "leveraged" (possibly in some abstract sense) to run some kind of (possibly idealized) "engine". Second, entropy does increase when one "homogenizes" a system (possibly in some abstract but deterministic sense, or possibly in a statistical sense). If you adopt a mathematical notion of entropy closely allied to the notions most often encountered, you can prove a lemma to this effect (but only valid for this particular notion of entropy).

One of the simplest mathematical definitions of "entropy" occurs in a very simple setting: partitions of a finite set (no probability measure needed, or if you prefer, we impose "counting measure"). Boltzmann suggested defining the entropy of such the partition [itex]\pi[/itex] as the log of the multinomial coefficient

[tex] S(\pi) =

\log \left(

\begin{array}{ccccc} & & n & & \\

n_1 & n_2 & \dots & n_{r-1} & n_r

\end{array} \right)

= \log \, \frac{n!}{n_1! \, n_2! \dots n_{r-1}! \, n_r!}

[/tex]

where the [itex]n_j[/itex] are the sizes of the r blocks of the partition, so that [itex]n = n_1 + n_2 + \dots n_r[/itex]. For convenience we can allow zero values for the [itex]n_j[/itex], as long as this sum condition holds (and [itex]n>0[/itex]).

Exercise: Assume that not all blocks have the same size. Suppose with little loss of generality that [itex]n_1 > n_2 +1 > 0[/itex]. What happens to the Boltzmann entropy if [itex]n_1 \rightarrow n_1-1, \; n_2 \rightarrow n_2+1[/itex]?

Exercise: read Weeks 247-250 and 252 (the parts dealing with Kleinian geometry) of This Weeks Finds http://www.math.ucr.edu/home/baez/TWF.html

Recalling that a Kleinian geometry arises whenever we have a group acting on a set, can you recognize a Kleinian geometry lurking behind Boltzmann's entropy?

Exercise: Try to discover and prove further formal properties of Boltzmann entropy. Can you find "categorify" these to find analogous formal properties at the level of Kleinian geometry? Are these more general?

Exercise: If you are familiar with another mathematical definition of "entropy", ditto.

Exercise: If you are not familiar with any other mathematical definitions of "entropy", apply Stirling's approximation to the Boltzmann entropy and try to find some formal properties of the quantity you come up with. What is the natural mathematical setting for its definition?

If any of this tickles your fancy, I recommend that you study one of the greatest (and most readable and most fun!) scientific papers of all time:

http://www.math.uni-hamburg.de/home/gunesch/Entropy/shannon.ps

Then read Thomas and Cover,

A good book for anyone utterly baffled by the above is Lawrence Sklar,

(

Last edited:

- #6

- 1,707

- 5

hmm so entropy obeys conservation of energy?The idea of "heat death" is that the universe has been homogenized, so that no free energy gradient is possible. "Cold death" is a somewhat silly term referring to a future epoch when free energy gradients have become too diffuse to support life as we know it, or possibly (eventually) too diffuse to runanyidealized information processing device. So from our perspective, they are pretty similar.

- #7

- 1,707

- 5

that's exactly what your post implies, that energy is conserved but become impotent.Of course not. That doesn't even make sense and I can't imagine why you thought anything I wrote would imply this.

edit

maybe my understanding of energy is elementary, by virtue of its inability to do work it is no longer energy is what you mean.

- #8

- 1,707

- 5

does the total amount of energy in the closed system of the universe remain constant?Maybe you simply need to express yourself more clearly. As I already noted, this is a subtle and extremely complex subject, so clarify of expression is more important, not less so.

- #9

- 1,707

- 5

no offense but telling me to rifle through other threads of abstruse information doesn't lend to my understanding. a glib answer would have sufficed.It turns out that this is not an easy question to discuss, and if you don't know this, it is safe to assume that you lack the background required to try to explain why not.

Did you search for past threads on this? If you don't find anything satisfactory, why not ask about that in a new thread in the Cosmology subforum? Due to the complexity of the subject, I'd prefer that we try to keep this thread more or less on topic. TIA

- #10

- 1,707

- 5

i'm faced with a problem indemnic to people like me. i yearn to know advanced topics but to know these advanced topics i need the foundation. i'm working on a foundation, i'm a begining physics major. for now though if i am curious about something it is pointless to try to read scholarly material because it is very opaque to me. so if i need a curiousity satisfied the best that i can hope for is a simplified answer.Gee whiz, ice, aren't you being a little harsh? I dislike glib answers and unless I expended more time and energy than I currently have available, it's not clear that my glib answer would be better than the one offered in the WP article I cited. And please, no offense backatcha, but shouldn't you be willing to make an effort yourself?

though i can understand if and why you would unwilling to provide one, it is still very stultifying

- #11

- 397

- 0

http://en.wikipedia.org/wiki/Entropy

- #12

- 397

- 0

Searching for an answer would have helped you out more. That is all he is trying to hint at. If you are not willing to at least look at some threads with similar issues discussed it must not be all that important.no offense but telling me to rifle through other threads of abstruse information doesn't lend to my understanding. a glib answer would have sufficed.

- #13

- 21

- 0

- #14

- 5

- 0

If the enenrgy would be transfrerred from high-energy particle to lower ones, then the all the chemical reactions in the universe would've gone to completion, but it does not work this way. THe reaction comes to halt when the entropy generated is maximum, i.e. the products formed and the reactants left must have a high disorderness created. This is where the reaction is under equilibrium.

According to what i've read in the book, change in entropy can be negative- which means that energy can be transferred from lower energy reservoir to a higher one, this requires some work in. But the entropy generated can't be negative in real life due to the irreversibilities present, like friction.

If we consider an isloated universe (adiabatic) in which there are subsystems. Though we are not able to transfer heat to the system but even then the entropy of the universe (system) is generated due to irreversibilities present during the process going on within the system.

Final Comment: THe energy of he particles in the rxn is conserved but the entropy is generated or created during rxn, i.e. at equilibrium pt this causes the rxn to stop from proceeding furhter (or go back) w/o reacting all the high energy molecules.

I hope this helps u.

- #15

Chris Hillman

Science Advisor

- 2,345

- 8

Yes, as sd_barry said, that's not really true. BTW,

energy to a less energetic one, without any statistical ambiguity.

Seems the matter is more complicated though :surprised

Another comment on what sd_barry said: entropy in statistical mechanics is properly understood against the background of ergodic theory. The book by Lawrence Slkar,

- Replies
- 12

- Views
- 3K

- Replies
- 1

- Views
- 3K

- Replies
- 5

- Views
- 3K

- Replies
- 33

- Views
- 2K

- Replies
- 22

- Views
- 67K

- Replies
- 14

- Views
- 11K

- Last Post

- Replies
- 7

- Views
- 7K

- Replies
- 1

- Views
- 2K

- Replies
- 13

- Views
- 3K

- Last Post

- Replies
- 3

- Views
- 768