Entropy in quantum mechanics and second law of thermodynamics

[tom.stoer]

Can you please tell me were I am wrong?

I define the entropy (as usual) as

$$S[\rho] = -k_B \text{tr}(\rho\ln\rho)$$

The time development of the density operator is

$$\rho(t) = U(t)\rho(0) U^\dagger(t)$$

That means

$$S[\rho(t)] = S[U(t)\rho(0) U^\dagger(t)] = S[\rho(0)]$$

where I used the invariance of any trace of the density operator w.r.t. a general unitary transformation (here: time translation)

But that means that the entropy my system is always constant

$$\frac{dS}{dt} = 0$$

Where is my mistake?

 

[dextercioby]

The mistake is obvious.

$$\mbox{tr}\left(\rho (t) \ln\rho (t)\right) =\mbox{tr}\left[U(t) \rho (0) U^{\dagger} (t) \left[\ln U(t) + \ln\rho (0) + \ln U^{\dagger} (t)\right]\right] \neq \mbox{tr} \left(\rho(0) \ln \rho(0)\right)$$

 

[tom.stoer]

Naively I would define ln(A) as a power series in terms of A (just like for any other function f(A)); but as soon as I do this the equality is trivial. So why is this power series expansion not valid here?

If I do just a change of basis vectors generated by a unitary U there MUST not be a U dependence; but the algebraic properties do not depend on the specific chaoice for U (namely that's the time translation); it's valid for every U.

And I mean, you have not shown that the two expressions are indeed different; you just stopped calculating :-)

 

[tom.stoer]

Let's look at a density operator

$$\rho = \sum_n p_n|n\rangle\langle n|$$

where n is an energy eigenstate. That means that the time evolution of the states is trivial

$$|n,t\rangle = e^{-iHt}|n\rangle = e^{-iE_nt}|n\rangle$$

and that the density operator is constant

$$\rho(t) = \rho(0)$$

That means that in case of a purely unitary time-evolution entropy is always constant

$$\frac{dS}{dt} = 0$$

That means that the only way to get a non-constant entropy is to have a non-unitary time-evolution with

$$\rho(t) = \sum_n p_n(t)|n\rangle\langle n|$$

where again I assume time-independent H, i.e. trivial time-evolution of the states.

Is it still possible to derive

$$\frac{dS}{dt} \ge 0$$

and what are "reasonable" assumptions or conditions for the time-dependence of the probabilities?

 

[weejee]

I think you might need to look at some reduced density matrices.

 

[tom.stoer]

I don't want to talk about subsystems and reduced density operators; for subsystems and entanglement, energy and particle exchange, ... it's clear that I may get time-dependent p(t).

I want to look at the whole (isolated) quantum system.

If this quantum system has been prepared in a non-equilibrium state I know that it's entropy will grow (classically). How can I proof this in quantum mechanics?

 

[weejee]

Well, we know that an isolated system always evolves unitarily.

Among the foundations of the quantum statistical mechanics, there is the random-phase postulate. This means that we have no knowledge on the many-particle correlation, which amounts to looking at the one-particle reduced density matrix.

-Well, this statement isn't correct, as the 'random-phase' means the phase between different eigenstates of the whole system, but not between different single-particle levels. I guess I need to think more about this.

 

[A. Neumaier]

Can you please tell me were I am wrong?

I define the entropy (as usual) as

$$S[\rho] = -k_B \text{tr}(\rho\ln\rho)$$

The time development of the density operator is

$$\rho(t) = U(t)\rho(0) U^\dagger(t)$$

That means

$$S[\rho(t)] = S[U(t)\rho(0) U^\dagger(t)] = S[\rho(0)]$$

where I used the invariance of any trace of the density operator w.r.t. a general unitary transformation (here: time translation)

But that means that the entropy my system is always constant

$$\frac{dS}{dt} = 0$$

Where is my mistake?

There is no mistake. Unitary evolution implies that pure states remain pure, and that entropy is constant.

The increase of entropy is a property of systems in which the joint dynamics with the environment is integrated out, so that a dissipative dynamics for the system alone results, described by a Lindblad equation rather than the von Neumann equation.
Here entropy increases until equilibrium is reached.

 

[Demystifier]

I don't want to talk about subsystems and reduced density operators; for subsystems and entanglement, energy and particle exchange, ... it's clear that I may get time-dependent p(t).

I want to look at the whole (isolated) quantum system.

If this quantum system has been prepared in a non-equilibrium state I know that it's entropy will grow (classically). How can I proof this in quantum mechanics?

See S. Weinberg, The Quantum Theory of Fields I, Sec. 3.6, pages 150-151.

 

[DrDu]

Already in classical mechanics Liouvilles theorem proves that microscopic entropy remains constant with time for an isolated system as long as you describe the motion of all particles with Newtonian dynamics. You need some mechanism like coarse graining or consider an explicitly irreversible equation like Boltzmann's equation to obtain an entropy increase. The problem is that a finite isolated system will always return to its initial configuration in phase space if you wait long enough (Zemelo's paradox?). However, this time becomes very large already for quite small systems so that you should take into account the coupling to the surrounding, however weak it may be.

 

[tom.stoer]

There is no mistake. Unitary evolution implies that pure states remain pure, and that entropy is constant.

My assumption is slightly more general. I can start with a mixed state (but still unitary evolution).

 

[A. Neumaier]

My assumption is slightly more general. I can start with a mixed state (but still unitary evolution).

My second statement didn't assume the first as hypothesis, but was independent of it.
Your argument is well-known (and probably already in von Neumann's 1932 book).

There is a connection between the two: Entropy increase is typically accompanied by mixing, i.e. the fact that pureness is not preserved by the evolution. This is always the case when the environment is properly taken into account and the Markov approximation is made to remove the memory of past environment influence.

However, there are more approximate models involving Hamiltonians with an (antihermitian) optical potential where there is no mixing but entropy typically still increases.

 

[tom.stoer]

Fine, thanks. So what is the most general framework (assumptions regarding H etc.) in which dS/dt ≥ 0 can be proven?

 

[A. Neumaier]

Fine, thanks. So what is the most general framework (assumptions regarding H etc.) in which dS/dt ≥ 0 can be proven?

It is called a quantum dynamical semigroup, a concept derived and well-studied in the decade before 1980. The generator can (under very mild assumptions) be put in the form of a so-called Lindblad operator You can find lots of papers about them using http://scholar.google.com or http://xxx.lanl.gov/multi?group=physics&/find=Search

 

[Demystifier]

Fine, thanks. So what is the most general framework (assumptions regarding H etc.) in which dS/dt ≥ 0 can be proven?

Have you seen my post #9?

 

[tom.stoer]

Thanks again

 

[tom.stoer]

Have you seen my post #9?

yes, thanks; I'll check that

 

[A. Neumaier]

yes, thanks; I'll check that

Weinberg derives a classical master equation involving quantum transition processes.
This is (but Weinberg doesn't make the connection) the diagonal part of a corresponding quantum master equation, which is governed by a Lindblad operator.