What is Entropy: Definition and 1000 Discussions

Entropy is a scientific concept, as well as a measurable physical property that is most commonly associated with a state of disorder, randomness, or uncertainty. The term and the concept are used in diverse fields, from classical thermodynamics, where it was first recognized, to the microscopic description of nature in statistical physics, and to the principles of information theory. It has found far-ranging applications in chemistry and physics, in biological systems and their relation to life, in cosmology, economics, sociology, weather science, climate change, and information systems including the transmission of information in telecommunication.The thermodynamic concept was referred to by Scottish scientist and engineer Macquorn Rankine in 1850 with the names thermodynamic function and heat-potential. In 1865, German physicist Rudolph Clausius, one of the leading founders of the field of thermodynamics, defined it as the quotient of an infinitesimal amount of heat to the instantaneous temperature. He initially described it as transformation-content, in German Verwandlungsinhalt, and later coined the term entropy from a Greek word for transformation. Referring to microscopic constitution and structure, in 1862, Clausius interpreted the concept as meaning disgregation.A consequence of entropy is that certain processes are irreversible or impossible, aside from the requirement of not violating the conservation of energy, the latter being expressed in the first law of thermodynamics. Entropy is central to the second law of thermodynamics, which states that the entropy of isolated systems left to spontaneous evolution cannot decrease with time, as they always arrive at a state of thermodynamic equilibrium, where the entropy is highest.
Austrian physicist Ludwig Boltzmann explained entropy as the measure of the number of possible microscopic arrangements or states of individual atoms and molecules of a system that comply with the macroscopic condition of the system. He thereby introduced the concept of statistical disorder and probability distributions into a new field of thermodynamics, called statistical mechanics, and found the link between the microscopic interactions, which fluctuate about an average configuration, to the macroscopically observable behavior, in form of a simple logarithmic law, with a proportionality constant, the Boltzmann constant, that has become one of the defining universal constants for the modern International System of Units (SI).
In 1948, Bell Labs scientist Claude Shannon developed similar statistical concepts of measuring microscopic uncertainty and multiplicity to the problem of random losses of information in telecommunication signals. Upon John von Neumann's suggestion, Shannon named this entity of missing information in analogous manner to its use in statistical mechanics as entropy, and gave birth to the field of information theory. This description has been proposed as a universal definition of the concept of entropy.

View More On Wikipedia.org
  1. mooncrater

    Unknown (to me) formula of Entropy

    Homework Statement The question is says: Two vessels divided by a partition contain 1 mol of N2 and 2 mol of O2 gas. If the partition is removed and gases ate mixed isothermally, then find the change in entropy due to mixing assuming initial and final pressure are same . Homework Equations...
  2. mooncrater

    Is this how we represent entropy?

    Homework Statement The question says: In a process involving n moles of an ideal gas , what is the entropy change of the system ? Homework Equations ΔS=qrev/T=(ΔU-w)/T (I have used the chemistry's equation of 1st law of thermodynamics which has the -ve sign) The Attempt at a Solution The...
  3. mooncrater

    Maximizing Entropy in an Isolated System: Understanding the Role of Equilibrium

    Homework Statement There is a line in a question: "Entropy of an isolated system is always maximised at equilibrium." And it is given true. But Why? Homework Equations None The Attempt at a Solution In an isolated system heat input is equal to zero. And we know that entropy= heat...
  4. D

    Entropy change of van der Waals gas expansion

    Homework Statement Consider ##n## moles of gas, initially confined within a volume ##V## and held at temperature ##T##. The gas is expanded to a total volume ##\alpha V##, where ##\alpha## is a constant, by a reversible isothermal expansion. Assume that the gas obeys the van der Waals equation...
  5. mooncrater

    Relation between system enthelpy and surrounding entropy

    Homework Statement It is given in my book that: ΔStotal=ΔSsystem+ΔSsurrounding Where S is entropy. ΔSsurr=-ΔH/T Therefore: ΔStotal=ΔSsystem+[-ΔHsystem/T] As we can see here that ΔSsurrounding=-ΔHsystem/T is applied here . But is this relation correct? Homework Equations ΔS=qreversible/T Where...
  6. T

    How Does the Universe Use Temperature Differences to Create Structures?

    The main result of thermodynamics is that if you have a place that is hot and another place that is colder, you can operate a heat engine by absorbing heat from the hot place and dumping it in the cold place, extracting some useful work in the process. It gives you a way to calculate the...
  7. hideelo

    Two (sorta meta) questions related to entropy

    I'm taking thermal physics this semester and I have two questions that have been floating around my head, 1. Time's arrow and second law: If I have system (box of gas) and at t_i I know all the positions and momenta of all the particles, let's assume it's not in a state with maximum entropy...
  8. Jimster41

    Hubble constant and Entropy v2

    Is there agreement here regarding the relationship between expansion of the universe from its initial conditions, entropy (2nd law), time, (and more tenuously perhaps) "evolution"? I asked a question awhile back that was too specific I think that tried to tie the constant of expansion to the...
  9. PWiz

    Does electronegativity affect rate of entropy increase?

    Let's say we have two samples of pure Helium-4, and two other samples of pure hydrogen fluoride (consisting of Hydrogen-1 and Fluorine-19) all in separate containers. One container of each chemical is at the same initial temperature of 200°C at a pressure of 101kPa, and the other ones are at...
  10. S

    Entropy and thermodynamics question

    Homework Statement Planck famously argued that if identical particles are considered indistinguishable this would resolve Gibbs paradox by correcting for over-counting of the states. If the number of possible arrangements, W, of the N particles of an ideal gas at volume, V, and temperatureT...
  11. T

    Entropy State Variable: Thermal Equilibrium Questions

    I have a few questions about entropy and path Scenario I have a closed system of Ideal Gas- Volume is Fixed , Mol Vol is fixed. At room temperature the system is in thermal equilibrium with its surroundings I then cool this system removing Q . To this system I then re-add Q until it is again in...
  12. Q

    A Black Hole's "lost entropy"?

    I know that a black hole sucks stuff into a singularity, and I know about the second law of thermodynamics (that the entropy in an isolated system can only stay the same or increase), so if a black hole sucks something in it reduces the total entropy of the Universe, right? This was brought up...
  13. T

    Is the difference of two state functions a state function?

    Hello everybody, For my thermodynamics test I have to tell whether or not a quantity is a state function, which is obviously not all too difficult when regarding entropy, enthalpy etc. on their own. However there are a lot of questions where it is about "H-S" or "G-H". Are these not always...
  14. L

    How Does Energy Transfer Affect Entropy in a Water-Ice System?

    Homework Statement 5 kg of water at 60 degrees are put in contact with 1 kg of ice at 0 degrees and are thermally isolated from everything else. The latent heat of ice is 3.3x105 J/kg What is the change of entropy of the universe when 100J of energy are transferred from the water to the ice...
  15. P

    How Does Cooling Bricks Affect the Entropy Change of the Universe?

    One hundred 1:00 kg bricks are removed from a ring kiln, which operates at a temperature of 500 C; and are allowed to cool in the atmosphere at 20:0 C: If the process irreversibility is 18:8 MJ determine the entropy change of the Universe and the specic heat capacity of the material from which...
  16. K

    Gravitational entropy in the early universe

    Penrose wrote in the Road to Reality that gravitational clumping increases the entropy of the universe. The early universe was very low in entropy because it was very smooth, with very little clumping. So, is it accurate to say that the early universe was high in entropy except for the...
  17. twistor

    Alternative Ways of Decreasing Entropy in CCC

    Note: This is a question on a particular cosmological scheme, mainly Conformal Cyclic Cosmology. In Cycles of Time, Penrose says that Black Hole Information Loss causes the entropy to decrease in a way that doesn't violate the 2nd law. I think his analysis is correct, IF it was the case that...
  18. S

    Other Texts for mastering the concepts of entropy?

    Perhaps aptly, the subject of entropy is a serious mess when one attempts to use Prof. Google to learn about it. There's just too many disparate concepts across too many different domains for me to be able to piece it all together. With the baseline that I've learned the simplified...
  19. F

    Does the entropy of the universe as a whole change?

    Does the universe as a whole ever change from being the universe as a whole? Does it ever break into pieces and cease being the universe? And if anything (like the universe) never changed its state, wouldn't that mean its entropy never changed? Are there any constant thermodynamic properties...
  20. I

    Temperature and entropy for two gases mixing

    Homework Statement A system is made up of two halves. In one there's 10kg neon gas with the temperature ##20 \circ##C, in the other 10kg nitrogen gas with the temperature ##100 \circ## C. Suppose the septum is removed so that thermodynamic equilibrium may appear and the gases mix. Calculate...
  21. M

    Thermoelectric devices and entropy

    Today in my thermodynamics class my professor spoke about how a process must satisfy the laws of thermodynamics in order to work. He gave an example of current going through a wire generating heat. (See attached picture) But he also talked about how adding heat to a wire and it generating a...
  22. K

    Spontaneous emission entropy

    Does entropy increase during spontaneous emission? If not, how is the information about the emitted photon mode encoded into the initial state of the atom (and/or environment)? If so, where does the extra information come from?
  23. R

    Entropy change in irreversible processes

    The equation for entropy S=delta(Q)/T is derived from reversible processes such as Carnot cycle. The delta(Q) in the equation is the reversible heat added or taken out from the system. So, why is this equation valid in the case of processes like cooling of a body which is irreversible?
  24. F

    Does "Entropy" play a role in Quantum Physics?

    Does "Entropy" play a role in Quantum Physics?
  25. S

    Entropy: Definition, Misconceptions & Increase in Closed System

    A lot of the less maths-y definitions of entropy talk about disorder and how disordered a system is. I'm given to understand that entropy is a measure of energy over temperate. Could someone clear up these misconceptions? I don't understand why 'disorder' is used. Isn't that subjective? Second...
  26. A

    Change in Entropy, double integral?

    Homework Statement A thermally conducting, uniform and homogeneous bar of length L, cross section A, density p and specific heat at constant pressure cp is brought to a nonuniform temperature distribution by contact at one end with a hot reservoir at a temperature TH and at the other end with a...
  27. slatts

    Scale of perturbations re entropy, in quantum bounce

    In Bojowald's 2010 popularization of Loop Quantum Cosmology Once Before Time, there's a sketchy diagram (on his p.125) showing quantum perturbations in a transitional phase between contracting and expanding universes as widest at earlier times of decreasing volume, narrowing at the...
  28. Jimster41

    Is the concept of entropy addressed in the Lagrangian formalism?

    just working my way through Susskind's "Theoretical Minimum". At the Langrangian formalism I'm in novel territory so this may be a dumb question. Kind of multiple choice or fill in a real answer. Why is there no term for the Entropy of a system in the Lagrangian? Is it because time is an...
  29. L

    Entropy Change for an Ideal Gas

    Homework Statement 10 moles of an ideal gas Cv = 20.8 J/mol at T0 = 300 K and P0 =0.3 MPa occupy the left half of an insulated vessel. At time t=0 a 1 kW electrical heating element is turned on. after 30 s, the partition dividing the vessel ruptures and the heating element is turned off...
  30. G

    How Do I Determine the Change in Entropy of the System?

    Homework Statement Determine ΔSsys when 3.0 mol of an ideal gas at 25°C and 1 atm is heatedd to 125°C and expanded to 5 atm. Rationalize the sign of ΔSsys. Homework Equations State Function: dS = (dU)/T + (PdV)/T State Function for Entropy of Ideal Gas: dS = (CV,mdT)/T + (nRdV)/V Ideal gas...
  31. Jimster41

    Is the Hubble Constant Linked to the Second Law of Thermodynamics?

    Do I understand correctly (in general terms) or wildly incorrectly if I imagine that the constant of expansion and the second law of thermodynamics are very closely connected, or even that the constant of expansion is potentially the source of the second law?
  32. Alexi-dono

    [python] How can I get my OS to pick this up as entropy?

    So I am going to be making some keys; and I want to make them more random... So I made this: #I know that the code is pretty crude, but it works. #P.S. it is an infinite loop, run at your own risk import random from random import randint import string import time x=1 n=randint(5,90)...
  33. G

    Determine all of the Physical Chemistry Variables of the System

    Homework Statement A weather balloon is filled with Helium gas and released from the ground. It goes up 18km and achieves a diameter of 15m. Determine if the following values are greater than zero, less than zero, or equal to zero: ΔV, ΔP, ΔT, ΔU, ΔH, Ssys, surr, Stot Homework Equations ΔU =...
  34. A

    Contradiction in thermodynamics problem?

    Consider a gas as your system, confined in the usual frictionless piston-cylinder. The piston is massless, external pressure is constant, Pext. Let the system be at initial state T1 and P1 = Pext. We want to compare the following two processes: in the first process, we reversibly heat the gas...
  35. predaylight

    De Broglie wavelength and ideal gas entropy derivation

    When the ideal gas entropy is derived, we consider N atoms in a box of volume=Lx*Ly*Lz. Then, we make the assumption that Lx,Ly,Lz >>de Broglie wavelength of atoms. I am not sure why we need to make this assumption? Thanks!
  36. It's me

    Callen Thermodynamics 2.8-2 matter flow equilibrium

    Homework Statement A two component gaseous system has a fundamental equation of the form $$S=AU^{1/3} V^{1/3} N^{1/3} + \frac{BN_1N_2}{N}$$ where $$N=N_1+N_2$$ and A and B are positive constants. A closed cylinder of total volume 2V_0 is separated into two equal subvolumes by a rigid diathermal...
  37. E

    Exploring the Mysteries of Black Hole Entropy and the Holographic Principle

    How exactly did Hawking compute that black hole entropy is 1/4 that of a Planck area and concluded about the holographic principle where information of a volume is located on the area of black hole? And if there was no holographic principle, how big should entropy of the black hole be with...
  38. S

    Confusion on entropy change calculations for irreversible process

    I was studying 2nd law thermodynamics. In that context found the clausius's inequality saying closed integral of dQ/T <0 for irreversible process. And from the reversible process entropy was defined. And from that view they said that for irreversible process dS>dQ/T. Now when I saw some...
  39. J

    Entropy increase in adiabatic irreversible compression

    Hi there, I was wondering if you could help me, I think I may have some concepts wrong or incomplete. Homework Statement We have an adiabatic cylinder of volume ##V_1## filled with a gas of pressure ##p_1## and temperature ##T_1## in thermal equilibrium, closed with a piston. All of a suden...
  40. Jewish_Vulcan

    Describe disorder in terms of entropy

    when they mean disorder do they mean the range of velocities of the particles increasing as entropy increases? so there are larger differences between the low KE particles and the high KE particles?
  41. Newb_Aero_Ninja

    Convergent Subsonic Ramjet Utilizing Shockwave Compression

    Hi, I am working on investigating an idea I proposed regarding a ramjet that operates in subsonic flow (of a fixed speed) with a convergent intake. That utilizes the pressure immediately behind a standing shock-wave for compression. I have posted a link to my initial report here and I now need...
  42. T

    Relationship between pressure & chem potential in ideal gas

    Homework Statement (Excerpted from a longer, multipart problem but essentially) Show that for an ideal gas, $$ \frac{\partial p}{\partial T}\bigg)_\mu = \frac{S}{V}. $$ Homework Equations • The ideal gas law, of course $$ pV = Nk_{\rm B}T $$ • Pressure, temperature, and chemical potential...
  43. diegzumillo

    Entropy as log of omega (phase space volume)

    Homework Statement I've seen this problem appear in more than one textbook almost without any changes. It goes like this: Assume the entropy ##S## depends on the volume ##\bar{\Omega}## inside the energy shell: ##S(\bar{\Omega})=f(\bar{\Omega})##. Show that from the additivity of ##S## and the...
  44. J

    Entropy (Information Theory Question)

    Homework Statement Let ##X## and ##Y## be two independent integer-valued random variables. Let ##X## be uniformly distributed over ##\left\{1,2,...,8\right\}##, and let ##\text{Pr}\left\{Y=k\right\} =2^{-k},~k=1,2,3,...## (a) Find ##H(X)##. (b) Find ##H(Y)##. (c) Find ##H(X+Y,X-Y)##. Homework...
  45. N

    Proof of "Entropy of preparation" in Von Neumann entropy

    How should I prove this? From John Preskill's quantum computation & quantum information lecture notes(chapter 5) If a pure state is drawn randomly from the ensemble{|φx〉,px}, so that the density matrix is ρ = ∑px|φx〉<φx| Then, H(X)≥S(ρ) where H stands for Shannon entropy of probability {px}...
  46. R

    Explain why the entropy is non-nul

    Homework Statement Bonjour, Given the hamiltonian Show that The Attempt at a Solution [/B]...
  47. V

    Papers on Entropy in Quantum Mechanics Framework

    Hey, I am going to write my bachelor's thesis on Entropy in a Quantum Mechanical Framework. My professor told me he would refer me to some literature. However it will take him some time. I would like to get started myself. Could you please refer me to papers, books, articles? I have already read...
  48. MexChemE

    Gibbs free energy and entropy inconsistency

    Homework Statement For a certain reaction, ΔG = 13580 + 16.1 T log10(T) - 72.59 T. Find ΔS and ΔH for the reaction at 298.15 K. Homework Equations ΔG = ΔH - TΔS \left[\frac{\partial (\Delta G)}{\partial T} \right]_P = - \Delta S The Attempt at a Solution For the sake of this thread's length I...
  49. L

    Change in Entropy for Isothermal Compression of Ideal Gas

    Problem statement: A sample of 8.02 × 10-1 moles of nitrogen gas ( γ = 1.40) occupies a volume of 2.00 × 10-2 m3at a pressure of 1.00 × 105 Pa and temperature of 300 K. It is isothermally compressed to half its original volume. It behaves like an ideal gas. Find the change in entropy of the gas...
  50. A

    Calculation of entropy change

    Homework Statement A solid metallic cube of heat capacity S is at temperature 300K. It is brought in contact with a reservoir at 600K. If the heat transfer takes place only between the reservoir and the cube, the entropy change of the universe after reaching the thermal equillibrium is A...
Back
Top