What is Entropy: Definition and 1000 Discussions

Entropy is a scientific concept, as well as a measurable physical property that is most commonly associated with a state of disorder, randomness, or uncertainty. The term and the concept are used in diverse fields, from classical thermodynamics, where it was first recognized, to the microscopic description of nature in statistical physics, and to the principles of information theory. It has found far-ranging applications in chemistry and physics, in biological systems and their relation to life, in cosmology, economics, sociology, weather science, climate change, and information systems including the transmission of information in telecommunication.The thermodynamic concept was referred to by Scottish scientist and engineer Macquorn Rankine in 1850 with the names thermodynamic function and heat-potential. In 1865, German physicist Rudolph Clausius, one of the leading founders of the field of thermodynamics, defined it as the quotient of an infinitesimal amount of heat to the instantaneous temperature. He initially described it as transformation-content, in German Verwandlungsinhalt, and later coined the term entropy from a Greek word for transformation. Referring to microscopic constitution and structure, in 1862, Clausius interpreted the concept as meaning disgregation.A consequence of entropy is that certain processes are irreversible or impossible, aside from the requirement of not violating the conservation of energy, the latter being expressed in the first law of thermodynamics. Entropy is central to the second law of thermodynamics, which states that the entropy of isolated systems left to spontaneous evolution cannot decrease with time, as they always arrive at a state of thermodynamic equilibrium, where the entropy is highest.
Austrian physicist Ludwig Boltzmann explained entropy as the measure of the number of possible microscopic arrangements or states of individual atoms and molecules of a system that comply with the macroscopic condition of the system. He thereby introduced the concept of statistical disorder and probability distributions into a new field of thermodynamics, called statistical mechanics, and found the link between the microscopic interactions, which fluctuate about an average configuration, to the macroscopically observable behavior, in form of a simple logarithmic law, with a proportionality constant, the Boltzmann constant, that has become one of the defining universal constants for the modern International System of Units (SI).
In 1948, Bell Labs scientist Claude Shannon developed similar statistical concepts of measuring microscopic uncertainty and multiplicity to the problem of random losses of information in telecommunication signals. Upon John von Neumann's suggestion, Shannon named this entity of missing information in analogous manner to its use in statistical mechanics as entropy, and gave birth to the field of information theory. This description has been proposed as a universal definition of the concept of entropy.

View More On Wikipedia.org
  1. S

    I want a deep clarification in entropy

    i want a deep clarification in entropy
  2. S

    Low Entropy big bang , models that explain it

    Hi As I understand it there are several attmepts to explain the low entropy configuration of the universe at the big bang. Is seems to me the choices on the table that I am aware of are a mutliverse as in the Caroll/Chen model . A cyclic universe as in the CCC model or some hybrid of the two...
  3. P

    Total entropy change for ice melting in a room

    Homework Statement Okay, so I am having difficulties with understanding the concepts around entropy, take this question: What is the total entropy change for 7 kg of ice melting from -5 C° to 5 C° in room at 5 C°. Homework Equations dS=dQ/T Q =mΔH m*c*ln(tfinal/tinitial) c_ice=2 c_water=4...
  4. F

    Decision making based on entropy reduction

    Hello guys, I just registered on this forum, so I hope you can help me with some differential entropy stuff. So I have made the attached pdf file (it's a bit messy, sorry) that demonstrates a toy version of the problem I'm trying to solve. Thing is I'm quite new to information theory, so...
  5. A

    Is my answer correct for finding the change in entropy?

    I am not sure if my work is correct so I need your help to confirm it. Question: Find the change in entropy when: n mol of ideal gas (ɣ=7/5) is reversibly compressed until the pressure is three times the ideal gas at constant temperature. My answer: S=n Cv ln(T2/T1) + nR ln(V2/V1)...
  6. R

    Pressure, temperature and entropy vs. volume graphs

    Homework Statement "In the following a<b<c are finite positive constants. One mole of an ideal monoatomic gas, initially at volume Vi and temperature 1000K, expands to a final volume cVi in 3 reversible steps: (1) isothermal expansion from Vi to aVi (2) adiabatic expansion from aVi to bVi (3)...
  7. A

    What is the Entropy of Liquid Nitrogen at 77.244K and 1bar Pressure?

    Hi All, I tried to find entropy of liquid nitrogen in various data books, using nitrogen's CAS number, MSDS, but I was able to get the entropy of nitrogen till only 100K, not below that. Does anyone know what's the entropy of liquid nitrogen or that where can I find it? Thanks!
  8. tom.stoer

    Gravitational Entropy: QFT, String Theory, Spin Networks

    In ordinary QM and QFT entropy is defined using a density operator for a generalized state: S = -\text{tr}\left(\rho\,\ln\rho\right) b/c for the gravitational field we do neither know the fundamental degrees of freedom nor the Hilbert space states, a definition like \rho =...
  9. G

    How Do You Calculate Entropy and Reversibility in Irreversible Processes?

    hi i am a little bit confused about the definition of entropy that says: dS=dQ_rev/T what does this dQ_rev mean? is this definition wrong, if we are talking about irreversible processes? My idea was that when you have an irreversible process like the isobaric expansion of a gas, then...
  10. A

    Statistical Relationship Between Helmoltz Free Energy and Entropy

    Homework Statement From Hill's "Introduction to Statistical Thermodynamics", question 3-4 reads: (note "STR" denotes the case of most probable distribution and should be read as C*) Homework Equations The most probable distribution for a system of independent indistinguishable...
  11. A

    Entropy in an isobar transformation

    What is the variation of entropy in an isobar transformation?
  12. atyy

    Entropy, Relative entropy, Mutual information

    The Bekenstein-Hawking entropy is expected to be, and has been shown to be in some cases, derived from counting states. However, entropy is not defined for continuous probability densities, and so I have heard it said that relative entropy (of which the mutual information is a form) is more...
  13. jbrussell93

    Exploring Entropy: A Physics Student's Questions

    I have gotten to the thermodynamics portion of my physics class, and right now I'm reading about entropy. It is taking me forever to read the chapter though because I keep pondering so many questions. - How can life be possible with the concept of entropy? Cells must organize themselves in...
  14. R

    Is there an effective life time of the universe where it will reach max entropy?

    I have been having a discussion with a friend and I think we have reached the limit of our knowledge, so hopefully someone on here can help! Basically the question is if a photon is emitted it will travel forever providing it never hits anything. So let's say we are close to the edge of the...
  15. A

    Exploring the Possibility of Negative Changes in Entropy in the Universe

    Negative Changes in Entropy?? Perhaps this is not the right forum location, but I would like to ask some of the more experienced physicists here about the notion of negative changes in entropy in the universe. According to the text I am currently reviewing by Hill, the probability that a...
  16. A

    Plotting Fanno Flow Entropy Equation in T-s Plot

    Hi everybody, I have a problem with this equation: it represents the motion of a gas in a duct with friction (Fanno flow). I need to plot this function in a T-s plot, do you have any ideas? the Mach number changes along the curve... R=constant S2-S1=R*(M2-1)*log(T2/T1)$
  17. S

    Can plants/solar panels decrease entropy?

    If in theory there was a very efficient and powerfull refrigerator. Is it possible that a plant/solar panel could turn that heat into usuable energy, faster then what the frige uses up?
  18. S

    Contribution of one fermion to entropy of one-particle state

    Homework Statement Hello, I'm studying for my final exam on statistical physics, and I found an exercise of which I think it is really easy but I'm unsure of how to do it! So now I wonder if I actually don't understand what I'm doing at all! The question is as follows: Calculate for...
  19. K

    Entropy and Heat Capacity have the same units. Connection? Redundancy?

    Given that heat capacity is a ratio of change of energy over change of temperature, while entropy is a change of energy over absolute temperature... I was wondering if there is any basis for the idea that energy will tend to flow from media having low heat capacity to media having high heat...
  20. Physics Monkey

    Truncating probabilities based on entropy

    Roughly speaking, I want to know how badly Shannon can fail in the one-shot setting. The standard ideas of asymptotic information theory give a precise meaning to the entropy of a given probability distribution in terms of best achievable compression with vanishing error in the limit of many...
  21. C

    How to calculate entropy for a system

    How can you acuratley measure this? I can't see how you can give randomness a number? I've seen in some places that S = ln(the number of possible arangments) Is this true in all cases? But how can you measure the number of possible arangements?, it seems imposible to calculate the entropy for a...
  22. C

    What is entropy? on the most fundamental level.

    On the atomic level, what is entropy? how can I visualise it? Thanks
  23. C

    What has more entropy out of steam, water and ice?

    I'm trying to understand entropy, because I have no clue what it is. Iv seen questions like this posted in other places on the web, but there seems to be a disagreement over the answer. Some people say it is the randomness and chaos of a system, and other people say it is how close it is to...
  24. W

    Heat Capacity and Entropy Textbook Definition - Quick Question

    Just a quick question of something I found in my textbook but can't get how they produced it. C_p =(∂Q/∂T)_p that is the definition of heat capacity at a constant pressure p. Q is heat and T is temperature. This equation is fine and I know how to derive it. Now it is the next line which...
  25. A

    Entropy Reversal: Proven by Physics and Science

    I would like to make a stand regarding the topic of entropy reversal. Entropy CAN in fact be reduced in a closed system, and this happens spontaneously according to the fluctuation theorem. Its been published in a well known scientific journal over a decade ago, and beforehand has been...
  26. F

    Magnetic entropy vs. magnetic field

    I measured the heat capacity of a sample under various magnetic fields. When I calculated the magnetic entropy as a function of temperature, I found the magnetic entropy measured at 0.5 Tesla is higher than that measured at 0 T. As far as I know, the magnetic field will try to allign the...
  27. A

    Entropy calculations involving integration (physical chemistry)

    This isn't a homework question per se, but more of a coursework question. Specifically, I'm a bit at a loss as to how to go about learning a particular section of the coursework for a physical chemistry (i.e. thermochemistry) class I am taking. The section in question is that pertaining to...
  28. S

    Thermal equilibrium - Entropy driven

    Hey there. We are struggling with a problem from an old exam about statistical mechanics. I hope you can help us or give any clues. Here is the problem. Homework Statement A chamber is divided by a wall into two sections of equal volume. One section of the chamber is initially filled by an...
  29. K

    Entanglement, Entropy and Energy

    I suppose the meta-question is: Where do I read about this? Engineering major, not physics. Worked through Penrose's book until the tensor calculus on manifolds chapter and then sank without a trace. The popularized descriptions of quantum physics are hopelessly incomplete and as Feynman...
  30. J

    Entropy and the Second Law of Thermodynamics

    I'm having trouble understanding well what exactly is entropy. I know it involves an irreversible process in a closed system, but for some reason I just can't grasp well the concept. About the second Law, it involves entropy heavily so I am sure I won't understand it without understanding...
  31. O

    [Thermodynamics] Calculate change in entropy of closed reversible system

    Homework Statement Mercury is a silvery liquid at room temperature. The freezing point is -38.9 degrees celcius at atmospheric pressure and the enthalpy change when the mercury metls is 2.29 kJ/mol. Wat is the entropy change of the mercury if 50.0 g of mercury freezes at these conditions? The...
  32. S

    What rules, energy or entropy?

    what rules, energy or entropy?? any physical system goes to a state of maximum entropy or minimum energy, they don`t imply each other, by my understanding 1>third law s->0 as e->0 2>system tends to be in a state of least energy how??
  33. M

    Dark energy from logarithmic corrections to cosmological horizon entropy?

    We currently have a thread about logarithmic corrections to the basic black hole entropy formula. I was thinking about attempts to relate the magnitude of dark energy to the area of the cosmological horizon, and about the various analogies made between the cosmological horizon and the horizons...
  34. M

    Logarithmic corrections to black hole entropy, especially for the standard model

    Ashoke Sen has written a paper http://arxiv.org/abs/1205.0971 which uses path integrals in Euclidean gravity to compute "Logarithmic Corrections to Schwarzschild and Other Non-extremal Black Hole Entropy in Different Dimensions". Sen starts by listing several varieties of extremal black...
  35. R

    Entropy and Disorder (Crystallization)

    To show that entropy is not the same thing as disorder (what people intuitively accept as disorder) my textbook gives an example of crystallization in a supersaturated solution. And it argues that since both temprature and disorder decrease the entropy must decrease also, but it does not. Hence...
  36. P

    How does DNA maintain order over time?

    It seems that dna is constantly taking on damage - entropy. Why doesn't this damage accumulate over time? It appears that the amount of genetic damage that should accumulate would significantly outweigh the amount of ordering produced from the basic mechanisms of evolution. How is DNA ordering...
  37. I

    Understanding Entropy: Calculations and Examples for Beginners

    Hi guys! I'm new to the forum and had several questions about entropy. I am a bit of a physics newbie by a lot of standards but I understand a lot of it and love physics. I can understand the basics of entropy that it is (correct me if I'm wrong) basically just disorder, that it is always...
  38. G

    How Does Heat Transfer Between Two Reservoirs Affect Universal Entropy?

    Homework Statement Two large reservoirs, H and C, are available: if H is at 900 K and C is at 300 K, what is the entropy change of the Universe if 100 J of heat are taken from H and added to C? Homework Equations ΔS=∫dQ/T ΔS_universe = ΔS_surroundings + ΔS_system The Attempt at a...
  39. R

    Entropy of Blackbody Radiation

    Homework Statement The following is from a book: "Terrestrial radiation, T=255 K. Emitted flux ≈ 240 W m-2. Energy density for cavity radiation ≈ 3x10-6 J m-3. Entropy for cavity radiation ≈ 1.7x10-8 J K-1 m-3." I can't understand how they have calculated the Entropy.The Attempt at a...
  40. matt_crouch

    Calculate the Change in entropy of the universe

    Homework Statement Calculate the changes in the entropy of the universe for a) A copper block of mass 0.5kg is dropped into a lake of 10 degrees with the block having a thermal capicity of 2J/K and a temperature of 100 degrees Homework Equations dS=dQ/T The Attempt at a...
  41. 7

    Temperature Change in Partitioned Tank with Ideal Gas Upon Removal of Partition

    Hi all, Sorry if this is posted in the wrong place, I'm new here. I have a thermodynamics question. Why is the temperature change 0 in the case of a partitioned tank containing an ideal gas when the partition is removed? This seems to run counter to the idea of an aerosol spray can...
  42. I

    Entropy of the river due to coal heating

    Gamma (Cp/Cv) of a gas Homework Statement An experimenter adds 980 J of heat to 1.75 mols of an ideal gas to heat it from 10.0 C to 25.0 C at constant pressure. The gas does 234 J of work during the expansion. Calculate gamma (Cp/Cv) for the gas. Homework Equations Cv=Cp-nR Gamma...
  43. marcus

    Bianchi's entropy result-what to ask, what to learn from it

    Bianchi's entropy result--what to ask, what to learn from it I think most if not all here are familiar with the idea that entropy, by definition, is not an absolute but depends on the observer. (Padmanabhan loves to make that point. :-D) There may also be an explicit scale-dependence. And in...
  44. J

    How Does Melting Ice Affect Global Entropy?

    Homework Statement A 4.50 kg block of ice at 0 C falls into the ocean and melts. The average temperature of the ocean is 3.50 C, including all the deep water. By how much does the melting of this ice change the entropy of the world? Homework Equations Not sure if I should be using any...
  45. N

    Exploring Entropy Production in Chemical Processes

    Hello, So presume we have a system in which a chemical process A + B -> X + Y is happening. We allow it to be a non-equilibrium process (so there will be an entropy production inside the system) but for ease we presume the system is characterized by the usual variables E, V, N_A, ..., N_Y...
  46. C

    Thermochemistry:Gibbs' Free Energy and Entropy

    Homework Statement a) 3 moles of carbon dioxide gas expands reversibly in a piston-container from 20 L to 40 L in an isothermal process at 400 K. Calculate work, heat, change in internal energy and change in enthalpy, considering van der Waals behaviour. [a = 3.59 atm L^2 mol^-2 and b = 0.0427...
  47. A

    Change in entropy as gas expands?

    Homework Statement http://img846.imageshack.us/img846/5678/problemem.jpg Homework Equations Pv= nRT U = Q-W dS = dQ/T (entropy transferred) + σ (entropy created) The Attempt at a Solution Part A. Assuming that as the gas expands Volume increases and Pressure decreases, thus the...
  48. P

    Thermodynamics help with entropy

    Homework Statement Is it possible for an adiabatic liquid-vapor separator to separate wet steam at 100 psia, 90 % quality into a saturated liquid stream and a saturated vapor stream both at a pressure greater than 100 psia? Ans: (no according to the increase in entropy principle) I need to...
  49. H

    Probabilistic violation of entropy by radiation

    Consider a solid body at some constant temperature. Heat is transported by conduction and radiation. The radiative component transports heat by the d-d electronic transitions which emit photons and they are absorbed by molecules somewhere else in the body. I presume that the direction of...
  50. N

    Unraveling the Mystery of Entropy Production

    Hello, So one presumes that J_i = \sum_j L_{ij} X_j where J_i is the current for a certain variable x_i and X_j are the different kind of thermodynamical "forces". In the case of heat conduction, the "force" is temperature difference \nabla T and the current J_i is a current of heat (Fourier's...
Back
Top