jackle said:
Mike, does it help to point out that geometric shapes have an entropy if they consist of something physical? eg. A real life cube of ice has an entropy and I believe you can calculate the entropy from thermodynamics by considering it's constituent molecules. If the ice melts, it changes shape and state and has a different entropy (if I recall). A cube of frozen oxygen has a different entropy again.
Therefore, it is not proper to calculate an entropy without specifying the material that forms the shape. The same shape has a different entropy depending on what it is made of. If it is made of nothing, it has no entropy at all - otherwise conceptual shapes would interfere with reality and they don't. Furthermore, I find a probability distribution meaningless in quantum mechanics unless it represents the probability of measuring real matter. Real matter does have an entropy.
The entropy that we are accustomed to using is measuring states of discrete points - the configuration of point particles - at least in statistical mechanics. However, even there we describe things in geometrical terms such as the distants between particles and their rates of change.
But now we are starting to describe particles in terms of strings, and loops, and branes, etc, which are in and of themselves geometric objects. We are beginning to describe physical properties in terms of geometric dynamics, how shapes change, or vibrate, or combine, etc. Though summing up the phase and amplitude of quantum mechanical alternatives does make things more complicated.
Why should we think that there is some conservation of information/entropy at the heart of QM? There is no alternative to nothing except something. There is no alternative but that our universe exist. The probability of our universe existing as a whole is 100%, and that is true always, no matter how the universe evolves. And the information content of something with a probability of 1 is zero. So the universe has information content of zero and will always remain zero since there is always a probability of 1 that the universe as a whole exists. The universe always conserves information.
This means that information is conserved (at zero) even when the universe was so small that the first quantum mechanical situation arose. This means that conservation of information is intimately involved with QM itself.
So I look to see how this might occur. I see the path integral offering alternative paths. I see a wave function whose square gives probabilities. And the only way I see (so far) that the information derived from these possible alternatives is if there is some entropy associated each of the paths.
I don't know how that all works together to produce the path integral. But I ask everyone to keep an open mind as they study these things.
As for the intrinsic nature of the information contained in a single valued function y=f(x) which graphs as a line. If the line is normalized by dividing it by the average, then the entropy of the line can be calculated in the same way as a probability density function. That being the case, it is easily seen that the entropy is the same even if the curve is shifted on the x-axis. However, I'm not so sure the entropy remains the same when the curve is shifted up or down, even though you would still divide by the average. Your thought are welcome.