Jano L. said:
Instead of 'information', we can use better expression 'physical state'. Then we can talk about state not related to any specific observer, such as number of electrons in an atom. It is common to think this state exists with no dependence upon measurement.
This makes the idea of "state" non-operational which makes it worse, not better. There are two things we can do with information (which we can encode in a physical system) we can read the "signal" (by measuring system observables) or we can "throw it away" by dynamically transmitting the information into an entropy dump...
Dmitry67 said:
...
But can we think about information without having any measurements? ...
No... and yes. The information is only meaningful as information if it is physically encodable in a physically measurable way. But no we needn't actually measure the information's carrier system to say the information is there...
For example, the definition of Bekenstein bound is not based on any measurements (and in case of Black holes, such measurements are not even possible). Or are there any hidden assumptions?
One can in principle measure the information content of a black hole in the form of the random noise as it evaporates, or in the black hole's state before and after the information has been dropped in. Consider encoding a signal in an electron, say using its momentum up to some resolution and its spin. Now take a black hole and place it in the electron's path, and measure the momentum and spin of the black hole before and after the consumption. The difference gives you back the information encoded in the electron. In a more sophisticated case, let a "perfect" black hole absorb an electron encoding a signal. The change in the BH is not just a matter of increasing mass. It will no longer be a perfect sphere but will have various minute deviations in its higher moments. These of course will dissipate as gravity waves over time but the information is still there, either in the surface configuration or in the configuration of gravity waves spreading outward at the speed of light.
It is no different from "destroying" the information in any thermodynamic way. You are mixing the existing information in a random way with the environment. You mix with incoming light signals coming from outside one's earlier past light-cone so its is information you did not have prior access to and also you are sending information outward at the speed of light (say from a candle's flame) so that it is forever beyond your future light-cone and you can't catch up to it and measure it.
The event-horizon of a BH is no different than that of a light-cone in that the information crosses and someone can potentially measure it but you can never get to it again.
Can we talk about 'pure' information, not related to any specific observer? Observer can't learn that information without measurement, but doesn't that information exist before the measurement?
We can talk about the information carrying capacity of a physical system without it having been encoded with known information. This is exactly what entropy is. I'm not sure what you mean by "pure" information though. At the quantum level ALL information is relative to the choice of commuting observables one utilizes to encode it. If I encode in X and you observe in P then by definition you have destroyed my encoded info and I have a priori randomized yours. But we will find that the system as a whole (when we've been careful to isolate it so we both agree which system we're talking about) encodes a specific amount of information we can describe as its maximum possible entropy. But note that isn't just say "an electron" we must in defining our system either limit ourselves to "the spin of the electron" or specify enough environment to say what position or momentum means. If say we're talking "an electron in a box" then it is the box, not which of us is looking at the electron which bounds the amount of encodable information. It is likewise the motion of the box not our motions which defines the amount of information as seen by different inertial observers.
I know I'm hitting on different points here in a bit of an uncorrelated way. Let me make one or two more...
One entangles two particles by encoding information into their correlation (a set of observables for the composite system) rather than encoding the information in the pair as two separate systems. If I then toss one of them into a black hole the I cannot recover that information EVER unless I choose to take the other particle and dive into the BH after the first.
Likewise and more completely, I can send the two particles (say they're photons) traveling outward in opposite directions at speed c and then it is forever impossible to, after the fact, recover that information. Take the BH case, the particle not tossed into the BH is now, for us outside, in a fundamentally randomized "state". We can say absolutely nothing significant about what we will see if we measure it. The particle's entropy is fundamentally non-zero.
Turn this around. A composite system of two particles can have zero total entropy, you make a sharp measurement of the whole. If that measurement is an entangling measurement then the entropy of each component of the whole has a non-zero entropy. One could view the entropy of any system, viewed as a part of a bigger whole, as a measure of its entanglement with the environment. One could then (on less solid physical footing) speculate that the entropy of the Universe as a whole (including interiors of BH event horizons) is exactly zero. We just see non-zero entropy in systems because we are only looking at a part of the Universe, in fact only have access to part of the universe.
Anyway these are some observations I've made over the years as I've contemplated the subject.