In Conclusion ...
alexepascual said:
... Changing the subject, I remember reading (I don't know where) about a "rigged Hilbert space" which would include the eigenvectors of continuous variables.
All I know about it is just what you say, that a "rigged" Hilbert space includes those kinds of objects among its elements. (I must add, however, that from the little I have seen, it looks to me like the rigged Hilbert space has structure which is much
richer than what is necessary for the mere inclusion of those kets.)
On the other hand, in order to understand this business of "generalized" eigenvectors, we don't need to know much more than we already do.
alexepascual said:
These kets of definite position and definite momentum don't seem to comply with one or more of the expected mathematical properties of Hilbert space.
One of the features which defines a Hilbert space is that it has an "inner product". That's the bracket <f|g>. By definition, this bracket is supposed to map any pair of vectors |f>, |g> to some complex number. This implies, in particular, that for any vector |f>, <f|f> has to be a number - that is, finite. So, if we have an object |h> such that <h|h> is
infinite, then by definition |h> is
not a member of the Hilbert space.
And basically, that's all there is to it.
So, for example, for the eigenket |x> we get
<x|x> = Dirac_delta(0) = infinity .
Alternatively, consider |p> in position-representation:
<x|p> = h
-1/2e
ikx .
Thus,
|<x|p>|
2 = 1/h .
To obtain <p|p> we now need to integrate this constant 1/h over the whole real line. Once again, the result is divergent. … In conclusion, these eigenkets, and others like them, are not "vectors belonging to H". They are called "generalized" eigenvectors.
(Something of the spirit of what is "really" going on has been lost in the above simplification so as to make it appear to be an entirely trivial matter. Sorry about that.)
-------------------
I don't know much about the historical aspects of how the idea of Dirac's delta function was received by his contemporaries. But today, that object is understood to be well-defined, along with many other "generalized" functions, all put on a thoroughly rigorous foundation in a branch of mathematics called "The Theory of Distributions" or "Distribution Theory".
-------------------
Regarding the original topic of this thread, here is the answer I propose:
For an ordinary vector |phi>, the outer product |phi><phi| is a (dimensionless) projection operator, whereas, for a generalized eigenvector |s>, of an operator with a continuous spectrum, labeled by the eigenvalues s, the outer product |s><s| is a projection-operator
density. It is a
density with respect to the parameter s, and, therefore, has dimensions
-1. In this way psi(s) = <s|psi> gets the dimensions -1/2 which it needs, in order for |psi(s)|2 to have the interpretation of a probability density with respect to the parameter s ... all in a perfectly natural, self-consistent way which is true to the physical and mathematical meaning of the objects involved.