Ben Niehoff said:
Defining a limit on a space of paths requires you to define a topology on the space of paths. This is what topology is all about.
I think there are perfectly sensible topologies on the space of paths in which a null path is the limit of a sequence of timelike paths. Or spacelike paths, for that matter. These topologies, like the underlying manifold topology, are not induced from the pseudo-Riemannian metric.
However, as you point out, the proper time along the path will approach zero as the path approaches the limit. Therefore proper time is not a good parameter along null paths (which we already knew).
Something that I realized that I don't know how to do is calculus of variations in the case where the derivative of the Lagrangian is undefined.
If we are looking for a parametrized path [itex]P(s)[/itex] that extremizes the proper time, then we can cast this as a Lagrangian dynamics problem:
[itex]A = \int{L ds}[/itex]
where the action [itex]A[/itex] is interpreted as the proper time [itex]\tau[/itex], and the lagrangian [itex]L[/itex] is interpreted as the expression [itex]\sqrt{g_{\mu \nu} \dfrac{dx^{\mu}}{ds} \dfrac{dx^{\nu}}{ds}}[/itex]
Using the Euler-Lagrange equations of motion gives for the extremizing path:
[itex]\dfrac{d}{ds} \dfrac{\partial L}{\partial U^{\mu}} - \dfrac{\partial L}{\partial x^{\mu}} = 0[/itex]
where [itex]U^{\mu} = \dfrac{d x^{\mu}}{ds}[/itex]
For the particular choice of [itex]L = \sqrt{g_{\mu \nu} \dfrac{dx^{\mu}}{ds} \dfrac{dx^{\nu}}{ds}}[/itex], the equations of motion become:
[itex]\dfrac{\partial_{\lambda} g_{\mu \nu} U^{\lambda} U^{\nu}}{L} + \dfrac{g_{\mu \nu} \dfrac{dU^{\nu}}{ds}}{L}<br />
- \dfrac{g_{\mu \nu} U^{\nu} \dfrac{dL}{ds}}{L^{2}} - \dfrac{1}{2 L} \partial_{\mu} g_{\nu \lambda} U^{\nu} U^{\lambda} = 0[/itex]
If we multiply through by [itex]L[/itex], this becomes:
[itex]\partial_{\lambda} g_{\mu \nu} U^{\lambda} U^{\nu} + g_{\mu \nu} \dfrac{dU^{\nu}}{ds}<br />
- g_{\mu \nu} U^{\nu} \dfrac{d \ log (L)}{ds} - \dfrac{1}{2} \partial_{\mu} g_{\nu \lambda} U^{\nu} U^{\lambda} = 0[/itex]
Finally, if we assume an affine parametrization, so that [itex]L[/itex] is constant along the path, then this simplifies to:
[itex]\partial_{\lambda} g_{\mu \nu} U^{\lambda} U^{\nu} + g_{\mu \nu} \dfrac{dU^{\nu}}{ds}<br />
- \dfrac{1}{2} \partial_{\mu} g_{\nu \lambda} U^{\nu} U^{\lambda} = 0[/itex]
which is equivalent to the usual geodesic equation. The problem, mathematically, is that the manipulations only make sense if [itex]L[/itex] is nonzero. If [itex]L[/itex] is zero, then all the equations (with [itex]L[/itex] in the denominator) are undefined.
For this reason, it seems to me that one needs to assume during the derivation that [itex]L[/itex] is small, but nonzero. So I don't see how you can actually get a null geodesic this way, except possibly as a limiting case.