A fine point that concerns me a bit, so I'll give a quote from Wald, "General Relativity", pg 34.
The quick summary is to provide a reference and check on my statement that the parallel transport process depends only on the value of the connection coefficients along the curve, and to flesh out the process a bit.
We start by writing the parallel transport equations for a vector ##v^a(\tau)## along a curve with a tangent ##t^a##. We will further assume that the manifold is labelled with some coordinates, and an associated coordinate basis for vectors.
Wald said:
In terms of components in the coordinate basis, and the parameter ##\tau## along the curve
$$\frac{dv^\nu}{d\tau} + \sum_{\mu,\lambda}t^\mu \, \Gamma^\nu{}_{\mu\lambda} v^\gamma = 0$$
This shows that the parallel transport of ##v^a## depends only on the values of ##v^a## on the curve, so we may consider the prallel transport properties of a vector defined only along the curve as opposed to a vector fields.
The connection as represented in the coordinate basis are the Christoffel symbols denoted by the symbols ##\Gamma##. ##\Gamma^a{}_{bc}## maps two vectors to a number, but it doesn't transform as a tensor, so it's best considered as a map from two vectors to a number, said map defines the connection in the particular coordinates and coordinate basis chosen.
This snippet shows mathematically how to parallel transport a vector along a curve, though it's a bit terse. And it fleshes out how an "ant" can perform the process knowing the connection.
To turn this parallel transport equation for a vector ##v^a## along a curve ##t^a## into the equations for a geodeisc, we only needed to to equate ##t^a## and ##v^a##, as a geodesic parallel transports the tangent vector of a curve along the curve. This, for a geodesic, we have:
$$\frac{dv^\nu}{d\tau} + \sum_{\mu,\lambda}v^\mu \, \Gamma^\nu{}_{\mu\lambda} v^\gamma = 0$$
I have assumed that ##v^a## is a unit vector, though I suppose we're considering the case where ##v^a## doesn't necessarily have a length, so this assumption is probably not needed.
For a space or space-time of dimension n, this is just n linear differential equations in the components ##v^0, v^1, ...v^{n-1}##
For a flat space-time and cartesian coordinates, the Christoffel symbols are all zero, and you find that the components of the vector ##v^a## are constant.