My intuition says that the extension of all rays will not meet at exactly the same point due to the chromatic aberration. Currently I don't have enough time to derive a formal algebraic proof, but I think you can follow the following reasoning.
Draw three rays and assume that all colors have the same refractive indices. Assume that the extension of the rays do meet at one point.
But in reality, the refractive index of materials always depends on the wavelength and since this dependency is arbitrary, you can change, e.g. the index for red ray only, to some other value causing the red ray to miss the intersection point with the other two rays. Therefore, generally there is no single intersection point for all rays.