Newton's theory of gravity can explain planetary orbits, but demonstrating that they are elliptical is more complex than assuming circular orbits. The mechanics book by Kleppner and Kolenkow provides a solid derivation of these concepts. Orbits can also take parabolic or hyperbolic shapes if the escape velocity is sufficient. Using Lagrange's equations of motion can help identify allowed orbits, although it may require significant effort unless the solutions are already known. The discussion emphasizes that an object's trajectory involves both position and velocity, not just a static path.