When a rocket accelerates (in any direction, not just in the direction of travel), its new path will share the following characteristics:
1) The new ellipse (or hyperbola) will intersect with the old one at the location where the acceleration was applied, so yes, the height at that location in the orbit will remain unchanged
2) The Earth (or body being orbited) will still be a focus, yes.
There's no requirement for the second focus to remain fixed though, and in general the second one will move (aside from a pure inclination change while at either periapse or apoapse)
If you're curious to play around with orbits, the game Kerbal Space Program is a really good way to get a feel for how orbits behave when you thrust in various directions, and how to maneuver in space. It does strictly two body mechanics (using patched conics with spheres of influence to handle travel between different bodies), but it's great for at least getting a feel for the basics, and it does so in a much more intuitive way than just looking at the math in my opinion.