It depends on how much you are prepared to work and what your educational background is. So called popular science books, of which Stephen King is the finest example, may get you excited and teach you a few terminologies and pretty diagrams, but they won't tell you anything about physics. All you'll get from reading these a sense of satisfaction, with nothing substantial behind it.
If you really want to know physics, then you have to learn the math. Just like there's no royal road to geometry, there's no non-mathematical way to physics.
RP Feynman's Lectures in Physics is a highly recommended book, though I personally found it very difficult to understand. If you didn't have math in high-school then you will have to learn essential concepts like algebra, analytical geometry and most importantly, calculus. You must know your calculus back-to-front, and also have some ideas of abstract algebra, topology, complex analysis. Roger Penrose's Road to Reality may be helpful as a crash course on required topics.
Now that you have the math under your belt, it's time for the unfortunate truth: the only way to learn physics is using good textbooks. If you didn't have physics in high-school, then start with Halliday and Resnick's Physics (not Fundamentals of Physics) and HC Verma's Concepts of Physics. Try to do the problems, at least some of them. If you truly love physics, then doing good problems should get your pulse racing.
After you have covered the basics, move onto more specialised stuff:-
1)Kleppner and Kolenkow-Intro to Mechanics
2)Griffiths-Intro to Electrodynamics
3)Thermodynamics and Statistical Mechanics
4)Fluid Mechanics
5)Griffiths-Intro to Quantum Mechanics
6)Theory of Relativity
If you are really serious, you may consider pursuing studies to the postgraduate level:-
1)Shankar-Quantum Mechanics
2)Jackson-Electrodynamics
3)Goldstein-Classical Mechanics
4)Statistical Mechanics
5)Landau et al.-Course in Theoretical Physics
If you really cover all this material without enrolling in a university, then you are a genius and I wouldn't be surprised if your name starts appearing in journals.