K&K is a good book. If you want the full benefit of all the little insightful nuggets a working knowledge of a typical calculus 1&2 series (Taylor series) will be satisfactory. Less is certainly doable though. That said, I wouldn't advocate it to someone who's never seen physics at all before or has difficulty applying math to physical problems. In that case, online resources are probably the best place to start self-study. A R&H&C 4th edition can also be had for like 20 bucks, and is another good place to start, if you prefer paper format and don't want to print online texts. This is all assuming you've never seen physics before.
Purcell is also a good book, and like jtbell mentions requires some study in vector calculus to glean the most from it.
Another good thing is the price point, both texts are cheapish compared to new editions of other physics textbooks.
If you want to study calculus as well concurrently, Anton has a decent book, which can be had for about 5 dollars on amazon. Some people don't like, but it's a good everyman's book in my opinion. (Edit, never mind, looked it up on amazon and it's now about 30 dollars for a used copy. Which is surprising, not sure why it went up.)