For all you theoretical physicists out there. I have got all the undergraduate math stuff down (group theory, point set topology, PDEs, introduction to mathematical analysis, linear algebra, classical differential geometry etc.), but now going further in my physics education I am approaching QFT and other highly mathematical fields, and it feels just so overwhelming having to learn all that manifold theory, diff. forms, algebraic topology, Lie theory, functionalanalysis. I really like math and all but the subjects seems so huge and abstract. It feels like I am never getting to the physics. So I was wondering, do I really have to plough through all those huge graduate level books before I go into the (theoretical) physics? Or is it possible to pick up math while studying the physics?