Pursuing a PhD in theoretical physics with a limited mathematics background can be challenging but is possible with the right preparation. It's recommended to strengthen math skills by taking additional courses, particularly in areas like Math for Physicists, complex variables, linear algebra, and differential equations, including partial differential equations (PDEs). Completing a master's degree with advanced math courses before applying to a PhD program is advisable, as many physics programs require strong math proficiency and may have specific admission tests. Geometry is also highlighted as an important area for graduate study, although some students may struggle with it. Overall, enhancing mathematical knowledge is crucial for success in theoretical physics.