For me it is a big no. If you can get your hands on Wu Ki Tung's book, it is all you need for group theory in physics without invoking sofisticated mathematics. It takes you from 0 to Young Tableaux for the classical groups, which are a foundation for Quantum Chromodynamics and Electroweak Theory in the Standard Model. It goes through the Lorentz group smoothly, without trying to attempt finesse which Zee misses (real vs complex, real vs complexified vs real forms of complexified Lie algebras).
As for GR, I only recommend two books: Ray D'Inverno's (first level) and Wald's (second and third level). If the latter is too expensive as a used book, then perhaps Norbert Straumann's text should serve the same spot, if found at a decent price.