You can learn GR at many different mathematical levels. The following books use little or no math:
Geroch, "General Relativity from A to B"
Gardner, "Relativity Simply Explained"
Einstein, "Relativity: The Special and General Theory ," http://etext.virginia.edu/toc/modeng/public/EinRela.html
These books use nothing beyond freshman calculus:
Taylor and Wheeler, "Exploring Black Holes: Introduction to General Relativity"
Hartle, "Gravity: An Introduction to Einstein's General Relativity"
So to answer your question, we'd really need to know something about your goals. At what level do you want to understand GR? If your goal is to dive into a graduate text, then we could discuss that.
Also, what is your background in physics? This is much more likely to lead to problems than a lack of mathematical background.