You could if you have a good enough foundation in Multivariable and Vector calculus, but if it interferes with your DE course, I'd wait until the course is over.
If you plan on doing stuff with General Relativity, then I would wait until you've done some PDE's first and for that you need a solid background in DE's.
Maybe what you could do is first familiarize yourself with the tensor theory and get used to the notation and how the generalized co-ordinate system theory works before you look at differential geometry with the theorems and things like Gauss-Bonnet and curvature. You need to understand this before you touch the more formal stuff.
You should be able to do tensor theory with the Multivariable and Vector calculus background so if you are keen just get a good book on tensor theory: different people use it including mathematicians, physicists (and other scientists) as well as engineers so there are plenty of different perspectives that should suit you to choose from.