Mathscienceknowledge said:
My experience in mathematics is calculus and I am currently self-studying multivariable calculus. I also have some experience in differential equations.
So the standard astrophysics textbook at the upper-undergraduate level is
An Introduction to Modern Astrophysics by Carroll.
https://www.amazon.com/dp/1108422160/?tag=pfamazon01-20
At a slightly lower level, I recommend
Essential Astrophysics by Kenneth Lang. It still uses some calculus, but it's not quite as comprehensive as Carroll.
https://www.amazon.com/dp/3642359620/?tag=pfamazon01-20
Another textbook I've heard good things about is
Astrophysics for Physicists by Choudhuri. From what I understand, however, is it requires a good understanding of undergraduate physics. Perhaps use this one as a follow up to Carroll.
https://www.amazon.com/dp/0521815533/?tag=pfamazon01-20
Eventually, you will have to study some higher-level physics as well; astrophysics is, after all, a branch of physics. Classical mechanics, thermal/statistical physics, special relativity, electrodynamics, and quantum mechanics are all heavily used in astrophysics and astronomy. If you want to self-study the subject at the graduate level, then you're also going to have to learn general relativity and nuclear/particle physics.
Edit: While the book that vanhees71 linked is good, you might find it to be too easy, especially if you're already familiar with basic astronomy. It is aimed at students who don't have much of a background in physics or calculus.