Depends on how familiar you are with certain kinds of math :)
We didn't use Griffiths, but I've looked into it a couple of times and it didn't look too heavy on the math. Hilbert spaces are important in QM, but I'm pretty sure Griffiths won't expect you to know it already.
Things you definitely need to control are Fourier transforms and solving differential equations by separation of variables, but that doesn't seem like a whole lot. Take a look at the appendices: Fourier transforms will undoubedly be covered there, and as for solving differential equations by separation: well the name already pretty much says what there is to say, assuming you've seen it in a course before.
My feeling is that you can dive right in.
As for Ryden, no idea, unfamiliar with it.