"Div, Grad, Curl and all that" by H.M. Schey is an awesome informal text on vector calculus. I'm using it right now for self study, and it's really good.
Also, you may want to look into "Optics" by Eugene Hecht. I think this book may be at a lower level then what you are interested in, but...