For the optics portion, Hecht's Optics should contain material at an adequate level. Other books at a similar level include Pedrotti[tex]$^3$[/tex]'s Introduction to Optics, and Fowles's Introduction to Modern Optics. (Fowles might be a bit thin to use as your sole reference, but it's cheap, so it's worth picking up to supplement either Hecht or Pedrotti.) At a slightly more difficult level is Saleh & Teich's Fundamentals of Photonics, and at a much more difficult level is Born & Wolf's classic tome, Principles of Optics. (Born & Wolf is pretty much the standard reference for researchers in the field.)