I don't think that you would actually have to be invisible to people, just invisible to a photon, so you would have to eliminate the interactions that photons have with the matter in your body; not an easy feat but you would be invisible if you did that.
So there's you answer, but then how do...