You have to modify electromagnetism somehow to get an infinite speed of light. The answer can depend on how you do that. I guess most natural ways to do it would still keep a capacitance, all you need to keep is some attraction between opposite charges.