In QM, vector potential is physical, but not observable. In that sense, it is not unlike wave functions. In fact, in QED, it is essentially one of the wave functions.
Of course, the problem with non-observable quantities in QM is that you cannot tell if these are true physical quantities, or merely convenient mathematical representations for something else. So this doesn't mean that vector potential is "real". Merely that there is a real physical object that it represents.