I'm not sure if this helps, but rather than thinking of a field (such as the electromagnetic field) as being created by the exchange of the corresponding particles (photons), it's better to think of it as the photons as reflecting perturbations, or changes, in the field. The field exists in the absence of any photons, and a static field (such as the field of a charged point mass at rest) doesn't involve photons at all. (Virtual photons might be used in calculations, but they shouldn't be taken seriously as a physically meaningful description of what's going on.)
The following is completely non-rigorous, but I hope it's not blatantly wrong. (Somebody will correct it if it is.)
If you have a large object such as a star that has a nonzero charge, the electric field can be described in terms of "moments". Far away from the star, it will look approximately like a point-charge. It will have a field that is approximately of magnitude \frac{Q}{r^2}, where Q is the total charge, and r is the distance to the center of the star. That's called the "monopole moment". But since a star is not completely spherically symmetric, there will be "corrections" that will have magnitude proportional to 1/r^4, 1/r^6 etc. Those corrections are due to the dipole moment, the quadrupole moment, etc. Stuff going on inside the star (matter moving around) will have no effect on the total charge, so that part of the star's electric field is static (at least in a frame in which the star is at rest). But the "corrections" will be time-dependent. Those time-dependent corrections are propagated by electromagnetic waves.
If the star collapses into a black hole, there can be no propagation of information from inside the star to distant locations. So the "corrections" disappear. The star will look like a perfect sphere, with an electric field exactly \frac{Q}{r^2} in magnitude.