This question is actually of significant historical importance, but in the context of Newton's gravity, rather than Maxwell's equations. The basic issue for static electric fields is of course the same.
Newton assumed the universe should be infinite and homogeneous, and he came to the same resolution as NFuller, that the gravitational field should be zero by symmetry arguments-- if it doesn't know how to point, it must be zero. He regarded that as a deeper principle than the equations he was solving, so although the issues about the problems with applying symmetry arguments to Gauss' law that have been raised are entirely valid, Newton, who knew the necessary version of Gauss' law (i.e. that a spherically symmetric mass distribution had to produce a field toward the origin that depended only on the enclosed charge), felt the symmetry argument supercedes the mathematics of forming a proper solution. Perhaps it could be said he felt the boundary condition must be whatever is necessary to produce a zero field, because a field that doesn't know which way to point must be zero. The point is, Newton felt his gravity was consistent with a static universe, and this mistake caused him to miss that the universe should be dynamical.
Of course general relativity reaches a different conclusion about an infinite homogeneous mass distribution, but that's a different theory, so it's easy to overlook that Newton could also have realized the universe should be dynamical. I have always felt that Newton was basically wrong, in the sense that even if Newton's own theory of gravity were applicable, the gravitational field should not be taken to be zero, and the universe could not be static. I think the problem is in the implicit assumption that the field must be a "thing," handed to us without our input or participation, so must be unique. But this is never actually required in empirical sciences-- we only need the observations to come out as predicted, including whatever input or participation we need to supply. The observation is that a homogeneous mass distribution that is bounded and stationary undergoes contraction, and the timescale for density increase is given by 1/sqrt(rho*G). A similar expression would hold for the expansion of a homogeneous charge distribution with fixed charge-to-mass ratio. Notice this timescale depends on the local density, so the global scale is irrelevant and should exhibit no problems even when extended to infinity. The contraction/expansion timescale is what must be unique, not the fields, because observing fields requires a somewhat arbitrary calibration procedure, which may need to dovetail with the frame of reference or perspective of the observer.
So I think the physical problem here is in the implicit assumption that the field must be unique. It seems odd that the field you calculate could depend on where you set the origin, but that's not odd if the behavior you are trying to understand (contraction or expansion toward or away from some origin) also depends on where you set the origin-- the timescale for the contraction or expansion does not depend on where you set the origin. Also, the OP was bothered by the increasing magnitude of the field as you go away from the origin, but this can depend on the calibration procedure you use to measure fields, and there is no rule that says the field cannot depend on the calibration, nor that it cannot grow without limit if that's how you choose to calibrate it. All that has to be satisfied in an empirical science is that once you choose your origin (i.e., local reference frame), and once you have a self-consistent procedure for obtaining correct results to all your measurements from that perspective, then all observers must get the results they predicted, even if those results depend on the procedure used.
In short, I feel we should never have assumed the field must be unique, as that assumption is more than we get to assume when using empirical science. I agree with Newton that the physical outcome should always trump the formal mathematical issues, but I would add that a physical outcome is a description by an observer using a given procedure, and is not in and of itself something that needs to be unique. This is very much the perspective of relativity, so I feel that relativity has already solved the issue even without replacing Newton's gravity with Einstein's, which is reasonable because the solution can hold even at times when the speeds are much less than the speed of light. Hence I'm saying not only that I agree the solution is allowed to depend on implicit boundary conditions, but also that different boundary conditions are allowed within the same physical problem, if they dovetail with different procedures by different observers. Relativity basically says that it is only necessary that the observers be right, not that they agree!