In the end, I think some amount of argument concerning symmetry has to be invoked. If the magnetic field is really a plane field and not a vector field, the object that it is a part of has to be at least a plane as well. The Faraday field is what results through a simple analogy of the field being a derivative of a potential. There is some amount of, yes, by magic it works. Trying to build up to 3+1D from 3D is, well, hard. Trying to go the other way is much easier--and, in my opinion, much cleaner from a conceptual standpoint, though it does have drawbacks.
Were I to teach EM, I might be tempted to start with the Faraday field and SR and show that the E and B fields in 3D come about from looking at particular components that are of relevant interest to 4-currents with various properties.