There's one electromagnetic field, and that's it. You have to always work with the complete field, if you change from one frame of reference through the other, and you have to use the Lorentz transformation of spacetime-fourvectors as well as the electromagnetic field components, which are the components of a 2nd rank antisymmetric tensor in Minkowski spacetime.
In the reference frame, where the magnet is moving you have both electric and magnetic components. The electric field acts on the electrons in the wire even when they are still at rest and thus a current can start to flow and then of course you need the complete Lorentz force including electric and magnetic field components.
In the reference frame where the magnet is at rest and the wire is moving, you have a pure magnetostatic field and the Lorentz force acts with the magnetic field acts on the electrons within the wire.
This is precisely the problem Einstein started his famous paper on special relativity in 1905. With SR all the apparent problems were finally completely understood, and no asymmetries in the description of the situation in either the moving-magnet or magnet-at-rest frame and a wire (or wire loop) occur anymore, as Einstein promised in the introduction to this paper.