Here's how I see it. Start with your favorite definition of inertia. Here are a couple:
1. inertia (în-ûr¹she), in physics, the resistance of a body to any alteration in its state of motion, i.e., the resistance of a body at rest to being set in motion or of a body in motion to any change of speed or of direction of motion. This is known as Newton's first law of motion. (http://www.neutron.anl.gov/hyper-physics/inertia.html )
2. The concept of inertia is today most commonly defined using Isaac Newton's First Law of Motion, which states: Every body perseveres in its state of being at rest or of moving uniformly straight ahead, except insofar as it is compelled to change its state by forces impressed. [Cohen & Whitman 1999 translation]
The description of inertia presented by Newton's law is still considered the standard for classical physics. (
http://en.wikipedia.org/wiki/Inertia)
N.B.: no mention of self-inductance anywhere! If we want to understand inertial effects of current flow in a wire, we'd better look at motion of individual electrons under a (really powerful) microscope.
Electrons in a copper wire at room temperature undergo a collision about every 4x10^(-14) sec [relaxation time], during which they lose all "memory" of their previous motion. There are about 10^23 electrons per cc, all moving randomly, so average motion is zero. An electric potential applied across the ends of the wire produces an axial electric field that accelerates each electron (for a short time!) following a collision. The average motion or net "drift" is what we call a current.
Change or remove the electric field and the electrons will
resist any alteration in their state of motion, i.e., ... any change of speed or of direction of motion according to Newton. That's inertia. But only for 4x10^(-14) seconds! Then the motions are randomized again and inertial effects are over. A changing magnetic field can influence the motion by generating an emf, thereby inducing electron flow, as Mr. Faraday discovered. You can say that it behaves like inertia because you can't tell the difference by looking at your oscilloscope and ammeter, but you're just doing an experiment that's too crude to see the differences. Inside the wire at the microscopic level the continuing current is being driven from outside. In fact whether the changing magnetic field is generated by the original current as in a solenoid or by an external electromagnet and power supply, it's still an external forcing function and not inertia. Inertial effects disappear in about 4x10^(-14) sec in copper at room temperature IMHO.