I had a summer job once in an electric motor rebuild shop. They baked out the windings in an oven. I don't know the oven temperature, but it would have been hotter than a typical kitchen oven. And it had a means of dealing with the smoke from the burned insulation.
Maybe use the self cleaning cycle of a self cleaning kitchen oven? Do it outside because of the smoke.
Armatures are often wound with a two layer insulation. The outer layer is a thermal-set epoxy or lacquer. There will be a temperature at which the glue is pyrolysed. That is usually between 150° C and 250° C.
You will probably need to remove the commutator before heating.