I'm going to say something that might offend a few of my colleagues who happen to work on the mathematical side of QFT, but in general the way things work out is the following:
The more rigorous you get when dealing with this subject, the further from physical reality you go. Worse, the more rigorous you get, the more time you will spend trying to understand it (and believe me, it is not simple).
Just about every physicist I know has had the exact same problem you are experiencing sometime in grad school. In my case, I wasted about a month of my life pouring through the mathematical side with identically zero results and I managed only to confuse myself and to ask increasingly abstract questions that seem to have no end, and further stretched my mathematics acumen beyond my existing grad level competency. Rigor mortis if you will.
Learning the standard way (see Coleman lectures above) is about two orders of magnitude easier, further reaching and possibly indicative of more mathematical structure than simply fiddling around with modifying Wightman or Haag-Ruelle axioms in order to create a single four dimensional field theory that actually reproduces something that we know is true since the 50s.
The bottomline is that the mathematics themselves are unknown, extremely sophisticated/hard as well as having plausibility problems, indeed many of the socalled texts and papers on rigorous qft are conceivably in the wrong direction altogether. I'm not saying that this is a dead end, one day the mathematics will be ironed out (it has too), but we are objectively far from that point. What we do know, is that the physicist treatment is at least approximately correct, and as such is pretty much required material for everyone.
I recommend Weinberg volume 1 for a very logical presentation of the material (be warned it is harder than most qft texts precisely b/c of this fact). If that still does not satisfy you, well seek out Streeter-Wightman, but do keep in mind that material is sort of a siren call and merely a first pedestrian step into a tunnel that is quite dark.
Your best bet is to decide what exactly is confusing you about the physics treatment, and then ask questions.