No, it's really the math of the Poincare group. In short the argument goes as follows: You start with the representation of space-time translations, which leads to eigenvectors of energy and momentum. Now you want irreducible representations (defining what's an elementary particle). This leads you to look for the Casimir operators of the Poincare group. With energy and momentum you can build ##p_{\mu} p^{\mu}=m^2##, where ##m## is the (invariant) mass of the particle.
Now since the representation is irreducible, you can use the energy-momentum states at fixed mass, and further you can define a standard momentum ##K## with ##K^2=m^2## and all other momentum eigenstates posssible must be reachable by application of the unitary operations on the eigenvectors of energy-momementum eigenvalues ##K##. All the basis vectors at fixed standard momentum ##K## must be reachable with POincare transformations either, because we have an irreducible representation. In other words these vectors build a representation of the subgroup which leave the standard momentum unchanged.
Now take the two physically relevant cases ##m^2>0## and ##m=0## (##m^2<0##, socalled tachyons have trouble, and as far as I know there are no sensible models with interacting tachyons known, let alone that no tachyon has been ever seen in experiment). For ##m>0##, you can choose the standard momentum ##K=(m,0,0,0)##. Then the subgroup of the Lorentz group which leaves this momentum invariant is the SO(3) acting on the spatial part of the momentum, and since ##\vec{K}=0##, these rotations all leave ##K## unchanged. Now you only need to find the irreps. of SO(3) (or its covering group SU(2)), which leads to particles with spin quantum number ##s \in \{0,1/2,1,3/2,\ldots \}##. Then the spin-##z## component (i.e., the angular momentum of a particle with a standard momentum, which here means it's the particle at rest) takes the ##2s+1## values ##\sigma_z \in \{-s,-s+1,\ldots,s-1,s \}##. E.g., a massive vector particle belongs to the representation with ##s=1## (by definition) and thus has three spin-degrees of freedom. Particle states with non-zero momentum can be defined by applying rotation free Lorentz boosts on the states with standard momentum (defining the socalled Wigner basis and with it the full unitary irrep of the Poincare group).
What's different for ##m=0## is that the standard momentum must be light-like. The usual choice is to use a particle running in ##z## direction, i.e., the standard momentum is taken as ##K=(k,0,0,k)##. Now the subgroup of the Lorentz group leaving this standard vector unchanged (the socalled "null rotations") turns out to be non-compact and equivalent to the group ISO(2) of the Euclidean plane. This group consists of translations (two degrees of freedom) and a rotation in the plane O(2). A generall irrep of this little group to the standard momentum ##K## will define an infinite dimensional Hilbert space (as in quantum theory of a particle in a plane the generators of the translations have the entire ##\mathbb{R}^2## as a spectrum), but here this implies that you'd have something like a particle with an infinite number of intrinsic quantum states like the spin of massive particles. Such a thing is also not known to exist in nature, and thus we restrict ourselves to representations, where the translations are represented trivially. Then you are only left with the O(2) rotations, i.e., in the physical space the rotations around the 3 axis. Since in the end you want to have representations of the entire Poincare group, including all rotations and boosts of the Lorentz group, the rotations around the 3-axis must also be represented by ##\exp(\pm \mathrm{i} \lambda \varphi)## with ##\lambda \in \{0,\pm1/2,\pm 1,\ldots \}##. Thus all massless particles have only two polarization degrees of freedom (or one if you have a scalar particle) (here we used the helicity ##\lambda##, i.e., the projection of the particles angular momentum to the direction of its momenum).
Now we want local quantum field theories, i.e., we like to work with field operators that transform like classical fields, e.g., for a vector field we want to have $$A'^{\mu}(x')={\Lambda^{\mu}}_{\nu} A^{\nu}(x),$$
where ##\Lambda## is an arbitrary proper orthochronous Lorentz transformation. This shows that for the massless case, in order to have the null rotations represented trivially, the ##A^{\mu}## must be defined modulo to gauge transformations, i.e., with ##A_{\mu}## also ##A_{\mu}+\partial_{\mu} \chi## with an arbitrary scalar field ##\chi## represents the very same field.
For details, see Appendix B of my lecture notes on QFT:
http://fias.uni-frankfurt.de/~hees/publ/kolkata.pdf