Individual photons have "helicity", which translates into circular polarization. So 'rotating' the photon will not change the polarization state.
Going over to the macroscopic description of polarization, with arbitrary polarization states, means that the light is now composed of a population of partially (mutually) coherent photons. Pure polarized light is completely coherent, randomly polarized light is incoherent. Descriptions of polarizers and retarders using photons is statistical in nature.
The polarization of light corresponds to spin, certain specially-prepared fields (Bessel beams, etc) of radiation possesses a property corresponding to angular momentum.