Thank you. That makes sense now :)
I'm thinking that although it is the S component of the photon's J that has a value, because of spin-orbit interaction, it is only J that needs to be conserved and not the individual components S or L. Which is why it can be the electron's L that carries...