I think you are visualising the event as being a bit like a bullet hitting a wall. That would tend to throw shards of wall off in the direction that the bullet might 'bounce off' (i.e. laws of reflection). I don't think that the photoelectric effect is quite so mechanical. afaik, the photon arrives and adds its energy to the total energy around the surface. One (lucky) electron which happens to be near the surface and already, perhaps, 'travelling outwards', can have its kinetic energy increased enough to escape with some extra KE. It is hardly like a coconut shy because the ball (photon) has no well defined size and many electrons (coconuts) occupy one wavelength of the incident light.
I guess someone must have done photo electric experiments and looked at the angular distribution of photoelectrons. The result would be interesting but i would predict that there would be a maximum intensity normal to the surface, rather than at the 'reflected angle'. (Momentum conservation is not violated as long as one considers the whole mass of metal as the target and not the individual photoelectron.)