That's an excellent diagram to base this discussion on. It is an example of Huygens construction, which is a classical approach to wave behaviour. It was never an attempt to describe what is actually going on, afaik. It was a way of looking at things in order to predict a result; that's certainly the way it is regarded these days, when it is used (and it often is). The way it works assumes that each of the sources of the spherical wavelets is coherent. This is what accounts for the constructive interference in the forward direction only.
And that's as far as it is useful, I'm afraid.
If you try to hop on board with a sort of quantum theme, it will actually show you where the idea is wrong because you cannot validly mix classical and quantum ideas in this way. As I have already said, for the model to work with absorption/emission of individual photons by electrons (which are the yellow dots in your diagram?), the re-emitted wavelets have to be all in step (coherent). If you take two different electrons and imagine them absorbing a photon and re-emitting it, they will each take a different amount of time over the process because the delay is random. Those neat little wavelets which, in the diagram have all originated in perfect order, will not be like that. There will no longer be a resultant coherent wave front but a set of random, short lived wave fronts, aiming in many different directions.
Has that convinced you?