In a book it is written
" there cannot be backward flow of energy during propagation of a wave..
and the resultant amplitude of all secondary wavelets at any point on a backward wavefront is zero.
The effects of secondary wavelets cancel out at all points except those lying on forward envelope...