Quantum fields are simply operators, really no different than a Hamiltonian. The whole idea of creation and destruction operators goes way back to Heisenberg's matrix mechanics, particularly applied to the oscillator. To see that the standard "a" operators do what is claimed for them requires a modest amount of work -- finding the eigenstates of the number operator, among other things.
All of this is very basic to QM, and, fortunately, is discussed in many, many books and Googles. Landau and Lifschitz, Cohen-Tannoudji, Zee, Gross, Weinberg, ... all write about your issue. So, read.
Regards,
Reilly Atkinson