Hermite polynomials are essential in physics, particularly as solutions to the one-dimensional quantum-mechanical harmonic oscillator. They can be defined in various ways, but physicists typically use a specific definition that may initially seem non-polynomial due to its exponential components. For further understanding, resources like Arfken's mathematical methods book, as well as texts by Boas and Riley, provide valuable insights. In-depth treatments can be found in Lebedev's "Special Functions and Their Applications," which also covers other important mathematical functions used in physics. To effectively solve physics problems, starting with a foundational physics course or textbook is recommended.