I think @Baluncore has nailed it. When breaking a board, you need to deliver enough energy to exceed its tensile strength limit and create a crack that spreads rapidly.
In 1979, there was an article in Scientific American: The Physics of Karate by Feld, McNair, and Wilk. You might find it...