We'll it's not completely wrong. He didn't state every function must have an *elementary* indefinite integral. In the form he stated, it's actually a theorem! For every continuous function f(x), there exists a function \int^x_a f(t) dt which is also continuous.
To the OP: If someone tried to solve it, they would never get anywhere, or perhaps they may be able to prove there is no solution at all, such as via the Risch Algorithm. The important thing to understand is that the set of functions which we choose to call "elementary" and happen to come up in our study often is COMPLETELY arbitrary. That's how they were chosen : Nice properties, easy to manipulate, came up in our study often. Does that make any of the other "non-elementary" functions somehow less of a useful function?
It turns out that many functions that have no "elementary" anti derivatives come up in mathematics and physics quite a lot, such as the Gamma Function, the Error function and the Exponential Integral. Nothing has stopped mathematicians and physicists from just *defining* these integrals as some new function with some name they gave it, and studying its properties from there.
A simpler example would be to consider the scenario where you know nothing about the natural logarithm function, it's not elementary to you and you haven't come across it. Then you encounter the integral \int^x_1 1/t dt. Should there be anything stopping you from investigating it, even though it has no "elementary" anti derivative? We can still work out this integrals properties. We can show that it satisfies F(xy) = F(x) + F(y), that F(x^n) = nF(x), etc etc.
Sorry to ramble, but I'm just emphasizing, having no elementary anti derivative is really no limitation to studying a function. It's a pity many people seem to think it is.