I've had, and am still having, similar thoughts.
I guess the force that still keeps me going is the thought that you don't have to be smartest to make a difference. That is, I'm still being troubled by the fact that I'm not the smartest or even close. But then again, not many people are...