You’ll be fine.
I also had setbacks in my late teens and early twenties, and I went to community college in order to get up to speed before transferring to a UC. Now I’m a PhD student at Caltech.
I too was worried about getting into a good grad program, and I felt inferior to my peers who had...