I have Aspergers as well and I totally understand where you are coming from.
IMO, the easy way out is not the best solution in the long run. I've been rejected, outcasted, bullied, defriended, been given weird looks, gone through lots of friendships, gotten in nasty arguments and so on. In the end, each of these painful experiences taught me a lesson so that now I can talk to people freely. And now I have flexibility. Some days I might just want to come home from work and stay home alone playing video games the whole day, but whenever I need to, I can make friends and find people to talk to.
So yeah, you can isolate yourself if you want. You won't experience any pain, but you won't learn much either. And in 5 years from now, you'll say to yourself that you're still in the same position you were years ago and you could have improved but you didn't.
It's your choice.