Yeah man. I can't think of any other reasons.
I don't look 165 though. Also, when you look fit and others know they aren't fit, then they get nervous. I'm not saying it's because I look fit or not. I may not even look fit but everyone always asks me about working out. I look better than the average guy does physically that's for sure.
Yes, some of the girls I talked to have said that I initimidate their boyfriends. They usually ask the girl if anything is going on between us, which I think is hilarious.
I have crossed the line before. Like the one time a couple (I knew the girl) was sitting on a bench and I just went over and put my arm around her. I know the guy hates me for sure. They ended breaking up and he probably think it's my fault. I have no idea.
Another time, I was at a bar. I wanted to dance with this girl so I walked over and asked her to dance. Then she was like, my boyfriend is right here and points next to herself. (Keep in mind she never said no.

I'm sure she wanted to dance.) So, I slowly and gently pushed (physically) her boyfriend like 3-4 feet away and said "Voila, boyfriend is gone, let's go dance."