So I guess just to reinforce what a lot of people in this thread have said, I had a pretty much open discussion about what it takes to get an academic position with my faculty advisor the other day, and this is basically what we came to agree upon

Yes, it really is hard to get a position, and no, it doesn't just take hard work. She said a lot of it has to do with what university you're applying to, and what research they focus on. Therefore, it's supposedly important what
your research was in, and that you don't lock yourself into an area that is kind of going nowhere. So even if you "objectively" excel there, it'll be hard getting a position if the universities just don't see it as something they want to do. Of course how good your research was factors in, but I guess it's sometimes hard to make distinctions whose was better, because it's just too hard to analyze it objectively. So from what I was told, universities often also look for people to form groups, so that they're not going to have one professor specializing in one thing, and then another in a completely different one, but rather two or three whose research will be kind of related.
Apart from that, there are subjective factors that come into play, and "personality" was the first thing that was brought up. Which makes sense. So I guess they not only look for excellence, but a good fit. And what that good fit is again depends on multiple factors that come into play in any interpersonal relation, so some might look for younger people, whereas others for more experienced, hence older ones. But from what I gathered, this isn't just some random, trivial factor, it plays a big role, and so does networking. It was pretty much confirmed to me what two-fish quant was saying all along, that is, if they haven't heard of you, you won't get the position. And if there are, say, 15 people that make it to the final shortlist, and for which it's hard to determine who stands out in terms of research, doesn't it actually make sense that they would go with someone who they know, who they've talked to and think is a nice person to work with, rather than take a chance with someone who, yes, they've heard of (and of their research), but don't really know how they are as a person?
I know I didn't say anything new here, but I just thought I'd post this, because it is just another affirmation of the fact that what the more experienced people here are saying isn't just bolony and that it's not just their disenchantment with Physics or academia that drives to strike down the romanticized view of hard work implying a job in the academia.