On average, the answer is going to be yes. Condensed matter physics is such a broad classification, and it's the largest division of physics, that there are just more condensed matter physicists overall than high energy physicists. High energy physics is smaller, and although they have some really big projects like the LHC, there's still more condensed matter research going on because it's relevant to industry and technology (in a more direct fashion than the LHC and similar projects are). (Plus, lots of the folks working on the LHC are engineers and technicians, not just scientists).
At a given university, they might have a larger high energy faction than condensed matter faction, so at that university it might be easier to get into high energy physics.
It also depends on what subfield of condensed matter you are looking at. There's quite a lot of research on high temperature superconductors or nanomaterials, but maybe not as much on supersolids, for example.
Looking beyond grad school, though, if you intend to keep doing science in the field your get your Ph.D. in, your only option to keep doing high energy physics is to do postdocs and try and get a tenure-track job, which is extremely difficult, to say the least. Condensed matter research which focuses on materials will have many options in industry.