One way of looking at it is that it is just recognizing what the terms "I" or "you" and "free will" actually refer to. You are not some abstract disembodied essence with magical powers. You are a physical thing, made of physical parts, that obey physical laws. So of course any interpretation of "free will" is going to have to be compatible with those facts, and any valid referent of the term "free will" is going to have to be some physical process going on in the physical system that is "you".
And compatibilism is simply the view that if your acts can be validly given such an interpretation, then they are acts of free will. You don't have to have magical non-physical powers to have free will.
Another way of putting it would be to say that the kind of "free will" I have just described, while it might not be what many people thought they meant by "free will", is still sufficient, because it gives us all the capability we need in practice to have the things that "free will" is supposed to give us.