Ah, but you are doing work! If you push on a brick wall, even though you do no work on the wall itself, your muscles are doing work on themselves because they aren't rigid objects and will stretch slightly as they try to contract. All of the work is eventually turned into heat through this and through the chemical processes fueling your muscles.