Well, to "see" your face on something, you need light to bounce of the surface in a orderly fashion. Therefore in highly polished surfaces like mirrors the light gets bounced off in one direction. whereas in something like the wall, the surface is very rough although it might seem "smooth" to touch therefore the light gets scattered and no reflection is seen!