Why are objects with higher center of mass less stable?

[Simfish]

Is it because less force (from, say, potential objects that could tip the object) is required to exert the same amount of torque on objects with higher center of mass?

 

[mgb_phys]

An object falls over when the centre of mass moves outside the base.
Consider what angle you have to tilt a shape through to get to this state.