Some ideas:
Have you already seen limit points? If so, try showing that both the sup and the inf (when both are finite*) , are limit points of a set. Then look for a charcterization of closed sets in terms of limit points.
*This can be extended to the infinite case too, but let's start slowly.
