You don't. For one thing elements don't have a single color. Sulpher, for example, can have many different colors.
Metals, specifically, have a "silvery" color (i.e. they reflect light) because of the "free" electrons that are not bound to individual atoms and so can "vibrate" more easily.