You can look at it in several ways. One is to look at the electric field between the plates (I assume parallel plates). Since there is a dielectric between the plates, the electric field gets reduced and you will need more charge on the plates to increase the voltage between them. Using the definition of capacitance you can figure it out from there.