I started this problem by looking at the electric potential of a ring, which is:
[tex]V=\frac{kQ}{\sqrt{R^2+z^2}}[/tex]

So then if it varies in the thickness of the ring, would it be reasonable to have it be:
[tex]V=\frac{kQ}{\sqrt{(R_{out}-R_{in})^2+z^2}}[/tex]

Or would I need to use the equation for the electric potential of a uniformly charged disk with radius R_out, then subtract the electric potential of the inner disk of radius R_in.

No, that is not correct. You can't just substitute R_in and R_out.
One way of doing this, is finding the contribution of a small ring and integrating to get the contribution of the disc.

First, consider a small ring of thickness [itex]dr[/itex] with a radius of [itex]r[/itex].

Now, what is the potential due to this ring at point at a height 'z' at the axis? It is,

[tex]V=\frac{kdQ}{\sqrt{r^2+z^2}}[/tex]

where, dQ is the small charge on the ring. How do you find this dQ?
You can find the uniform surface charge density [itex] \sigma [/itex] from the question right? (Hint:Total charge/Total area). Since the ring has a small thickness [itex]dr[/itex], the small area will be [itex] 2 \pi r dr [/itex]. From this, you can find the charge "dQ" on the small ring.

How do you find the potential of the disc? Notice that, if you sum the contributions of such small rings, you will get the potential of the disc. So you integrate the contribution the small ring where the radius varies from [itex]r_{in}[/itex] to [itex]r_{out}[/itex]

Can you put this in mathematical equations and post the answer here?