@stevendaryl is correct, I think, and you should disregard my previous comments to
@Haorong Wu about the derivatives.
No, ##x_a## is not a vector or a component of one. There is no such thing as a position vector in non-flat spaces or non-Cartesion coordinates. An infinitesimal change in position, ##\mathrm{d}x^a##, is a vector, so quantities like ##g_{ab}\mathrm{d}x^a\mathrm{d}x^b## can be calculated, but ##g_{ab}x^ax^b## doesn't make sense. Coordinates are a tuple, not a vector.
##\partial_af## is the change in a function ##f## as you move an infinitesimal distance in the direction in which only the ##a##th coordinate changes. Yes, this is ##\frac{\partial}{\partial x^a}f## (Carroll notes that,
very roughly speaking, "##x^\mu## has an upper index, but when it is in the denominator of a derivative it implies a lower index on the resulting object."). ##\partial^af##, then, cannot mean ##\frac{\partial}{\partial x_a}f##, because ##x_a## doesn't mean anything. Instead, it is an accepted shorthand for ##g^{ab}\partial_bf##.
So to return to your original question, you should interpret ##\partial^\beta(g_{\alpha\beta}A_\mu A^\mu)## as $$\begin{eqnarray*}
&&\partial^\beta(g_{\alpha\beta}A_\mu A^\mu)\\
&=&g^{\beta\sigma}\partial_\sigma(g_{\alpha\beta}A_\mu A^\mu)\\
&=&g^{\beta\sigma}\frac{\partial}{\partial x^\sigma}\left(g_{\alpha\beta}A_\mu A^\mu\right)
\end{eqnarray*}$$