They are not "linear transformations" because they are not linear. Specifically "[itex]x^2[/itex]" and "[itex]xy[/itex]" are not linear.
More precisely, a linear transformation, L, must satisfy L(x+ y)= L(x)+ L(y) and L(ax)= aLx for a any number. For b,
[tex]L\left(\begin{pmatrix}x \\ y\end{pmatrix}+ \begin{pmatrix}u \\ v\end{pmatrix}\right)= \begin{pmatrix}(x+u)^2 \\ y+ v\end{pmatrix}= \begin{pmatrix}x^2+ 2u+ u^2 \\ y+ v\end{pmatrix}[/tex]
not
[tex]L\left(\begin{pmatrix}x \\ y\end{pmatrix}\right)+ L\left(\begin{pmatrix}u \\ v\end{pmatrix}\right)= \begin{pmatrix} x^2 \\ y\end{pmatrix}+ \begin{pmatrix}u^2 \\ v\end{pmatrix}= \begin{pmatrix}x^2+ u^2\\ y+ v\end{pmatrix}[/tex]
Similarly,
[tex]L\left(a\begin{pmatrix}x \\ y \end{pmatrix}\right)= L\left(\begin{pmatrix}ax \\ ay\end{pmatrix}\right)= \begin{pmatrix}a^2x^2\\ ay\end{pmatrix}[/tex]
which is not the same as
[tex]aL\left(\begin{pmatrix}x \\ y\end{pmatrix}\right)= \begin{pmatrix}ax^2 \\ ay\end{pmatrix}[/tex]
and the same argument for (c).