Nile3
The answer to your question depends on what you take a reduction of mathematics to logic to consist in.
There are many mathematical theories whose axioms are not reducible, recoverable or interpretable as theorems or axioms of logic. As MathematicalPhysicist said, logic doesn't imply the existence of any entities while, for example, the axioms of number theory and set-theory do imply the existence of (infinitely many) entities. (Though I'm not sure that the induction scheme mentioned by MathPhys is a good example, as it is really a conditional statement).
It's not entirely clear cut, because there's some debate about what precisely counts as a logical truth -- Frege and Russell thought that second order logic - quantification into predicate position -- did entail the existence of set-like entities.
However, you might think that mathematics doesn't really assert the existence of numbers and sets; rather, mathematicians are concerned with what would be true if a certain collection of axioms were true - the axioms defining number theory, or the axioms defining set-theory. From that point of view, there is a sense in which most modern mathematics, and certainly most standard modern mathematics, can be regarded as a kind of logic -- the art of drawing out ever more subtle and difficult logical consequences of a set of axioms.
Sometimes, though, mathematicians can get into a fight as to whether or not an axiom is 'correct'. There used to be disagreement about whether the axiom of choice was an acceptable axiom. Insofar as mathematicians get involved in this discussion, we cannot understand what they are doing as simply doing logic, as they are not just drawing out the consequences of a set of axioms. Some set-theorists take sides on whether the continuum hypothesis is 'true.' But I would say it is doubtful whether such arguments play much part in modern mainstream mathematics. For a start, there are difficulties in using the notion of truth in the mathematical context without finding oneself committed to Platonism.
It's not clear the degree to which Godel's theorem is really relevant. A common formulation is that Godel's incompleteness theorem shows that any sufficiently strong consistent formal system is incapable of proving all the mathematical truths. But that statement involves the notion of mathematical truth, which is contentious. More formally, Godel's theorem just shows that, for any sufficiently strong consistent formal system, there is a mathematical statement P, such that neither P nor ¬P is provable. Whether this touches upon the reducibility of maths to logic depends upon your attitude towards P. For instance, many mathematicians are unmoved by the unprovability of CH from standard axioms of set-theory.