This is rather an abuse of Godel. He was arguing that there are aspects of mathematics which can never be explained from within mathematics itself. Some things must be assumed as axioms to get the show started.
Many good epistemologists followed on from Godel to make better sense of this, such as Robert Rosen (my particular favourite).
A quick summary would be that we have a modelling relation with reality that involves our formal models and our informal measurements - actually a feedback loop process of predicting and then checking.
Mathematics is part of the modelling, a human creation, and we are doing our best to fit the model to the reality we observe.
So to ask whether the universe "is" mathematically logical is to conflate model and reality. Instead, the correct question is how closely do our logical models and observed reality then conform.
We might say that if the two seem to dovetail exactly, then bingo, we can say the universe "is" that way for all intents and purposes. Bur a catch is that models also have purposes. They are not naked creations, but intentional practices. I could say I want to model reality for the purpose of understanding its truth. Or I could instead say I want to model reality in a way that maximises my control over it. And the kinds of models that result are actually different in deep ways. So good epistemology requires the model and the modeled to be kept separate.
Where does maths come into this? Math is really only the science of pattern, the logic of forms. It is the shapes that things must fall into, the regularities that must emerge.
And it is as abstract as possible. A style of models that is all generals or universals, with all local particulars pushed out into the measurement side of the modelling relation.
So the number 1. It can stand for one anything. Within the realm of formal modlling. And then to answer 1 what, we must make a measurement. We must look out into the world and (informally) put a finger on that 1 thing.
The general answer then is that the universe does seem to fall into logical patterns (it is regular, and regular for self-organising reasons) and mathematics is the attempt to formally model things that fall into logical patterns.
Reality cannot work any other way (we must presume) and our formal modelling will work best when it also does the same thing.