The place to start this debate would be epistemology - acceptance that all knowledge is modelling. Knowledge is always a map (and so embeds a human purpose, representing where we want to go).
Then the question becomes what kind of knowledge of reality is maths?
Clearly it is knowledge of the most general or universal kind. The most general or universal that we find useful *as a map*.
So we can know a tree at many levels of modelling, from memories of particular trees in my garden to what we get taught about plant life in general in botany class. But what kind of mathematical level generalisations can we make about trees?
The fractal nature of tree branching would be one "deep insight". It connects trees to many other phenomenon like river systems and other dissipative structures.
Dissipative structure theory is of course a physical theory about energy flows and entropy degraders. And fractals are the product of mathematical equations. So we can see how there is a path from what some like to call qualitative-to-quantitative description.
A tree is a highly qualitative experience as we know "so many things" about it. But in a stuck together, constructed, componential sort of way. The idea of "tree-ness" is multi-dimensional. Then dissipative structure theory is a much more general description that is also much more constrained in its application. It has qualitative aspects (like energy flow) but also offers "things that must be measured" - such as quantities which get conserved. Then fractals are completely general, so general they no longer appear to refer to any real life instances. There are no qualitative aspects, just the quantitative - variable plugged into equations.
So what I am arguing is that all knowledge is modelling. Qualitative or quantitative. Then modelling does follow a hierarchy of generalisation. You start with "raw experience" (or the kind of natural world modelling that animal brains evolved to do, which also embed purposes of course). Then move away from raw experiences of trees and fish and ponds to increasingly more general, and thus reduced (stripped of qualifying specifics, trimmed of unneccessary phenomenal dimensions) levels of modelling. Physics is our word for the limit of science, the limit of description for what is real. Then maths is the step beyond, into generalities that are not real, that are pure quantity - but which can have qualities like energy or inertia plugged back into their frameworks and so become a tool for doing physics or other reality modelling.
Well, I say maths is pure quantity, but of course the axioms of maths are the vestiges of qualitative description. We boil reality right down to the last irreducibly necessary concepts - like assumptions about continuity~discreteness, stasis~change, chance~necessity.
Maths itself is of course a mix of disciplines.
You have algebra~geometry (the discrete vs the continuous descriptions). Algebra and geometry are in effect the exploration of the world of all possible general objects or general structures.
Then you have logic, which is the generalisation of causality, the generalisation of reality's rules.
And within maths there are levels of generalisation, as made explicit in category theory. So topology is more general than geometry. Arguably, by taking away the quantitative aspects of geometry - distance and angle and curvature - topology becomes a more qualitative level of description. Yes, it does reduce geometry towards the axiomatic nub, the ideas like continuous~discrete dimensionality that are its founding assumptions.
So category theory ends up with a ur-reduced, ur-general, map of reality. Objects and morphisms. Like a map which is a blank sheet of paper with an arrow saying "you are here" and a second saying "everything else is somewhere else".
To sum up, all knowledge is modelling. All modelling is shaped by purpose. Maps have reasons. Maps also want to be as simple as possible - particulars are reduced to leave generalisations.
Then human knowledge starts up where animal knowledge left off. We start off with a highly subjective or qualitative view of reality and work towards an objective or quantitative view. Maths is an almost purely general level of map making, but even here some founding qualitative axioms are required.