@Fra
Yes, this is the problem of the geometric approach. Spacetime is the stage, on which everything has to happen from the geometric view, but itself is not static but observer dependent. Every try to view QM from a geometrical point of view risks to establish a static stage, a non relativistic spacetime, from which we know, that it is simply not true. On the other side, trying to quantize spacetime,.. well,.. at first; What exactly to begin with? Because whatever you quantize, it is ontologicaly above that 'stage', another actor on that relative and observer-dependent 'stage'. So we need a Lorentz-invariant 'thing' which stays stable, while distance and time changing observerdependent. Very difficult to achieve.
A possible take could be; because we have a bit of an "untrustworthy" spacetime, so to say. The truly stable elements seem to be the already quantized parts: the measurements, the discrete values. These are the actors, but they happen on this wobbly stage.
So, a possible solution is to flip the hierarchy: to see spacetime not as the stage, but as an expression of these quantized values. This means spacetime itself emerges from them. For this to be physically plausible, a single fermion or photon, in isolation, cannot define space or time. But an interaction between at least two entities is the minimal event that can bring concepts like 'distance' and 'duration' into existence.
That is why I brought up this relational perspective earlier. It suggests that geometry is the consequence of interaction, not its precondition. In this way we then don't have to quantize the spacetime itself, as it is quantized from deeper core already.
And this way, your 'inferential' view and the 'geometric' view become one and the same in a way.