Okay, then you would prefer to use relativistic mass? It seems more logical to you? But, then, where is your "stuff is stuff" idea?
It's got to be one or the other. You can't have both. Although, I guess you could. On Mondays, Wednesdays and Fridays, you could use the invariant mass ##m##. And, on Tuesdays, Thursdays and Saturdays you could use relativistic mass ##\gamma m##.
And, if someone asks you why, you could say: I like the idea that "stuff is stuff" so I like the idea of invariant mass. But, I also like the fact that mass changes with relative velocity, so I like relativistic mass too. So, I use one some days and the other on other days.
Physicists decided they needed to settle on one or the other, and in general they preferred invariant mass. Relativistic mass is deprecated because that is people not following an agreed standard.