Here's a crude map of a made up town. I've highlighted one of the roads in red:
View attachment 296802
Here's a rotated version:
View attachment 296803
The red highlighted road is in a different place, to the left of the river instead of the right. Clearly things have moved and are in different places.
I suspect what you actually mean by "changing where the roads are on the map" is that the Euclidean relationships between them have changed - that the perpendicular distance between the worldlines as measured with a ruler on the Minkowski diagram has changed in a way more complex than a simple scaling, and that angles between lines have changed. You are correct. They have. This is due to the fact that you are drawing a plane that does not respect the laws of Euclidean geometry, so you cannot represent it on a plane that
does respect those laws without distorting something. But that just means your two maps are distorted in different ways - it doesn't mean that they are maps of different things. For example, here's a NASA composite of the Earth as a Mercator projection:
View attachment 296804
The north and south poles lie at the top and bottom of the map, as usual. Here's another Mercator projection - drawn by exactly the same process - but with the points where the international date line and Greenwich meridian cross the equator at the top and bottom of the map, which puts the north pole in the middle and the south pole at the edge.
View attachment 296807
South America and Australia point in opposite directions compared to the original, Africa is massively distorted, and the whole of Europe and Asia is much smaller. Do you think this is a map of another planet? Because that seems to be equivalent to your beliefs about Minkowski diagrams. Or is it just that spherical geometry is different from Euclidean geometry and any flat map of a sphere is distorted, and any two maps are
differently distorted? Because that's what's really going on, both in the Mercator projection and the Minkowski diagrams.
Original Mercator projection image credit: NASA, via Visible Earth.