My second issue is that your statement still seems to imply that there could be a discrepancy between the way these vectors "actually point" (red) and how we arbitrarily define them to point (blue). This is NOT the case. The first half of the sentence (red) is actually just totally meaningless without the second half (blue): they point in whatever direction they are defined to point, so it is not possible for these two things to be discrepant. It's NOT "unestablished." It's totally established, by definition.
Example: the direction of the electric field at a point in space is defined as the direction in which a positive test charge would accelerate if placed at that point in space. If you were to reverse that definition, and instead define it as the opposite of the direction that a positive charge would accelerate (or, equivalently, as the direction that a negative charge would accelerate), then the field vectors would, in fact all point in the opposite direction from what they did before. This change of definition, of course, has absolutely no effect on what is actually observed. Charges of a given polarity would still accelerate in the same directions as they did before. The effect of this quantity called the "E-field" would simply be defined to be the opposite of how we define it. Similarly, the direction of a magnetic field at a point in space has arbitrarily been defined to be the direction that a compass needle would point if placed at that point in space. However, we could easily have defined it in the opposite way if we had wanted.