The permeability and permittivity of free space are now defined by other quantities, such as the length of a meter and the speed of light. Suppose you measured the capacitance of two one-square-meter plates separated by 1 millimeter in vacuum. Because the meter is defined by c, and c = 1/sqrt(u0e0), the measurement is not an independent measurement. the value of all the fundamental constants are based on a variety of interdependent quantities, every value is over determined, and least square fits are used to get the most probable values. In the 2002 table of the fundamental constants (which I am now looking at), both the permeability and permittivity of free space are "exact" defined quantities, meaning no uncertainty in value.
So you cannot go out into intergallactic space and measure them, because of their dependence on other quantities. On the other hand, dimensionless quantities, like alpha, are dimensionless and measurable.