Not sure I can really add to that site, because it is excellent, but in case anybody doesn't want to delve that far into and just wants the super-short version, here it is:
When we look at the CMB, the light coming from it is partially polarized. This means that the electric field lines of the incoming radiation tend to be oriented in one particular direction. The specific source of this orientation comes from the gravitational perturbations in the early universe (the above link gives a good description of the physics involved there).
Now, we can decompose any field that picks out a specific direction at every point into two components: an "E mode" and a "B mode". The E mode component, also called the gradient component, is a vector field which only points towards/away from sources. The reason it is called an "E mode" is because this is much like the behavior of the Electric field with unmoving charges.
The B mode component, similarly, behaves like a magnetic field in that it has a curl but no divergence, which means it tends to point in circles around sources.
The important point here is that the physics behaves very differently upon these two different components of the polarization, making them an excellent probe of early-universe physics. For instance, the B-mode polarization is only sourced by tensor perturbations in the early universe, so a positive detection of primordial B-mode signal is as near a direct measurement of inflation as we can get with CMB observations.