Some materials (I'm thinking of wood specifically) also get darker when polished as opposed to rough but I have no idea whether or not it's due to the same mechanism.
It MAY be closely related, because the mechanism in wood is that rough wood had a HUGELY larger surface area (due to little troughs and grooves) and thus reflects more light. Polishing reduces the surface area. Maybe wetting "smooths out" the surface area in a similar way.
If that's the case, it is possible that your special pants may be of a slick material that actually gains a surface roughness when moisture raises the fibers, thus it reflects more light.