Good point. The solution to the paradox is that we don't normally talk about gases at 1K; most (all?) gases liquefy above that temperature, and the ideal gas law doesn't apply anyways to gases at very low temperatures.
Think about what happens when a gas, say air, goes from 1 degree Celsius to 2 degrees Celsius. (This is hot enough that the ideal gas law applies, so we're safe in using this thought experiment.) Celsius temperature doubles, but the room in your air doesn't suddenly double in volume when the temperature goes from 1 degree Celsius to 2.