The general idea is correct, but since we're dealing with electronagnetic waves, they travel slower in any medium. So pumping out all the air of the room would technically make your wifi faster.

Liquid oxygen has (I think) a refractive index of about 1.2, so it would make the signals 20% slower (still very fast)