That isnt how it is always done. In not-dry countries, the non-potable water is generally collected locally. It is filtered rainwater from cisterns, not piped public water from afar.