No need to remove the housing, unless there's a problem with it or you need the space or something. Just remove the filter and screw the empty cannister back on. Your water system will be just fine.
The bypass plugs mentioned above are used when winterizing so that you don't waste half a gallon of anti-freeze filling up the canister. (guess who forgot his this year...)
One would work for you too, but you don't need it.
That said, I'm in the "both" camp. A blue cylinder "pre-filter" at the spigot end of the host and a good activated charcoal filter in the wet-bay cannister to make everything taste good.
Regards,
Randy