Instead, just get a multi-stage reverse osmosis filter unit. That'll take out virtually everything potentially nasty and/or bad tasting: chlorine, flouride, metal salts used to control algae, misc. minerals and so forth. Coffee and tea brewers, you really owe this to yourselves. The maintenance amounts to replacing a few filters in an under-sink unit every one to three years depending on your local water supply. No remembering to refill a pitcher, just a little extra spigot on your sink.
[1] BPA-free isn't good enough. Replacing one plasticizer with another that also has high estrogenic activity is pointless.