You can do this by adding some salt-water bottles, which have a lower melting point, and will therefore absorb a lot of heat (heat of fusion) well below 0C. Eg add 250g salt/liter gives melting point of -18C.
Of course you waste some space on useless salt water vs potable - maybe there are better alternatives, eg fruit juice? Milk? Honey?