You have it exactly backwards. We use colima to run the (lima) VM that runs Docker daemon, but we use all the standard docker tools on the host. Colima configures docker with a context called "colima" that knows how to talk to the guest correctly.