Apart from maximizing compatibility, is there a technical reason why GPU is not used if available?
mainly this is a portability and compatibility solution.. I think with GPU available deployments, it wouldn't benefit from ternary distillation. It would be a different problem domain.