Huggingchat Omni: Model router at inference for 115 open-source models
1–2 of 2 posts
Re: Huggingchat Omni: Model router at inference for 115 open-source models
#2Hugging Face just released HuggingChat Omni, that selects the best model for every prompt automatically amongst 115 open-source models including gpt-oss, deepseek, qwen, kimi, smolLM, gemma, aya and many more already!
Omni uses a policy-based approach to model selection thanks to a model router called Arch-Router from Katanemo.