Nexus: An Open-Source AI Router for Governance, Control and Observability
1–10 of 27 posts
Re: Nexus: An Open-Source AI Router for Governance, Control and Observability
#2Grafbase just launched Nexus, an open-source AI Router that unifies MCP servers and LLMs through a single endpoint. Designed for enterprise-grade governance, control, and observability, Nexus helps teams manage AI complexity, enforce policies, and monitor performance across their entire stack.
Built to work with any MCP server or LLM provider out-of-the-box, Nexus is designed for developers who want to integrate AI with the same rigor as production APIs.
Re: Nexus: An Open-Source AI Router for Governance, Control and Observability
#3Grafbase just launched Nexus, an open-source AI Router that unifies MCP servers and LLMs through a single endpoint. Designed for enterprise-grade governance, control, and observability, Nexus helps teams manage AI complexity, enforce policies, and monitor performance across their entire stack. Built to work with any MCP server or LLM provider out-of-the-box, Nexus is designed for developers who want to integrate AI w…
Sounds like litellm which I use, I wonder how it compares?
Re: Nexus: An Open-Source AI Router for Governance, Control and Observability
#4As in Torment Nexus? Wow.
Re: Nexus: An Open-Source AI Router for Governance, Control and Observability
#5Grafbase just launched Nexus, an open-source AI Router that unifies MCP servers and LLMs through a single endpoint. Designed for enterprise-grade governance, control, and observability, Nexus helps teams manage AI complexity, enforce policies, and monitor performance across their entire stack. Built to work with any MCP server or LLM provider out-of-the-box, Nexus is designed for developers who want to integrate AI w…
Sounds like litellm which I use, I wonder how it compares?
There is also https://github.com/maximhq/bifrost which apparently overcomes some performance issues of litellm and is easy to get going.
Re: Nexus: An Open-Source AI Router for Governance, Control and Observability
#6This is cool
Re: Nexus: An Open-Source AI Router for Governance, Control and Observability
#7I thought it was a phone :/, for developers.
Re: Nexus: An Open-Source AI Router for Governance, Control and Observability
#8Grafbase just launched Nexus, an open-source AI Router that unifies MCP servers and LLMs through a single endpoint. Designed for enterprise-grade governance, control, and observability, Nexus helps teams manage AI complexity, enforce policies, and monitor performance across their entire stack. Built to work with any MCP server or LLM provider out-of-the-box, Nexus is designed for developers who want to integrate AI w…
Sounds like litellm which I use, I wonder how it compares?
Founder of Grafbase here.
Here are a few key differentiators vs LiteLLM today:
- Nexus does MCP server aggregation and LLM routing - LiteLLM only does LLM routing
- The Nexus router is a standalone binary that can run with minimal TOML configuration and optionally Redis - LiteLLM is a whole package with dashboard, database etc.
- Nexus is written in Rust - LiteLLM is written in Python
That said, LiteLLM is an impressive project, but we're just getting started with Nexus so stay tuned for a steady barrage of feature launches the coming months:)
Re: Nexus: An Open-Source AI Router for Governance, Control and Observability
#9I thought it was a phone :/, for developers.
That phone was discontinued:)
Re: Nexus: An Open-Source AI Router for Governance, Control and Observability
#10This is cool
What are you building?