The issue is when you have many MCP tools the context becomes too large for the LLM. So Nexus indexes all the tools and lets you search for the right tool and then execute it.
Here are a few key differentiators vs LiteLLM today:
- Nexus does MCP server aggregation and LLM routing - LiteLLM only does LLM routing
- The Nexus router is a standalone binary that can run with minimal TOML configuration and optionally Redis - LiteLLM is a whole package with dashboard, database etc.
- Nexus is written in Rust - LiteLLM is written in Python
That said, LiteLLM is an impressive project, but we're just getting started with Nexus so stay tuned for a steady barrage of feature launches the coming months:)
GraphQL Federation has historically been constrained by the complexities of managing subgraphs, custom integrations, and infrastructure overhead. While existing solutions provide ways to unify GraphQL APIs, they still require significant operational effort. Until now.
We’re excited to introduce Grafbase Extensions, a powerful new way to customize and enhance your GraphQL APIs without the hassle of building and maintaining additional infrastructure. With WebAssembly-powered extensions, you can federate any API, database, or service into your GraphQL schema, whether it’s REST, gRPC, or Kafka. With Extensions, you can bring in any authentication (e.g. OpenID connect) or custom authorization logic directly into the gateway.
Grafbase Federated Graphs are spec compliant with Apollo Federation. We've invested a lot in the developer experience of building an deploying GraphQL APIs. Local development, the Grafbase SDK and the Grafbase dashboard were built from the ground up to be easy and efficient to use.
GraphQL APIs deployed to Grafbase are also deployed to the edge by default, but can now also be deployed in your own infrastructure.
GraphQL really shines when it comes to providing a unified data layer for frontend teams. Having a consistent, typed API is a big time saver for developers building data rich applications.
The ability for frontend teams to shape the data they need without talking to a backend developer and reduce the number of requests made to the API makes for a perfect match when building high performance applications.
From a product perspective Grafbase offers a serverless, realtime GraphQL API deployed at the edge. Our goal is to provide a unified data layer on top of existing APIs and databases.
The Grafbase platform itself is built in Rust and deployed to the edge using WebAssembly. Every GraphQL endpoint is deployed to V8 isolates at the edge which translates to very low cold starts and extremely fast performance globally.
Our branching feature makes collaboration seamless with your team. Just created a Git branch and push it up to create an instant preview branch that is totally isolated from production.
The Grafbase CLI is open source and available on GitHub: https://github.com/grafbase/grafbase.
We are planning to open source the GraphQL gateway itself later this year.
Stay tuned for end-to-end type safety with TypeScript configuration.
Founder of Grafbase here. We are currently in private beta, but at working closely with the community on our way to public beta. Ping me in our Discord if you want to chat!
Grafbase (https://grafbase.com) | Rust, Serverless, GraphQL | Remote | Full-time
Grafbase is a data platform for developers. Deploy instant serverless GraphQL backends with a top notch DX.
We are well funded and backed by leaders in developer tools.
We recently launched our Private Beta and are working towards a Public Beta launch later this year.
If you're passionate about Developer Experience, GraphQL, Serverless and Wasm you will feel right at home at Grafbase. Join us and build the data platform of the future!
Grafbase is a data platform for developers. Deploy globally fast GraphQL APIs with a top-notch developer experience.
We are well funded and backed by leaders in developer tools.
We recently launched our Private Beta and are working towards a Public Beta launch later this year.
If you're passionate about Developer Experience, GraphQL, Serverless and Wasm you will feel right at home at Grafbase. Join us and build the data platform of the future!