Local TypeScript Super SDK to Call 200 LLMs

- Production-ready and used by enterprises. - Fully local and NOT a proxy. You can deploy it anywhere. - Comes with batching, retries, caching, callbacks, and OpenTelemetry support. - Supports custom plugins for caching, logging, HTTP client, and more. You can use it like LEGOs and make it work with your infrastructure. - Supports plug-and-play providers. You can run fully custom providers and still leverage all the benefits of Adaline Gateway.

Features Strongly typed in TypeScript Isomorphic - works everywhere 100% local and private and NOT a proxy Tool calling support across all compatible LLMs Batching for all requests with custom queue support Automatic retries with exponential backoff Caching with custom cache plug-in support Callbacks for full custom instrumentation and hooks OpenTelemetry to plug tracing into your existing infrastructure Plug-and-play custom providers for local and custom models