Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Local TypeScript Super SDK to Call 200 LLMs

github.com

Post reply on HN
Print view View original

11–20 of 21 posts

Re: Local TypeScript Super SDK to Call 200 LLMs

#11

Post by maeil »

A more fleshed out competitor to llm-interface [1]? Looks great!

Does it run in FaaS/serverless environments out of the box? Lambdas, Cloudflare Workers, Vercel functions and the likes? Deno? The README says "Isomorphic - works everywhere", but might be nice to make this more explicit.

[1] https://github.com/samestrin/llm-interface

Re: Local TypeScript Super SDK to Call 200 LLMs

#12

Post by vbo »

Looks good, might give it a try. I was looking for something similar to provide a unified interface for gpt and claude and eventually hacked something together myself, as none of the solutions I found could deal with structured output properly across both vendors.

Re: Local TypeScript Super SDK to Call 200 LLMs

#13

Post by alex_suzuki »

ArshDilbagi wrote: post #7
alex_suzuki wrote: post #6

what‘s a „Super SDK“? A meta sdk, i.e. an SDK wrapping other SDKs/APIs?

We have implemented “super-types” that are strongly typed in TypeScript and compatible with all providers (think a superset in mathematics). Hence the name, Super SDK. Gateway is super light weight. We don’t wrap around other SDKs. We describe the APIs in the provider packages (@adaline/openai) that plugs into @adaline/gateway that has all the features.

Got it, thanks!

Re: Local TypeScript Super SDK to Call 200 LLMs

#14

Post by BoorishBears »

ArshDilbagi wrote: post #10
BoorishBears wrote: post #4

Can tools return images to the LLM using this SDK? (where supported by the provider)

Yes, we support images, tools, response format (for OpenAI) and everything else.

I'm asking specifically about images being returned by a tool call. I didn't see any indication that it's supported skimming through the Zod types

Re: Local TypeScript Super SDK to Call 200 LLMs

#16

Post by Sn0wCoder »

Very neat, bookmarked. Read through the readme.md and would be nice to show an example of using with Ollama or LM Studio running locally. Would guess you just setup an OpenAI model, set the baseUrl to the local instance / API and go from there? For something that is Fully Local connecting to a provider with an API key is iffy at best, unless you are paying for enterprise keys. I guess the first line says used by ‘Enterprises’ but to be fully local that would include running the LLM locally also?

Re: Local TypeScript Super SDK to Call 200 LLMs

#19

Post by ndndjdjdn »

That is great. How do you even handle the daily divergence that must happen due to micro decisions made by various APIs. For example I wont mention their name but one OpenAI compatiable provider doesn't fully work with OpenAI client and had various holes so you need to account for that. The other hard thing is just the fast pace of AI. What if the underlying concepts change!

Well done!

Post reply on HN