Go LLM SDK for streaming, tool-calling AI backends (plus frontend React lib)

#1

Post by matryer » Thu, Jul 30, 2026, 11:55 AM UTC

Go LLM SDK for streaming, tool-calling AI backends (plus frontend React lib)
github.com

Re: Go LLM SDK for streaming, tool-calling AI backends (plus frontend React lib)

#2

Post by jnstrdm05 » Thu, Jul 30, 2026, 1:49 PM UTC

Very nice! Thanks for putting this out there

Re: Go LLM SDK for streaming, tool-calling AI backends (plus frontend React lib)

#3

Post by champagnepapi » Thu, Jul 30, 2026, 1:53 PM UTC

I’m curious to know if this was architected/designed by an actual human or is this just AI slop?

These days I am very very cautious about the quality of packages. I’ve become a lot more reluctant/hesitant (which is not to say prior I was in favor of just adding packages left and right). I was still conservative, but these days I’ve become much much more conservative when it comes to adding a package to a production system.

I will review this later and report back for the community

Re: Go LLM SDK for streaming, tool-calling AI backends (plus frontend React lib)

#4

Post by geodel » Thu, Jul 30, 2026, 2:09 PM UTC

champagnepapi wrote: post #3

I’m curious to know if this was architected/designed by an actual human or is this just AI slop? These days I am very very cautious about the quality of packages. I’ve become a lot more reluctant/hesitant (which is not to say prior I was in favor of just adding packages left and right). I was still conservative, but these days I’ve become much much more conservative when it comes to adding a package to a production s…

From their Agent.md:

"Go port of Vercel's AI SDK (github.com/grafana/ai-sdk), providing streaming LLM orchestration wire-compatible with @ai-sdk/react"

Re: Go LLM SDK for streaming, tool-calling AI backends (plus frontend React lib)

#5

Post by gregfurman » Thu, Jul 30, 2026, 2:09 PM UTC

This looks great! Wonder how it compares to https://github.com/genkit-ai/genkit since they also offer similar SDKs and support for different model providers.

Re: Go LLM SDK for streaming, tool-calling AI backends (plus frontend React lib)

#6

Post by nkapila6 » Thu, Jul 30, 2026, 2:10 PM UTC

champagnepapi wrote: post #3

I’m curious to know if this was architected/designed by an actual human or is this just AI slop? These days I am very very cautious about the quality of packages. I’ve become a lot more reluctant/hesitant (which is not to say prior I was in favor of just adding packages left and right). I was still conservative, but these days I’ve become much much more conservative when it comes to adding a package to a production s…

What is not written by AI nowadays..? Unless the library has strict no AI policy like Zig, I don't see AI going away.. but I would love to learn how you audit a huge AI written codebase atp?

Btw, the emdash in the repo description is a giveaway too.

Re: Go LLM SDK for streaming, tool-calling AI backends (plus frontend React lib)

#7

Post by throwaway894345 » Thu, Jul 30, 2026, 2:32 PM UTC

I wonder how these LLM SDKs compare. Is this in the same category as Google’s ADK? Or maybe ADK is a higher level (agents are a higher level than models)?

Re: Go LLM SDK for streaming, tool-calling AI backends (plus frontend React lib)

#8

Post by 8bitsout » Thu, Jul 30, 2026, 2:37 PM UTC

champagnepapi wrote: post #3

I’m curious to know if this was architected/designed by an actual human or is this just AI slop? These days I am very very cautious about the quality of packages. I’ve become a lot more reluctant/hesitant (which is not to say prior I was in favor of just adding packages left and right). I was still conservative, but these days I’ve become much much more conservative when it comes to adding a package to a production s…

I personally wouldn't classify it as slop from my own very quick glance of the code (who reads the code these days, amirite?) - seems pretty reasonable. Someone already mentioned that in AGENTS.md it is stated that this is a port, so that answers the design question. Out of interest, what is your definition of AI slop?

Re: Go LLM SDK for streaming, tool-calling AI backends (plus frontend React lib)

#9

Post by zknill » Thu, Jul 30, 2026, 2:39 PM UTC

This is a backend written in go that's wire-protocol compatible with the (catchy named) Vercel AI UI SDK; which is an SDK for helping to build AI chat apps. The original Vercel AI SDK backend is in typescript.

I think they really missed the opportunity to add in resumable streaming after a dropped SSE connection, or multi-device support. Because these SDKs are easy to drop-in to your applications, but hard once you actually try and build resilient systems on top of them. Systems that can heal from dropped connections, or support multiple users or multiple devices.

Re: Go LLM SDK for streaming, tool-calling AI backends (plus frontend React lib)

#10

Post by [deleted] » Thu, Jul 30, 2026, 2:59 PM UTC

8bitsout wrote: post #8

champagnepapi wrote: post #3

I’m curious to know if this was architected/designed by an actual human or is this just AI slop? These days I am very very cautious about the quality of packages. I’ve become a lot more reluctant/hesitant (which is not to say prior I was in favor of just adding packages left and right). I was still conservative, but these days I’ve become much much more conservative when it comes to adding a package to a production s…

I personally wouldn't classify it as slop from my own very quick glance of the code (who reads the code these days, amirite?) - seems pretty reasonable. Someone already mentioned that in AGENTS.md it is stated that this is a port, so that answers the design question. Out of interest, what is your definition of AI slop?

[deleted]