Viewing profile — rgthelen

Thanks for following along since day 1!

webhooks are the part where most agent-built auth falls apart. Here's how Corral handles it: The server-express.ts template generates the webhook route with the raw body parser bef…

Thanks! On auth providers — Corral already supports 9 OAuth providers out of the box (Google, GitHub, Apple, Discord, Microsoft, Twitter, Facebook, GitLab, LinkedIn) plus email/pas…

It 100% runs locally, is easy to deploy, and it wires it right into your app - even cooler, if you have a JS backend, no extra server, if you have python, go, ruby, etc, it will ha…

Hey HN. I built Corral because every time I asked an AI coding agent to "add auth and payments," it hallucinated for an hour and produced broken code. Wrong imports, phantom endpoi…

The split model leaves too many holes to make it really useful for the community. When we add things like "authentication", we'll ship the plugins (like okta integration (for enter…

Yeah, we are in it to win it.

Oh man, yeah, big pivot. We still are Rownd ( https://rownd.com ); but we see the writing on the wall. SaaS Software that helps with "hard code" problems is going the way of the do…

We are adding continuous model fine-tuning soon, and being able to bring extra horsepower into training is an opportunity. There is also a genuine opportunity to do the same thing …

Yeah, totally fair. The “horizontal orchestration” story only goes so far — at some point you need vertical depth. We’re starting with regulated enterprises (defense, healthcare, l…

Yes! Vulcan support is in dev (will be in the next versioned release, probably tomorrow). You can pull down the repo and run a few easy commands to get inference up and running. ht…

Appreciate that — and totally agree. The “who cares / who pays” question is exactly why this hasn’t scaled before. Our bet is that the timing’s finally right: local inference, smal…

Funny you bring it up. We shipped Vulkan support TODAY through a tight integration Lemonade ( https://lemonade-server.ai ). We now support AMD, Intel, CPU, and Cuda/Nvidia. Hit me …

Our business model is not to compete in open-source; we are just providing this to the community since its the right thing to do and as a signal to enterprises to reduce risk. Our …

I hear you and valid. A mixture of Models is probably a better phrase - we are constantly moving between AI experts and very skilled Developers who use OpenAI endpoints and call it…

Let me know when you open source it; I think there is a place for this and I think we could integrate it as a plug in pretty easily into the LlamaFarm framework :)

Yeah, I don't see why we could not integrate that. I think that is the next step as we move our workloads to production.

This looks awesome. Are you kind of like lemonade? Let's chat - robert@llamafarm.dev

Cool ideas, thank you.

What are a few use-cases you want to see this used for?

The hardest part, honestly, is the runtime. How do we make it super easy actually to deploy this. We are still working on that. Where do you see a few good places to focus at first…

Yeah, that’s a fair framing — it is kind of an “application layer” for AI orchestration, but focused on ownership and portability instead of just convenience. Yeah, the beachead wi…

Good question — that’s actually the sweet spot for LlamaFarm. You can wire things together yourself (LangChain, bash, Ollama, etc.), but LlamaFarm tries to make that repeatable and…

I am kind of militant about this. The ability to run great AI models locally is critical, not just for this sector, but for innovation overall. The bar of "build a few datacenters"…

Likewise, it's been fun building in the open on this one. You can download the CLI with just: curl -fsSL https://raw.githubusercontent.com/llama-farm/llamafarm/main/... | bash Then…