Viewing profile — thushanfernando

Bust?

We’ve been running distributed LLM infrastructure at work for a while and over time we’ve built a few tools to make it easier to manage them. Olla is the latest iteration - smaller…

It's not down - just following an eventual consistency model :D refresh again in a few hours. Otherwise he's probs doing a mass refactor... into 37 independently failing microservi…

The Blog Post from Google for context and background: https://blog.google/outreach-initiatives/entrepreneurs/ai-na...