Viewing profile — angarrido

[dead]

[dead]

[dead]

must people think it’s just GPU cost. In practice it’s coordination: model latency variance + queueing + retries under load. You don’t scale linearly, you get cascading slowdowns.

[dead]

[dead]

I built this because I couldn’t use Copilot or Claude at work without risking exposing internal code. This runs fully local (Gemma 4 26B), indexes your codebase, and answers questi…

[dead]

Local inference is getting solved pretty quickly. What still seems unsolved is how to safely use it on real private systems (large codebases, internal tools, etc) where you can’t r…

[dead]

Awesome idea, usually LLMs lack of creativity, so layouts look mostly the same, I could give a try

[dead]

Interesting approach. One thing I’ve been running into is that even with good alerts, the harder problem ends up being when to actually be exposed. You can get the signal right and…