My Homelab AI Dev Platform
51–60 of 69 posts
Re: My Homelab AI Dev Platform
#52Re: My Homelab AI Dev Platform
#53Some times I feel like a lot of people in tech independently go through the same things right around the same time with few people writing/sharing about it. I am also creating this and enjoyed the post and comments all going through the same thing :)
Not only in tech. This is a common phenomenon. We're not that original.
Re: My Homelab AI Dev Platform
#541. issue tag
2. write pr
3. testing
4. review+revise loop
5. merge mutex to ensure you don't get a merge storm
6. rebase and merge
I've been trying really hard to have it properly implement agentic identity where the pod gets a spiffe-attested token and then trades that for access to the vault secret for a project-scoped forgejo service account. I wish forgejo could configure a trusted external jwt signing authority so I could skip vault and the accounts.
Here's the inspiration for the auth model I've been trying to implement: https://datatracker.ietf.org/doc/draft-klrc-aiagent-auth/
The last piece has been using gvisor + kubernetes agent sandboxes. My fable adventure last week was having it debug the process of attesting and distributing workload identities for agents running in gvisor, as it creates a layer of indirection that confuses spire to the point it won't issue an ID.
Re: My Homelab AI Dev Platform
#55Re: My Homelab AI Dev Platform
#56Re: My Homelab AI Dev Platform
#57For the agent I was using `claude -p` with a pro subscription, but they've been treating their paying subscribers like they're on a free trial (they're subsidizing it so heavily it might as well be). So now I'm using an ollama pro subscription and a homebuilt agent with a bash tool and a str_replace tool. It gets on just fine with only those two
Re: My Homelab AI Dev Platform
#58How do you run inference for Open Code? What models are you running
Re: My Homelab AI Dev Platform
#59I’m working on an open source Forgejo Frontend that exposes additional features like this, and offers a better user experience, faster large diffs, and basically fixes every little thing I don’t like about Forgejo. Would be interested in hearing more of your complaints so I can continue to improve.
Re: My Homelab AI Dev Platform
#60Probably CI is the better primitive, I usually use gitlab though and I felt "put off" by all their native AI features being license gated.