51–60 of 137 posts
But relying on a Claude API so you don't really "own the stack" as claimed in the article...
I don't think switching to a different provider, or running an open one locally would affect the response quality that much.
I actually use IRC in my coding agent Change into rooms to get into different prompts. using it as remote to change any project, continue from anywhere.
Oh I get it the runtimes are nice and small, you're using Claude for the intelligence. Obv
I think I'm just impressed with anthropic more than anything. Defcon would have me believe that prompt injections are trivial
But relying on a Claude API so you don't really "own the stack" as claimed in the article...
Aren't LLMs commodity products these days? It's the same thing as running this on a $7 VPS that you don't "own". I don't think switching to a different provider, or running an open one locally would affect the response quality that much.
This is such a great idea. I have an idea now for a bot that might help make tech hiring less horrible. It would interview a candidate to find out more about them personally/professionally. Then it would go out and find job listings, and rate them based on candidate's choices. Then it could apply to jobs, and send a link to the candidate's profile in the job application, which a company could process with the same bo…
Working on this actually
[flagged]
Earlier quoted context omitted.
Aren't LLMs commodity products these days? It's the same thing as running this on a $7 VPS that you don't "own". I don't think switching to a different provider, or running an open one locally would affect the response quality that much.
The LLM is the key element here, not the 7 dollars VPS... The model itself has cost billions of dollars to train and of the service shuts down or is interrupted for some reason your fancy setup breaks like nothing.
But that has nothing to do with this use case, right? By the same logic, Linux has millions of man-hours went into it but we can use it for free on a $7 VPS.
> service shuts down or is interrupted for some reason your fancy setup breaks like nothing
No, it doesn't. That's what I meant by commodity. You can switch to another service and it will work just fine (unless you meant that all LLM providers might cease to exist).
Also note that they have a $2/day API usage cap, meaning that they are willing to spend $60+/month for the LLM use. If everything else fails, they can use those funds to upgrade the VPS and run a local model on their own hardware. It won't be Sonnet-4.6-level, but it will do. It just doesn't make sense with current dollar-per-token prices.