I wanted to know how much it cost? I would be scared to run this without knowing the exact cost. Its not a good idea to do it without a payment cap for sure, its a new way to wake up with a huge bill the next day.
We put a coding agent in a while loop
41–50 of 317 posts
Re: We put a coding agent in a while loop
#42I wanted to know how much it cost? I would be scared to run this without knowing the exact cost. Its not a good idea to do it without a payment cap for sure, its a new way to wake up with a huge bill the next day.
> We spent a little less than $800 on inference for the project. Overall the agents made ~1100 commits across all software projects. Each Sonnet agent costs about $10.50/hour to run overnight.
Re: We put a coding agent in a while loop
#43Starting to think of this quote more and more: "This business will get out of control. It will get out of control and we'll be lucky to live through it." https://www.youtube.com/watch?v=YZuMe5RvxPQ&t=22s
Re: We put a coding agent in a while loop
#44"At one point we tried “improving” the prompt with Claude’s help. It ballooned to 1,500 words. The agent immediately got slower and dumber. We went back to 103 words and it was back on track." Isn't this the exact opposite of every other piece of advice we have gotten in a year? Another general feedback just recently, someone said we need to generate 10 times, because one out of those will be "worth reviewing" How ca…
Hmm what sorts of advice in the last year are you referring to? Like the “run it ten times and pick the best one” thing? Or something else? I kind of agree that picking from 10 poorly-promoted projects is dumb. The engineering is in setting up the engine and verification so one agent can get it right (or 90% right) on a single run (of the infinite ish loop)
They're almost certainly referring to first creating a fleshed out spec and then having it implement that, rather than just 100 words.
Re: We put a coding agent in a while loop
#45Re: We put a coding agent in a while loop
#46> After finishing the port, most of the agents settled for writing extra tests or continuously updating agent/TODO.md to clarify how "done" they were. In one instance, the agent actually used pkill to terminate itself after realizing it was stuck in an infinite loop. Ok, now that is funny! On so many levels. Now, for the project itself, a few thoughts: - this was tried before, about 1.5 years ago there was a project…
Is that... the first recorded instance of an AI committing suicide?
Re: We put a coding agent in a while loop
#47> After finishing the port, most of the agents settled for writing extra tests or continuously updating agent/TODO.md to clarify how "done" they were. In one instance, the agent actually used pkill to terminate itself after realizing it was stuck in an infinite loop. Ok, now that is funny! On so many levels. Now, for the project itself, a few thoughts: - this was tried before, about 1.5 years ago there was a project…
> - weird copyright / IP questions all around. This will be a minefield. Yeah, we're in weird territory because you can drive an LLM as a Bitcoin mixer over intellectual property. That's the entire point/meaning behind https://ghuntley.com/z80 . You can take something that exists, distill it back to specs, and then you've got your own IP. Throw away the tainted IP, and then just run Ralph over a loop. You are able to…
except you dont
Re: We put a coding agent in a while loop
#48> After finishing the port, most of the agents settled for writing extra tests or continuously updating agent/TODO.md to clarify how "done" they were. In one instance, the agent actually used pkill to terminate itself after realizing it was stuck in an infinite loop. Ok, now that is funny! On so many levels. Now, for the project itself, a few thoughts: - this was tried before, about 1.5 years ago there was a project…
> - weird copyright / IP questions all around. This will be a minefield. Yeah, we're in weird territory because you can drive an LLM as a Bitcoin mixer over intellectual property. That's the entire point/meaning behind https://ghuntley.com/z80 . You can take something that exists, distill it back to specs, and then you've got your own IP. Throw away the tainted IP, and then just run Ralph over a loop. You are able to…
AI output isn't copyrighted in the US.
Re: We put a coding agent in a while loop
#49No it did not.
Re: We put a coding agent in a while loop
#50Earlier quoted context omitted.
When Claude starts deploying Kafka clusters I’m outro
It's already happening brother, https://github.com/containers/kubernetes-mcp-server .