Automating AI Away
replicated.live
Automating AI Away
1–10 of 69 posts
Re: Automating AI Away
#2BTW, you should probably fix the Beagle link on your homepage: https://replicated.live/beagle/
Re: Automating AI Away
#3Re: Automating AI Away
#4LLMS should be abstracted out of a process as soon as practicable, replaced with deterministic processes or procedures. Otherwise you’ve built the world’s most fragile process at the mercy of token cost, vendor hostility, geopolitics, and model deprecation.
Re: Automating AI Away
#5Basically what I’ve been saying since OldJob forced LLMs down our throats and pegging performance to usage metrics: why the fuck are we handing deterministic processes to probabilistic systems when it should be the other way around (using probabilistic systems to design deterministic ones)? LLMS should be abstracted out of a process as soon as practicable, replaced with deterministic processes or procedures. Otherwis…
I've genuinely never considered it from this angle before.
Re: Automating AI Away
#6Re: Automating AI Away
#7Basically what I’ve been saying since OldJob forced LLMs down our throats and pegging performance to usage metrics: why the fuck are we handing deterministic processes to probabilistic systems when it should be the other way around (using probabilistic systems to design deterministic ones)? LLMS should be abstracted out of a process as soon as practicable, replaced with deterministic processes or procedures. Otherwis…
I love the way you put this. Are there any sites or forums or places where people discuss/hash this out? I've genuinely never considered it from this angle before.
Re: Automating AI Away
#8This is a very interesting introduction to a blog post, but... I'm somehow missing the actual blog post. How does this stuff work in practice? What are some concrete examples? How does one get from JavaScript tokenizing things in a commit hook to validating that the LLM didn't disable tests it didn't agree with, or any other helpful property?
I also aspire to make one post a day. To be continued.
Re: Automating AI Away
#9Earlier quoted context omitted.
I love the way you put this. Are there any sites or forums or places where people discuss/hash this out? I've genuinely never considered it from this angle before.
Humans aren't deterministic. Determinism is a red herring. There are lots of other problems with agentic programming, but this is not at the top of the list.
Re: Automating AI Away
#10Makes sense, I have had the biggest wins with AI by attacking nondeterminism whenever possible. BTW, you should probably fix the Beagle link on your homepage: https://replicated.live/beagle/
[1]: https://github.com/gritzko/jab