AI coding at home without going broke
171–180 of 321 posts
Re: AI coding at home without going broke
#172I cannot figure out what people are doing to spend all this money. I have used a $60 per month Cursor plan on auto, and have never come close to using up my included usage, and I probably have it planning and coding and working for me all through the evenings 4 nights a week. What on earth are people doing differently that it's costing them so much? Maybe enabling on-demand usage or other paid models, or on higher mo…
Plenty of low level things can trip agents up, too. I just had one inexplicably refuse to read an error about a function needing a bool return value - trying about 10 variations of the same thing before I interrupted it. Skills probably cause issues too, it loves to for example read the source code of libraries I'm using if I give it permission. That's a rabbit hole.
Re: AI coding at home without going broke
#173what a world we live in?
Re: AI coding at home without going broke
#174Earlier quoted context omitted.
I don't miss the days of scraping through logs or dashboards myself to troubleshoot some latency or malformed data issue that I missed conditionals for. AI is incredible at finding patterns in otherwise benign stdouts, let alone as it cross-references data streams. In theory, I don't need most of these automations. But for $200/mo? I will happily reduce my cognitive burden on stuff that doesn't impact the core busine…
What I mean is a script that can look through the logs. They are known and deterministic (if you properly handle errors) and you can analyze them statistically. If you don't know what logs your app is outputting, then you have a bigger problem in your hands tbh.
But I'm a human - I will miss things. I maintain too many apps to have entire codebases in memory at this point. Or to continue monitoring all these streams. Logging is cheap - I log as much as possible because an AI will scan it for me.
I just want scoped pull requests to review proactively against the slew of things that can happen in prod that I didn't account for in my specs (again, from logs, customer issues, etc). I discard most of them. That is fine.
Re: AI coding at home without going broke
#175I feel like I must have plateued and don't know what to do next to level up. I'm currently on the $100/month codex plan and it seems fine using 5.5-xhigh all the time. I think of what to do next, have a chat session to determine exactly what to ask for up to the point of being ready to implement, and then codex churns on a commit-sized task whereupon I briefly check it on my local dev server. If necessary I ask for a…
I usually say run the full regression suite, all the simulator tests, install simulators and take a screenshot of every page on all applicable devices and do comprehensive fuzzing and chaos testing before I go to bed. It usually takes atleast 3-4 hours, usually longer, especially the UI/simulator tests.
In other words, isn't there a way to orchestrate this NOT as a long running token maxxing setup given that triggers and CI runs can be run deterministically.
disclaimer: I haven't done this, just interested.
Re: AI coding at home without going broke
#176Earlier quoted context omitted.
I recently in $COMPANY had a coworker try fable to do a refactor where not breaking anything was the game. It broke something at the first PR. I think we’re not there yet.
I've found that adding "Make no mistakes." to my prompt usually helps with this kind of problem...
Re: AI coding at home without going broke
#177I cannot figure out what people are doing to spend all this money. I have used a $60 per month Cursor plan on auto, and have never come close to using up my included usage, and I probably have it planning and coding and working for me all through the evenings 4 nights a week. What on earth are people doing differently that it's costing them so much? Maybe enabling on-demand usage or other paid models, or on higher mo…
Re: AI coding at home without going broke
#178> The first is to self host. You buy the machine, run open source models locally, and pay nothing per token after that. Power is not free. What I’ve found is that you’re basically paying a premium for privacy, and that’s worth it for me.
Re: AI coding at home without going broke
#179> The upfront cost is steep and the models you can actually run at home are weaker than what the frontier labs ship, so this only pays off if you can keep the rig busy with long running tasks where a slower, cheaper model grinds away overnight. Most people can’t keep a home machine that loaded, and the hardware you buy today may look like a bad bet in a year. Oh, so this is not a post about AI coding at home. It's ab…