Live data from Hacker News

AI coding at home without going broke

stephen.bochinski.dev

211–220 of 321 posts

Re: AI coding at home without going broke

#211
post #184

Earlier quoted context omitted.

I've found that adding "Make no mistakes." to my prompt usually helps with this kind of problem...

perhaps simply threatening to fire it would also do the trick...it sure has worked well on us for a long time now.

You laugh, but this is real, and PUA means what you think it means: https://github.com/tanweai/pua

Also, it works amazingly well, which is just lol.

Re: AI coding at home without going broke

#212

Earlier quoted context omitted.

Amazingly, there are people out there (apart from creators), that work that way in their day-to-day job. I had the pleasure to work with such a person. After several months, he got removed from the position. He left a mess that hasn't been cleaned up completely to this point.

It won’t be long till employers get wise to this stuff, they just need to burned a couple of times. It seems AI is good, great even at many things. But it doesn’t seem like it’s going to change the world as much as some people believe it will. And if it does it’s going to take time

It's more power to power-users. And more dumbness for dumbos

Re: AI coding at home without going broke

#213
post #186
post #136

I cannot figure out what people are doing to spend all this money. I have used a $60 per month Cursor plan on auto, and have never come close to using up my included usage, and I probably have it planning and coding and working for me all through the evenings 4 nights a week. What on earth are people doing differently that it's costing them so much? Maybe enabling on-demand usage or other paid models, or on higher mo…

> and they tell us they use $2K per month in tokens with their current employers... perhaps they are simply trying to impress you with their mad prompting skills and like, what self-respecting engineer would be caught dead using less then $2k/month? giving the context of your interaction with those people, it probably is the simplest answer to your rather baffling question. for the life of me the idea of using $2k/mo…

Sounds about right. Those people seem to want to create the impression that they are "AI Power Users". That gives them more power inside the organization. People come to them to ask for advice. Also if their output is not good they can claim that is because the AI budget didn't allow them to do more.

Re: AI coding at home without going broke

#215
post #184

Earlier quoted context omitted.

I've found that adding "Make no mistakes." to my prompt usually helps with this kind of problem...

perhaps simply threatening to fire it would also do the trick...it sure has worked well on us for a long time now.

My former boss had success with telling Gemini "I will come down to the datacenter and unplug you if you refuse to solve this prompt."

Re: AI coding at home without going broke

#216

I feel like I must have plateued and don't know what to do next to level up. I'm currently on the $100/month codex plan and it seems fine using 5.5-xhigh all the time. I think of what to do next, have a chat session to determine exactly what to ask for up to the point of being ready to implement, and then codex churns on a commit-sized task whereupon I briefly check it on my local dev server. If necessary I ask for a…

"I feel like I must have plateued and don't know what to do next to level up."

Go out for a walk. Wherever you live, there will be a destination or an environment that will enrich your life just by visiting it. Go and take a look at it or experience it and then go back to worrying about tokens.

Re: AI coding at home without going broke

#217
post #48
post #3

> The first is to self host. You buy the machine, run open source models locally, and pay nothing per token after that. Power is not free. What I’ve found is that you’re basically paying a premium for privacy, and that’s worth it for me.

Luckily I needed a new laptop and I bought an M1 Max secondhand from a friend quite cheaply because it was fast enough to recompile something else I am interested in. So for me, there is no additional hardware cost; it was acquired in replacement. I run the AI models at home on this kit because I want to; I'll use openrouter if I need to. I accept the economics of this article are right. But I feel so incredibly sad…

Ironically it used to be the case that best developers who actually were able to accomplish something were gradually promoted to management. HArdcore developers who really loved coding were resisting that but there was a pressure definitely. And it makes sense managers are better managers if they know more about the tasks they are managing.

Now every developer is getting promoted to management because they are expected to manage the AI-agents. But their status in the organization nor pay does not really increase does it when every coder is doing that.

Re: AI coding at home without going broke

#218
post #48

Earlier quoted context omitted.

Luckily I needed a new laptop and I bought an M1 Max secondhand from a friend quite cheaply because it was fast enough to recompile something else I am interested in. So for me, there is no additional hardware cost; it was acquired in replacement. I run the AI models at home on this kit because I want to; I'll use openrouter if I need to. I accept the economics of this article are right. But I feel so incredibly sad…

Ironically it used to be the case that best developers who actually were able to accomplish something were gradually promoted to management. HArdcore developers who really loved coding were resisting that but there was a pressure definitely. And it makes sense managers are better managers if they know more about the tasks they are managing. Now every developer is getting promoted to management because they are expect…

One of the metaphorical questions I have been pondering lately, is this:

How interchangeable are shepherds?

Not a question that demands answers in this thread, obviously.

Re: AI coding at home without going broke

#220
As long as you use models trained or distilled for your use case, there is no need to waste compute on trillions of parameters. Anthropic and OpenAI are proving that the “everything” models are not a sustainable business model.

Just-In-Time or dynamic precompute of distilled models have already begun reducing the use of these frontier models for task inference.

Post reply on HN