Live data from Hacker News

How I code with AI on a budget/free

wuu73.org

91–100 of 251 posts

Re: How I code with AI on a budget/free

#91
post #74

I am the person that wrote that. Sorry about the font. This is a bit outdated, AI stuff goes at high speed. More models so I will try to update that. Every month so many new models come out. My new fav is GLM-4.5... Kimi K2 is also good, and Qwen3-Coder 480b, or 2507 instruct.. very good as well. All of those work really well in any agentic environment/in agent tools. I made a context helper app ( https://wuu73.org/a…

Have you seen Microsoft's copilot? It is essentially free openai models

And to anyone who has ever used it, it appears more like opening smoothbrain. For a long time it was the only allowed model at work and even for basic cyber security questions it was sometimes completely useless.

I would not recommend it to anyone.

Re: How I code with AI on a budget/free

#93
post #20
post #15

Earlier quoted context omitted.

Gemini 2.5 pro free limit is 100 requests per day. https://ai.google.dev/gemini-api/docs/rate-limits

Doesn't it swap to a lower power model after that?

Not automatically but you can switch to a lower power model and access more free requests. I think Gemini 2.5 Flash is 250 requests per day.

Re: How I code with AI on a budget/free

#94
post #53

I think there’s huge potential for a fully local “Cursor-like” stack — no cloud, no API keys, just everything running on your machine. The setup could be: • Cursor CLI for agentic/dev stuff (example: https://x.com/cursor_ai/status/1953559384531050724 ) • A local memory layer compatible with the CLI — something like LEANN (97% smaller index, zero cloud cost, full privacy, https://github.com/yichuan-w/LEANN ) or Milvus…

[flagged]

Re: How I code with AI on a budget/free

#95
post #37

I wonder how much energy this is wasting.

Probably not as much as you think: https://www.sustainabilitybynumbers.com/p/ai-energy-demand You are better off worrying about your car use and your home heating/cooling efficiency, all of which are significantly worse for energy use.

> You’ll notice that this figure is for 2022, and we’ve had a major AI boom since then

I might as well read LLM gibberish instead of this article.

Re: How I code with AI on a budget/free

#97

I am the person that wrote that. Sorry about the font. This is a bit outdated, AI stuff goes at high speed. More models so I will try to update that. Every month so many new models come out. My new fav is GLM-4.5... Kimi K2 is also good, and Qwen3-Coder 480b, or 2507 instruct.. very good as well. All of those work really well in any agentic environment/in agent tools. I made a context helper app ( https://wuu73.org/a…

Note that the website is scrolling very slow, sub1-fps on Firefox Android. I'm also unable to scroll the call-out about grok. Also, there's this strange large green button reading CSS loaded at the top.

Re: How I code with AI on a budget/free

#98
post #9

My experience lines up with the article. The agentic stuff only works with the biggest models. (Well, "works"... OpenAI Codex took 200 requests with o4-mini to change like 3 lines of code...) For simple changes I actually found smaller models better because they're so much faster. So I shifted my focus from "best model" to "stupidest I can get away with". I've been pushing that idea even further. If you give up on ag…

I am developing the same opinion. I want something fast and dependable. Getting into a flow state is important to me, and I just can't do that when I'm waiting for an agentic coding assistant to terminate. I'm also interested in smaller models for their speed. That, or a provider like Cerebras. Then, if you narrow the problem domain you can increase the dependability. I am curious to hear more about your "surgical" t…

well, most of the time, I just dump the entire codebase in if the context window is big and its a good model. But there are plenty of times when I need to block one folder in a repo or disable a few files because the files might "nudge" it in a wrong direction.

The surgical context tool (aicodeprep-gui) - there are at least 30 similar tools but most (if not all) are CLI only/no UI. I like UIs, I work faster with them for things like choosing individual files out of a big tree (at least it is using PySide6 library which is "lite" (could go lighter maybe), i HATE that too many things use webview/browsers. All the options on it are there for good reasons, its all focused on things that annoy me..and slow things down: like doing something repeatedly (copy paste copy paste or typing the same sentence over and over every time i have to do a certain thing with the AI and my code.

If you have not run 'aicp' (the command i gave it, but also there is a OS installer menu that will add a Windows/Mac/Linux right click context menu in their file managers) in a folder before, it will try to scan recursively to find code files, but it skips things like node_modules or .venv. but otherwise assumes most types of code files will probably be added so it checks them. You can fine tune it, add some .md or txt files or stuff in there that isn't code but might be helpful. When you generate the context block it puts the text inside the prompt box on the top AND/OR bottom - doing both can get better responses from AI.

It saves every file that is checked, and saves the window size, other window prefs, so you don't have to resize the window again. It saves the state of which files are checked so its less work / time next time. I have been just pasting the output from the LLMs into an agent like Cline but I am wondering if I should add browser automation / browser extension that does the copy pasting and also add option to edit / change files right after grabbing the output from a web chat. Its probably about good enough as it is though, not sure I want to make it into a big thing.

--- Yeah I just keep coming back to this workflow, its very reliable. I have not tried Claude Code yet but I will soon to see if they solved any of these problems.

Strange this thing has been at the top of hacker news for hours and hours.. weird! My server logs are just constant scrolling

Re: How I code with AI on a budget/free

#100
post #9

My experience lines up with the article. The agentic stuff only works with the biggest models. (Well, "works"... OpenAI Codex took 200 requests with o4-mini to change like 3 lines of code...) For simple changes I actually found smaller models better because they're so much faster. So I shifted my focus from "best model" to "stupidest I can get away with". I've been pushing that idea even further. If you give up on ag…

I agree. I find even Haiku good enough at managing the flow of the conversation and consulting larger models - Gemini 2.5 Pro or GPT-5 - for programming tasks.

Last few days I am experimenting with using Codex (via MCP ${codex mcp}) from Gemini CLI and it works like a charm. Gemini CLI is mostly using Flash underneath but this is good enough for formulating problems and re-evaluating answers.

Same with Claude Code - I am asking (via MCP) for consulting with Gemini 2.5 Pro.

Never had much success of using Claude Code as MCP though.

The original idea comes of course from Aider - using main, weak and editor models all at once.

Post reply on HN