Live data from Hacker News

How to setup a local coding agent on macOS

ikyle.me

141–150 of 150 posts

Re: How to setup a local coding agent on macOS

#141

Earlier quoted context omitted.

this is the way, given anyone could swap for oh my pi / pi / etc

yes, whether for home experiments or at work, it is good practice (good hygiene) to be able to swap out both agentic harnesses and models. It is important to have a good strategy for exporting skills, etc.

yeah, I am using Pi right now, I switched from OpenCode

Re: How to setup a local coding agent on macOS

#143
post #102
post #5

I wrote a similar post some time ago just used ollama and opencode https://blog.kulman.sk/running-local-llm-coding-server/

Ollama is not a good choice - https://sleepingrobots.com/dreams/stop-using-ollama/ As for oprncode, doesn't the system prompt eat too much of the context? Local models are really constraint in regards contex, and opencode AFAIR uses a 10k of it or some thing close.

Ollama seems fine to me, technically. it works. why wouldn't someone use it? Because someone else doesn't like it? if it cost money, I'd pay more attention to the people behind it, but I don't, so I don't.

I wish people would stop wasting their outrage budget on things like this and pay more attention to politics.

Re: How to setup a local coding agent on macOS

#144
post #102

Earlier quoted context omitted.

Ollama is not a good choice - https://sleepingrobots.com/dreams/stop-using-ollama/ As for oprncode, doesn't the system prompt eat too much of the context? Local models are really constraint in regards contex, and opencode AFAIR uses a 10k of it or some thing close.

Ollama seems fine to me, technically. it works. why wouldn't someone use it? Because someone else doesn't like it? if it cost money, I'd pay more attention to the people behind it, but I don't, so I don't. I wish people would stop wasting their outrage budget on things like this and pay more attention to politics.

Focusing outrage on politics is pointless.

Technical people are rather good at learning new things, and ollama situation is a good learning experience.

llama.cpp gets you more tokens/s even if you ignore ollama team bad behavior.

Re: How to setup a local coding agent on macOS

#145
post #141

Earlier quoted context omitted.

yes, whether for home experiments or at work, it is good practice (good hygiene) to be able to swap out both agentic harnesses and models. It is important to have a good strategy for exporting skills, etc.

yeah, I am using Pi right now, I switched from OpenCode

I'm considering this right now. Is it very difficult to adapt to the new philosophy? Are you running mostly interactive or programmatic?

Re: How to setup a local coding agent on macOS

#146
post #141

Earlier quoted context omitted.

yeah, I am using Pi right now, I switched from OpenCode

I'm considering this right now. Is it very difficult to adapt to the new philosophy? Are you running mostly interactive or programmatic?

What do you mean by new philosophy? I use Pi the same way I used gpt or sonnet, just for simpler tasks.

Re: How to setup a local coding agent on macOS

#147
post #146

Earlier quoted context omitted.

I'm considering this right now. Is it very difficult to adapt to the new philosophy? Are you running mostly interactive or programmatic?

What do you mean by new philosophy? I use Pi the same way I used gpt or sonnet, just for simpler tasks.

Pi is an agent, gpt and sonnet are LLMs. Opencode is an agent, and has a drastically different philosophy than Pi.

FWIW, I took the dive on Pi today and I’m really happy with my decision so far

Re: How to setup a local coding agent on macOS

#148

Earlier quoted context omitted.

That was exactly my same question. Then I finished reading the post. The reason is pretty clear, and written in the post: it is faster than ollama+mlx.

how much faster?

All I remember is that it's pretty clear written in the post...

Re: How to setup a local coding agent on macOS

#149
post #146

Earlier quoted context omitted.

What do you mean by new philosophy? I use Pi the same way I used gpt or sonnet, just for simpler tasks.

Pi is an agent, gpt and sonnet are LLMs. Opencode is an agent, and has a drastically different philosophy than Pi. FWIW, I took the dive on Pi today and I’m really happy with my decision so far

Yeah, I meant using Pi with the local qwen model vs when I was using claude with sonnet or codex with gpt

Re: How to setup a local coding agent on macOS

#150
post #144

Earlier quoted context omitted.

Ollama seems fine to me, technically. it works. why wouldn't someone use it? Because someone else doesn't like it? if it cost money, I'd pay more attention to the people behind it, but I don't, so I don't. I wish people would stop wasting their outrage budget on things like this and pay more attention to politics.

Focusing outrage on politics is pointless. Technical people are rather good at learning new things, and ollama situation is a good learning experience. llama.cpp gets you more tokens/s even if you ignore ollama team bad behavior.

Political outrage is only pointless (in the cases when it is actually pointless), because not enough people get outraged.

Politicians count on your apathy so they can get away with their horseshit. You paying attention is kryptonite to crooked politicians.

Post reply on HN