11–20 of 42 posts
This is very convenient and nice! But I could not get it to work with the best small models available for Ollama for programming, like https://ollama.com/MFDoom/deepseek-coder-v2-tool-calling for example.
This is very convenient and nice! But I could not get it to work with the best small models available for Ollama for programming, like https://ollama.com/MFDoom/deepseek-coder-v2-tool-calling for example.
Was the model too big to run locally?
That’s one of the reasons I went with phi-4-mini - surprisingly high quality for its size and speed. It handled multi-step reasoning, math, structured data extraction, and code pretty well, all on modest hardware. Phi-1.5 / Phi-2 (quantized versions) also run on raspberry pi as others have demonstrated.
This is very convenient and nice! But I could not get it to work with the best small models available for Ollama for programming, like https://ollama.com/MFDoom/deepseek-coder-v2-tool-calling for example.
That's a really old model now. Even the old Qwen 2.5 coder 32b model is better than DSv2
Without any changes, you can already use Codex with a remote or local API by setting base URL and key environment variables.
Without any changes, you can already use Codex with a remote or local API by setting base URL and key environment variables.
i think this was made before that PR was merged into codex.
So this isn't really codex then?