Live data from Hacker News

Language models on the command line

simonwillison.net

1–10 of 46 posts

Re: Language models on the command line

#3
I wish llm were more stable, but unfortunately things just kept breaking out of the blue without me touching any settings of the program. I often had to reinstall the package. but finally I gave up and implemented my own.

Re: Language models on the command line

#4
post #3

I wish llm were more stable, but unfortunately things just kept breaking out of the blue without me touching any settings of the program. I often had to reinstall the package. but finally I gave up and implemented my own.

Which plugins are you using? Did you install via pipx or Homebrew or something else?

Re: Language models on the command line

#5
This was a workshop I gave in my https://llm.datasette.io/ CLI tool.

What other CLI tools are people using to work with LLMs in the terminal?

There one comment here about https://github.com/paul-gauthier/aider and Ollama is probably the most widely used CLI tool at the moment: https://github.com/ollama/ollama/blob/main/README.md#quickst...

Re: Language models on the command line

#6
post #4
post #3

I wish llm were more stable, but unfortunately things just kept breaking out of the blue without me touching any settings of the program. I often had to reinstall the package. but finally I gave up and implemented my own.

Which plugins are you using? Did you install via pipx or Homebrew or something else?

I used pipx and used AnthropicAI's plugin to use Claude. After 2 weeks of perfectly working, suddenly I got the "this model is invalid" error.

PS: I appreciate the work put into llm tho, it's a neat program I used with my Automator scripts to bring LLMs to macOS before Apple Intelligence was announced. I just wish the stability was not a concern.

Re: Language models on the command line

#7
This is awesome, thanks for sharing. I find this kind of tool really useful, Aider in particular. I made my own cli tool for interacting with GPT. It’s really useful with the -c flag for generating code especially bash commands I've forgotten

https://github.com/ljsimpkin/chat-gpt-cli-tool

Re: Language models on the command line

#8
post #5

This was a workshop I gave in my https://llm.datasette.io/ CLI tool. What other CLI tools are people using to work with LLMs in the terminal? There one comment here about https://github.com/paul-gauthier/aider and Ollama is probably the most widely used CLI tool at the moment: https://github.com/ollama/ollama/blob/main/README.md#quickst...

> What other CLI tools are people using to work with LLMs in the terminal?

I use aichat: https://github.com/sigoden/aichat

I especially like the terminal integration where I can type a natural language request at the terminal and press Alt+E to have it converted to a command to run.

Re: Language models on the command line

#9
post #6
post #4

Earlier quoted context omitted.

Which plugins are you using? Did you install via pipx or Homebrew or something else?

I used pipx and used AnthropicAI's plugin to use Claude. After 2 weeks of perfectly working, suddenly I got the "this model is invalid" error. PS: I appreciate the work put into llm tho, it's a neat program I used with my Automator scripts to bring LLMs to macOS before Apple Intelligence was announced. I just wish the stability was not a concern.

The plugins seem to need to be reinstalled after every upgrade

Re: Language models on the command line

#10
post #5

This was a workshop I gave in my https://llm.datasette.io/ CLI tool. What other CLI tools are people using to work with LLMs in the terminal? There one comment here about https://github.com/paul-gauthier/aider and Ollama is probably the most widely used CLI tool at the moment: https://github.com/ollama/ollama/blob/main/README.md#quickst...

(aichat in tangential comment looks much better) Besides aider and ollama, I think shell_gpt https://github.com/TheR1D/shell_gpt is great for quick chats / lookups. Being able to quickly cat files to repl sessions saves a lot of time.

I need to integrate distil whisper large v3, aider, and shell_gpt to tidy up a lot of my disjointed LLM use. As someone else mentioned, the commits created by aider allow me to "skip" some intermediate steps that would be required when working on coding tasks with other frameworks.

Post reply on HN