Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: My LLM CLI tool can run tools now, from Python code or plugins

simonwillison.net

Post reply on HN
Print view View original

61–70 of 178 posts

Re: Show HN: My LLM CLI tool can run tools now, from Python code or plugins

#61

Post by nlh »

Ok this is great and perfect timing -- I've been playing around with Warp (the terminal) and while I love the idea of their terminal-based "agent" (eg tool loop), I don't love the whole Cursor-esque model of "trust us we'll make a good prompt and LLM calls for you" (and charge you for it), so I was hoping for a simple CLI-based terminal agent just to solve for my lack of shell-fu.

I am keenly aware this is a major footgun here, but it seems that a terminal tool + llm would be a perfect lightweight solution.

Is there a way to have llm get permission for each tool call the way other "agents" do this? ("llm would like to call `rm -rf ./*` press Y to confirm...")

Would be a decent way to prevent letting an llm run wild on my terminal and still provide some measure of protection.

Re: Show HN: My LLM CLI tool can run tools now, from Python code or plugins

#62

Post by varyherb »

sorenjan wrote: post #8

Every time I update llm I have to reinstall all plugins, like gemini and ollama. My Gemini key is still saved, as are my aliases for my ollama models, so I don't get why the installed plugins are lost.

I was running into this too until I started upgrading with

llm install -U llm

instead of

uv tool upgrade llm

(the latter of which is recommended by simonw in the original post)

Re: Show HN: My LLM CLI tool can run tools now, from Python code or plugins

#63

Post by roxolotl »

Simon thank you so much for this tool! I use it daily now since charmbraclet’s Mods[0] doesn’t support anthropics models. And now with tool calling it’ll be even more useful. I am curious though if there’s any appetite for improving performance? It’s noticeably slow to even just print the help on all of my machines(M1 32gb/M2 21g/ryzen 7700 64gb).

0: https://github.com/charmbracelet/mods

Re: Show HN: My LLM CLI tool can run tools now, from Python code or plugins

#64

Post by simonw »

roxolotl wrote: post #63

Simon thank you so much for this tool! I use it daily now since charmbraclet’s Mods[0] doesn’t support anthropics models. And now with tool calling it’ll be even more useful. I am curious though if there’s any appetite for improving performance? It’s noticeably slow to even just print the help on all of my machines(M1 32gb/M2 21g/ryzen 7700 64gb). 0: https://github.com/charmbracelet/mods

How many plugins do you have installed?

We've seen problems in the past where plugins with expensive imports (like torch) slow everything down a lot: https://github.com/simonw/llm/issues/949

I'm interested in tracking down the worst offenders and encouraging them to move to lazy imports instead.

Re: Show HN: My LLM CLI tool can run tools now, from Python code or plugins

#65

Post by hanatanaka1984 »

kristopolous wrote: post #45

It's worth noting the streaming markdown renderer I wrote just for this tool: https://github.com/day50-dev/Streamdown More background: https://github.com/simonw/llm/issues/12 (Also check out https://github.com/day50-dev/llmehelp which features a tmux tool I built on top of Simon's llm. I use it every day. Really. It's become indispensable)

Interesting, I will be sure to check into this. I have been using llm and bat with syntax highlighting.

Re: Show HN: My LLM CLI tool can run tools now, from Python code or plugins

#66

Post by kristopolous »

hanatanaka1984 wrote: post #65
kristopolous wrote: post #45

It's worth noting the streaming markdown renderer I wrote just for this tool: https://github.com/day50-dev/Streamdown More background: https://github.com/simonw/llm/issues/12 (Also check out https://github.com/day50-dev/llmehelp which features a tmux tool I built on top of Simon's llm. I use it every day. Really. It's become indispensable)

Interesting, I will be sure to check into this. I have been using llm and bat with syntax highlighting.

Do you just do

| bat --language=markdown --force-colorization ?

Re: Show HN: My LLM CLI tool can run tools now, from Python code or plugins

#68

Post by andresnds »

nlh wrote: post #61

Ok this is great and perfect timing -- I've been playing around with Warp (the terminal) and while I love the idea of their terminal-based "agent" (eg tool loop), I don't love the whole Cursor-esque model of "trust us we'll make a good prompt and LLM calls for you" (and charge you for it), so I was hoping for a simple CLI-based terminal agent just to solve for my lack of shell-fu. I am keenly aware this is a major fo…

Isn’t that how the default way codex CLI runs? I.e. without passing —full-auto

Re: Show HN: My LLM CLI tool can run tools now, from Python code or plugins

#69

Post by th0ma5 »

pvg wrote: post #24
th0ma5 wrote: post #11

Earlier quoted context omitted.

I don't know the context that could be cordial when there is so much outright dishonesty about the state of LLM uptake. Can we have some guidance about how to call out bullshit? I know that the fake it to you make it or sell the shovels to the gold rush people are staples on here, but I don't what to do with a technology that is purely for that and seemingly for nothing else. Why do all of the breathless pro-LLM post…

Can we have some guidance about how to call out bullshit? That's right in the site docs linked above which you should check out.

I guess I'll need clarification -- getting trapped in a non-productive quagmire is the experience of a lot of people. The author chooses when to use terms in different contexts to get out of arguments ... and also, we still don't have any good way to test these things, so I'm not sure where I'm running afoul of the rules when it seems like everyone else is.

Re: Show HN: My LLM CLI tool can run tools now, from Python code or plugins

#70

Post by nbbaier »

kristopolous wrote: post #45

It's worth noting the streaming markdown renderer I wrote just for this tool: https://github.com/day50-dev/Streamdown More background: https://github.com/simonw/llm/issues/12 (Also check out https://github.com/day50-dev/llmehelp which features a tmux tool I built on top of Simon's llm. I use it every day. Really. It's become indispensable)

Ohh I've wanted this so much! Thank you!
Post reply on HN