Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Light like the Terminal – Meet GTK LLM Chat Front End

github.com

Post reply on HN
Print view View original

1–10 of 15 posts

Show HN: Light like the Terminal – Meet GTK LLM Chat Front End

#1

Post by icarito »

Author here. I wanted to keep my conversation with #Gemini about code handy while discussing something creative with #ChatGPT and using #DeepSeek in another window. I think it's a waste to have Electron apps and so wanted to chat with LLMs on my own terms. When I discovered the llm CLI tool I really wanted to have convenient and pretty looking access to my conversations, and so I wrote gtk-llm-chat - a plugin for llm that provides an applet and a simple window to interact with LLM models.

Make sure you've configure llm first (https://llm.datasette.io/en/stable/)

I'd love to get feedback, PRs and who knows, perhaps a coffee! https://buymeacoffee.com/icarito

Show HN: Light like the Terminal – Meet GTK LLM Chat Front End
github.com

Re: Show HN: Light like the Terminal – Meet GTK LLM Chat Front End

#3

Post by icarito »

Gracana wrote: post #2

This looks quite nice. I would like to see the system prompt and inference parameters exposed in the UI, because those are things I'm used to fiddling with in other UIs. Is that something that the llm library supports?

Yeah absolutely, I've just got to point where I'm happy with the architecture so I'll continue to add UI. I've just added support for fragments and I've thought to add them as if they were attached documents. I've in the radar to switch models in mid conversation and perhaps the ability to rollback a conversation or remove some messages. But yeah, system prompt and parameters would be nice to move too! Thanks for the suggestions!

Re: Show HN: Light like the Terminal – Meet GTK LLM Chat Front End

#4

Post by guessmyname »

It’d be better if it was written in C or at least Vala. With Python, you have to wait a couple hundred milliseconds for the interpreter to start, which makes it feel less native than it can be. That said, the latency of the LLM responses is higher than the UI, so I guess the slowness of Python doesn’t matter.

Re: Show HN: Light like the Terminal – Meet GTK LLM Chat Front End

#5

Post by icarito »

guessmyname wrote: post #4

It’d be better if it was written in C or at least Vala. With Python, you have to wait a couple hundred milliseconds for the interpreter to start, which makes it feel less native than it can be. That said, the latency of the LLM responses is higher than the UI, so I guess the slowness of Python doesn’t matter.

Yeah I agree, I've been thinking about using Rust. But ultimately it's a problem with GTK3 vs GTK4 too because if we could reuse the Python interpreter from the applet that would speed things up but GTK4 doesn't have support for AppIndicator icons(!).

I've been pondering whether to backport to GTK3 for this sole purpose. I find that after the initial delay to startup the app, its speed is okay...

Porting to Rust is not really planned because I'd loose the llm-python base - but still something that triggers my curiosity.

Re: Show HN: Light like the Terminal – Meet GTK LLM Chat Front End

#6

Post by Gracana »

icarito wrote: post #3
Gracana wrote: post #2

This looks quite nice. I would like to see the system prompt and inference parameters exposed in the UI, because those are things I'm used to fiddling with in other UIs. Is that something that the llm library supports?

Yeah absolutely, I've just got to point where I'm happy with the architecture so I'll continue to add UI. I've just added support for fragments and I've thought to add them as if they were attached documents. I've in the radar to switch models in mid conversation and perhaps the ability to rollback a conversation or remove some messages. But yeah, system prompt and parameters would be nice to move too! Thanks for the…

Awesome. It would be great to see a nice gtk-based open source competitor to lm-studio and the like.

Re: Show HN: Light like the Terminal – Meet GTK LLM Chat Front End

#7

Post by cma »

guessmyname wrote: post #4

It’d be better if it was written in C or at least Vala. With Python, you have to wait a couple hundred milliseconds for the interpreter to start, which makes it feel less native than it can be. That said, the latency of the LLM responses is higher than the UI, so I guess the slowness of Python doesn’t matter.

What's the startup time now with 9950X3D, after a prior start so the pyc's are cached in RAM?

Re: Show HN: Light like the Terminal – Meet GTK LLM Chat Front End

#8

Post by icarito »

cma wrote: post #7
guessmyname wrote: post #4

It’d be better if it was written in C or at least Vala. With Python, you have to wait a couple hundred milliseconds for the interpreter to start, which makes it feel less native than it can be. That said, the latency of the LLM responses is higher than the UI, so I guess the slowness of Python doesn’t matter.

What's the startup time now with 9950X3D, after a prior start so the pyc's are cached in RAM?

I wonder! In my more modest setup, it takes a couple of seconds perhaps. After that it's quite usable.
Post reply on HN