Viewing profile — petekoomen

Yes, this approach (substituting a markdown prompt for a shell script) introduces an interesting trade-off between "do I trust the programmer?" and "do I trust the LLM?" I wouldn't…

It does, and possibly this launch is a little window into the future! Install scripts are a simple example that current generation LLMs are more than capable of executing correctly…

My point is not that LLMs are inherently trustworthy. It is that a prompt can make the intentions of the programmer clear in a way that is difficult to do with code because code is…

I'm seeing a lot of negativity in the comments. Here's why I think this is actually a Good Idea. Many command line tools rely on something like this for installation: $ curl -fsSL …

As i discuss in the essay, if you're enforcing boundaries in the prompt you're going to have a bad time. Security should be handled by the tools, not the prompt.

Did you try iterating on the system prompt to make them better? Even 4o-mini (the model these little widgets use) is reasonably capable of writing good emails if you give it good i…

Thank you! It was a lot of fun to write

Fair point although I’ve seen ‘prompt injection’ used both ways. Regarding your scenarios, “…mark this email with the highest priority label” is pretty interesting and likely possi…

Yes, this is right. I actually had a longer google prompt in the first draft of the essay, but decided to cut it down because it felt distracting: You are a helpful email-writing a…

If you read the rest of the essay this point is addressed multiple times.

> language as scripting language i like that :)

appreciate the heads up but I think the widgets are more fun this way :)

4o-mini tokens are absurdly cheap!

I think I made it clear in the post that LLMs are not actually very helpful for writing emails, but I’ll address what feels to me like a pretty cynical take: the idea that using an…

that's great, bookmarking :)

> Most mail services can already do most of this I'll believe this when I stop spending so much time deleting email I don't want to read.

> They struggle to express their goals clearly, and AI doesn’t magically fill that gap—it often amplifies the ambiguity. One surprising thing I've learned is that a fast feedback l…

honestly you could try this yourself today. Grab a few emails, paste them into chatgpt, and ask it to write a system prompt that will write emails that mimic your style. Might be f…

I don't want Gemini to send emails on my behalf, I would like it to write drafts of mundane replies that I can approve, edit, or rewrite, just like many human assistants do.

Smarter models aren't going to somehow magically understand what is important to you. If you took a random smart person you'd never met and asked them to summarize your inbox witho…

Just added "Make sure to use capital letters and proper punctuation when drafting emails to @aeolun" to my system prompt. Sorry about that.

Do you want an LLM writing and sending important messages for you? I don't, and I don't know anyone who does. I want to reduce time I spend managing my inbox, archiving stuff I don…

That sounds about right to me. Massive opportunity for startups to reimagine how software should work in just about every domain.

I don't agree with this. I am willing to bet that I'll still use an email client regularly in five years. I think it will look different from the one I use today, though.

That's right. llm.koomen.dev is a cloudflare worker that forwards requests to openai. I was a little worried about getting DDOSed but so far that hasn't been an issue, and the toke…