I haven't pushed out a full version[1] which uses ducklake-wasm + this to make a completely local SQL answering machine, but for now all it does is retype prompts in the browser.
The Prompt API
51–60 of 157 posts
Re: The Prompt API
#52This API seems perfect for an idea I've had for a while: a de-snarkifier for social media. Social media can be intellectually stimulating and educational, but it's also easy to get sucked into ideological sniping and flamewars, even if you didn't go looking for it. The emotional and intellectual energy spent flaming strangers on the Internet is a complete waste of human capital. With an API like this, I assume you co…
Also what is toxic to one person is not toxic to another depending on their subjective choices. How will you solve for this without everyone just seeing what they want to see even if reality is not like that? I feel that will just enhance the problems of social media than reduce it.
It kind of falls apart when you start to think of edge cases rather than "hey this tool will keep morons off my feed!" mentality
Re: The Prompt API
#53Earlier quoted context omitted.
This is the Soylent of written communication. Full nutritional value with an unremarkable flavor.
Are humans supposed to enjoy the "flavor" of diarrhea, as the result of giving every village idiot a microphone so they can spew shit from their mouths? Sure, you might say this sort of thing is boiling flavor out of your food, but... boiling the bacteria out of what you consume isn't a bad thing.
Re: The Prompt API
#54Earlier quoted context omitted.
I think it's an interesting idea to explore. But... It's the type of idea that is unpredictable as it comes into contact with reality. If it works, it probably works very differently from the initial idea of how it will work.
Yeah, I 100% agree with the caution in this comment. I see the merit in such a proposal. It's the linguistic equivalent to boiling the food you consume, instead of eating it raw with all the associated bad stuff. The problem is, as you said, that this plan is unlikely to be as rosy as it's portrayed and probably has a lot of drawbacks in real life. Interesting to think about and explore, though.
I mean... you would be basically taking a complex thing, transforming and reconstructing it. What we want out of social media isn't a simple, legible function. The positives. You'd have to discover them.
If someone starts building with the intitial idea above, my guess is that they'd end up with some sort of custom feed that draws inspiration and inputs from social media... but isn't social media. It's something else that you can scroll, read and whatnot.
Re: The Prompt API
#55Earlier quoted context omitted.
[dead]
I think the proposed extension would simply hide your comment, and all users would be better for it.
Half the reason people steelman others' arguments is for the emotional exercise of being able to accept opposing views. And you want to throw that away so you dont have to overcome a little friction in your day? Even though doing so improves you
Re: The Prompt API
#56Earlier quoted context omitted.
Are humans supposed to enjoy the "flavor" of diarrhea, as the result of giving every village idiot a microphone so they can spew shit from their mouths? Sure, you might say this sort of thing is boiling flavor out of your food, but... boiling the bacteria out of what you consume isn't a bad thing.
This is sanding the edges of off life. Its gonna make you soft
Re: The Prompt API
#57This API seems perfect for an idea I've had for a while: a de-snarkifier for social media. Social media can be intellectually stimulating and educational, but it's also easy to get sucked into ideological sniping and flamewars, even if you didn't go looking for it. The emotional and intellectual energy spent flaming strangers on the Internet is a complete waste of human capital. With an API like this, I assume you co…
Re: The Prompt API
#58Seems like a good way for a rogue JS script to offload token generation to a bunch of unsuspecting visitors It would actually be pretty interesting to see if its possible to decentralize the compute to generate something useful from a larger prompt broken down and sent to a bunch of browsers using a subagent pattern or something like RLM, each working on a smaller part of the prompt
This feels like a lot of work for low reward, the technical/business infrastructure would be wild. And if anyone wants to offload their prompts to users browsers, they might as well just use the Chrome API correctly? How many server side prompts would realistically be useful to offload to a low end model like this? Plus even if you really wanted to do that, WebGPU exists and has for a while right?
Edit: simple example is a spam bot
Re: The Prompt API
#59Earlier quoted context omitted.
> It works, I've shipped this as a "local inference"/poor person's ollama for low-end llm tasks like search fantastic! > the model download is orders of magnitude greater than downloading the browser itself, and something that needs to happen before you get your first token back sure but does this mean the model is lazily downloaded? that is, if I used this and I am the first time the model was called, the user would…
chrome://on-device-internals reports "Model Name: v3Nano Version: 2025.06.30.1229 Folder size: 4,072.13 MiB" on a random Windows machine I just checked.
Re: The Prompt API
#60Earlier quoted context omitted.
I think the proposed extension would simply hide your comment, and all users would be better for it.
Really? Not having to face any pushback would be better? Half the reason people steelman others' arguments is for the emotional exercise of being able to accept opposing views. And you want to throw that away so you dont have to overcome a little friction in your day? Even though doing so improves you