Live data from Hacker News

The Prompt API

developer.chrome.com

51–60 of 157 posts

Re: The Prompt API

#51
The better part of this is having a local-first AI, particularly because it has tool-calling builtin & structured output.

I haven't pushed out a full version[1] which uses ducklake-wasm + this to make a completely local SQL answering machine, but for now all it does is retype prompts in the browser.

[1] - https://notmysock.org/code/voice-gemini-prompt.html

Re: The Prompt API

#52

This API seems perfect for an idea I've had for a while: a de-snarkifier for social media. Social media can be intellectually stimulating and educational, but it's also easy to get sucked into ideological sniping and flamewars, even if you didn't go looking for it. The emotional and intellectual energy spent flaming strangers on the Internet is a complete waste of human capital. With an API like this, I assume you co…

Don't you think its better to just curate your social media and follow communities where the default is not toxicity? This is basically a distortion layer for reality and will just encourage more echo chambers.

Also what is toxic to one person is not toxic to another depending on their subjective choices. How will you solve for this without everyone just seeing what they want to see even if reality is not like that? I feel that will just enhance the problems of social media than reduce it.

It kind of falls apart when you start to think of edge cases rather than "hey this tool will keep morons off my feed!" mentality

Re: The Prompt API

#53
post #47

Earlier quoted context omitted.

This is the Soylent of written communication. Full nutritional value with an unremarkable flavor.

Are humans supposed to enjoy the "flavor" of diarrhea, as the result of giving every village idiot a microphone so they can spew shit from their mouths? Sure, you might say this sort of thing is boiling flavor out of your food, but... boiling the bacteria out of what you consume isn't a bad thing.

This is sanding the edges of off life. Its gonna make you soft

Re: The Prompt API

#54
post #50
post #39

Earlier quoted context omitted.

I think it's an interesting idea to explore. But... It's the type of idea that is unpredictable as it comes into contact with reality. If it works, it probably works very differently from the initial idea of how it will work.

Yeah, I 100% agree with the caution in this comment. I see the merit in such a proposal. It's the linguistic equivalent to boiling the food you consume, instead of eating it raw with all the associated bad stuff. The problem is, as you said, that this plan is unlikely to be as rosy as it's portrayed and probably has a lot of drawbacks in real life. Interesting to think about and explore, though.

I wasn't even talking about drawbacks, though that applies too.

I mean... you would be basically taking a complex thing, transforming and reconstructing it. What we want out of social media isn't a simple, legible function. The positives. You'd have to discover them.

If someone starts building with the intitial idea above, my guess is that they'd end up with some sort of custom feed that draws inspiration and inputs from social media... but isn't social media. It's something else that you can scroll, read and whatnot.

Re: The Prompt API

#55

Earlier quoted context omitted.

[dead]

I think the proposed extension would simply hide your comment, and all users would be better for it.

Really? Not having to face any pushback would be better?

Half the reason people steelman others' arguments is for the emotional exercise of being able to accept opposing views. And you want to throw that away so you dont have to overcome a little friction in your day? Even though doing so improves you

Re: The Prompt API

#56
post #53
post #47

Earlier quoted context omitted.

Are humans supposed to enjoy the "flavor" of diarrhea, as the result of giving every village idiot a microphone so they can spew shit from their mouths? Sure, you might say this sort of thing is boiling flavor out of your food, but... boiling the bacteria out of what you consume isn't a bad thing.

This is sanding the edges of off life. Its gonna make you soft

Sign me up

Re: The Prompt API

#57

This API seems perfect for an idea I've had for a while: a de-snarkifier for social media. Social media can be intellectually stimulating and educational, but it's also easy to get sucked into ideological sniping and flamewars, even if you didn't go looking for it. The emotional and intellectual energy spent flaming strangers on the Internet is a complete waste of human capital. With an API like this, I assume you co…

For YouTube, this already exists and I‘m using it. The extension is caller DeArrow and aims to reduce sensationalism via crowdsourcing, though I wouldn’t be surprised if top contributors are bots using LLMs.

Re: The Prompt API

#58
post #8

Seems like a good way for a rogue JS script to offload token generation to a bunch of unsuspecting visitors It would actually be pretty interesting to see if its possible to decentralize the compute to generate something useful from a larger prompt broken down and sent to a bunch of browsers using a subagent pattern or something like RLM, each working on a smaller part of the prompt

This feels like a lot of work for low reward, the technical/business infrastructure would be wild. And if anyone wants to offload their prompts to users browsers, they might as well just use the Chrome API correctly? How many server side prompts would realistically be useful to offload to a low end model like this? Plus even if you really wanted to do that, WebGPU exists and has for a while right?

Nefarous use cases. Run that on some suckers machine.

Edit: simple example is a spam bot

Re: The Prompt API

#59

Earlier quoted context omitted.

> It works, I've shipped this as a "local inference"/poor person's ollama for low-end llm tasks like search fantastic! > the model download is orders of magnitude greater than downloading the browser itself, and something that needs to happen before you get your first token back sure but does this mean the model is lazily downloaded? that is, if I used this and I am the first time the model was called, the user would…

chrome://on-device-internals reports "Model Name: v3Nano Version: 2025.06.30.1229 Folder size: 4,072.13 MiB" on a random Windows machine I just checked.

Thank You stranger! I would have assumed the size would vary based on whether your hardware supports the high-quality GPU backend (4 GB) or defaults to a smaller CPU-compatible version (3 GB) but the 22GB note on that page is really confusing. Even if it was including the model server where's the remaining 18GB going towards?

Re: The Prompt API

#60
post #55

Earlier quoted context omitted.

I think the proposed extension would simply hide your comment, and all users would be better for it.

Really? Not having to face any pushback would be better? Half the reason people steelman others' arguments is for the emotional exercise of being able to accept opposing views. And you want to throw that away so you dont have to overcome a little friction in your day? Even though doing so improves you

I think pushback is different from snarky and/or aggressive. The devil's in the details I can imagine many ways to disagree with someone that would get past this tool as described.
Post reply on HN