Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

The Prompt API

developer.chrome.com

Post reply on HN
Print view View original

121–130 of 157 posts

Re: The Prompt API

#121

Post by gruez »

masfuerte wrote: post #116
gruez wrote: post #106

Earlier quoted context omitted.

>I can see applications for this being things like "while device is at rest and charging summarize all of the users recent text communications" or whatever else as a legal loop hole for wiretap laws This just exposes an API for sites to use. If they wanted to do the types of spying you're cynically suggesting, they could just add it without an API and you'd be none the wiser. Chrome contains closed source components…

Do you think no-one would notice that the Chrome download was 20GB larger?

Who says they'll be using the 20GB model? You'd hardly need frontier level intelligence to detect CSAM or ad keywords. Moreover, it's downloaded on first use, not bundled with the browser, so you won't really notice unless you're checking the chrome user data directory, but that also contains caches and other site data you'd likely chalk it up to random sites.

Re: The Prompt API

#123

Post by zozbot234 »

bavell wrote: post #117
zozbot234 wrote: post #88

Earlier quoted context omitted.

Ultimately it would amount to lazy-loading the model, but the parameters themselves would be fetched from the network as needed, which still decreases time-to-first-token. It's true that "expert" choices will span most of the model, regardless of any particular "subject" or "topic" choice, but if we simply care about time-to-first-token it's still a viable strategy.

Perhaps you could generate a few tokens before the entire model is downloaded, but since every token takes a potentially different "path" through an MoE model, you'd still need to wait for the entire download before getting deeper than a handful of tokens... which is not really a UX improvement imo.

Even at its worst, it's a minor UX improvement compared to having to download everything prior to getting to the first token. Ultimately we will complete the download, but we can still pick the best priority so that the first handful of tokens goes through.

Re: The Prompt API

#124

Post by paganel »

aembleton wrote: post #99
paganel wrote: post #67

Earlier quoted context omitted.

> operating systems start reliably shipping their own prebaked models Here's to hoping that that dystopia will never happen.

Would it be less dystopian for Operating Systems to ship with their own browser that ships with their own models? Or do you find the current situation where Operating Systems ship with browsers dystopian?

I find the very idea of this AI thing making its way through like a virus onto our computer systems (either in centralised form, as it mostly happens now, or installed locally, like this article writes about) quite dystopian. On the other hand I do not find the idea of the Internet browser as dystopian (even though a data and corporate behemoth like Alphabet being the entity behind Chrome is indeed dystopian, I agree on that).

On a second thought you're on to something, maybe if we hadn't let the Internet browser take over our computer-lives as much as it did in the last 20 or so years then Chrome (under its current manifestation, that is) wouldn't have happened. At least we are now aware of the dangers awaiting in front of us when it comes to AI.

Re: The Prompt API

#125

Post by ljm »

haberman wrote: post #42
nsilvestri wrote: post #34

Earlier quoted context omitted.

This is the Soylent of written communication. Full nutritional value with an unremarkable flavor.

That is unironically exactly what I want from social media. I want the option to engage with the substance of new developments in the world, technology, etc. without the drama. I don't want to be drawn into the drama of strangers (who could, for all I know, just be bots or ragebaiting AIs). If I want drama, there's plenty of it on TV, or I could talk to my friends about what is going on with people I actually know. T…

I would really just like the quirkier internet of old.

Flamewars these days are just created by shit-stirrers in another country who are just pumping out rage bait from an massive array of smartphones. It's not even an impassioned flamewar, it simply exists to aggravate.

Using AI to forcefully disengage by simply suppressing that content would be nice and also have the secondary effect of depriving various internet resources of ad revenue.

Re: The Prompt API

#126

Post by whatarethembits »

contagiousflow wrote: post #114
whatarethembits wrote: post #95

Earlier quoted context omitted.

I'm hoping that something like this can condense a 1000+ comments thread to couple of paragraphs at most.

Why would you want that?

Because I want to spend less time online.

Consuming things like comments gives my brain a false sense of social participation. It uses up my limited "social participation budget", with nothing to show for it. Often I reach for comments to see if an article is worth reading, has obvious false information, or see what the "consensus" is and instead I end up wasting time on anything but that. Its not good for my mind to marinate in contextless opinions of random people and increasingly, bots with an agenda. Sorting through all of that in my head uses up energy that could be better spent with real people. If I can simply see a summary of something potentially useful in under a minute, then my brain will get its dopamine hit (or alleviate FOMO) and be uninterested in sinking hours on something detrimental to my life. My experience suggests that, out of all countless hours I've spent on the internet reading things, less than 1% of it has been of any use to me. Its been a net negative.

How often do I feel the need to eavesdrop on a group of people I don't know, discussing something in real life? Almost never. Why would I want to do that online then? Also its mostly kids online. Why would I want to eavesdrop on what a bunch of kids are talking about? And yet its difficult to avoid due to the nature of aggregation platforms. If it were up to me, I'd filter out any and all content generated by or aimed at people under 25 (or even 30).

Imagine surfing the web without ever hearing anything about or adjacent to US politics, celebrities, Musk or AI? I'll seek out that information as and when I need to.

Yes, I can just not use certain websites out of sheer will. I've made progress there, but it can be better still.

Re: The Prompt API

#127

Post by Der_Einzige »

samrus wrote: post #53
jychang wrote: post #47

Earlier quoted context omitted.

Are humans supposed to enjoy the "flavor" of diarrhea, as the result of giving every village idiot a microphone so they can spew shit from their mouths? Sure, you might say this sort of thing is boiling flavor out of your food, but... boiling the bacteria out of what you consume isn't a bad thing.

This is sanding the edges of off life. Its gonna make you soft

Why Singapore is a dystopia.

Re: The Prompt API

#128

Post by senordevnyc »

haberman wrote: post #16

This API seems perfect for an idea I've had for a while: a de-snarkifier for social media. Social media can be intellectually stimulating and educational, but it's also easy to get sucked into ideological sniping and flamewars, even if you didn't go looking for it. The emotional and intellectual energy spent flaming strangers on the Internet is a complete waste of human capital. With an API like this, I assume you co…

I was literally just thinking that I’d like something like this for HN, which has become an incredibly bitter, cynical, and depressing place in the last decade. On virtually any story, most of the top comments are negative. Every major company is a greedy monster trying to destroy your life, every CEO is a sociopath, everything is terrible, all the time. I wonder how most HN users even get out of bed every day.

Re: The Prompt API

#130

Post by bryan_w »

samrus wrote: post #53
jychang wrote: post #47

Earlier quoted context omitted.

Are humans supposed to enjoy the "flavor" of diarrhea, as the result of giving every village idiot a microphone so they can spew shit from their mouths? Sure, you might say this sort of thing is boiling flavor out of your food, but... boiling the bacteria out of what you consume isn't a bad thing.

This is sanding the edges of off life. Its gonna make you soft

Nobody needs to be hard on the internet
Post reply on HN