Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser

twitter.com

Post reply on HN
Print view View original

171–180 of 194 posts

Re: Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser

#171

Post by hysan »

LunaSea wrote: post #128
j10u wrote: post #117

Earlier quoted context omitted.

I'm pretty sure that with time, they will be forced to let users choose the model. Just like it happened with the search engine...

Wouldn't this require Chrome to download models on the fly or pre-package multiple models? That doesn't really seem possible (mobile data connection) or convenient (Chrome binary size, disk space) for the user.

I don’t think you’d need to download on the fly. You can imagine models being installed like extensions where chrome comes with Gemini installed by default. Then have the API allow for falling back to the default (Gemini) or throwing an error when no model is available. I’d contend that this would be a better API design because the user can choose to remove all models to save space on devices where AI is not needed (ex: kiosk).

Re: Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser

#174

Post by sensanaty »

Qem wrote: post #150
sensanaty wrote: post #147

And how do I turn this cancer off permanently?

Use Firefox.

I already do, but Mozilla has already drunken the AI kool-aid [0][1].

[0] https://github.com/mdn/yari/issues/9208 [1] https://github.com/mdn/yari/issues/9230

Re: Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser

#175

Post by wiseowise »

sheepscreek wrote: post #44
hypeatei wrote: post #25

AI brain rot continues but now it's reaching unimaginable levels and infecting browser APIs, wow!

Why is it brain rot? It still blows my mind that it’s even possible for a low-power device to talk and behave like us. For all practical purposes, LLMs pass the Turing test. This a major leap forward in human innovation and engineering. IMO, this could be as influential as the adoption of electricity/setting up of the power grid.

> IMO, this could be as influential as the adoption of electricity/setting up of the power grid.

Are you okay?

Re: Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser

#176

Post by simonw »

sensanaty wrote: post #146
simonw wrote: post #107

If this is the API that Google are going with here: const model = await window.ai.createTextSession(); const result = await model.prompt("3 names for a pet pelican"); There's a VERY obvious flaw: is there really no way to specify the model to use? Are we expecting that Gemini Nano will be the one true model, forever supported by this API baked into the world's most popular browser? Given the rate at which models are…

Testing LLM/AI output sounds like an oxymoron to me.

In the LLM engineering community we call those "evals", and they're critical to deploying useful solutions. More on that here: https://hamel.dev/blog/posts/evals/

Re: Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser

#177

Post by jimmaswell »

zakkudruzer wrote: post #59
jimmaswell wrote: post #46

Earlier quoted context omitted.

What a needlessly hostile and cynical blog post. I also can't relate to their appraisal of copilot. It's been an incredible productivity booster for me in how it removes so much cognitive load that's tangential to the problem I'm solving. It mostly completes the same line/s I was about to type, sometimes even pointing out an error in my code when the output is odd. It's also awesome when it spits out 20+ lines unexpe…

Funny, that's been pretty much the opposite of my experience with Copilot (or any other LLM-based code assistant). It constantly spits out lines that are similar to what I was planning to write, but are subtly wrong in ways that take me more time to figure out and fix than it would have to just write it myself in the first place. It's handy if I want a snippet of example code that I could've just found on Stackoverfl…

What language? It's been great for me in C#, Java, JS/HTML/CSS/etc, and xml configs where it can easily learn from all the surrounding boilerplate.

Re: Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser

#179

Post by firtoz »

niutech wrote: post #133
firtoz wrote: post #17

Earlier quoted context omitted.

Browser extensions should be able to shim or even overwrite the `.ai` object in the window, so it should be possible to add ollama etc to all browsers through extensions with the same API, making it a defacto standard It should be simple enough to do that I believe at least 3-5 people are going to be doing this if it's not done already Hell, if nobody does it I will do it

It's already done: https://windowai.io

There you go.

Re: Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser

#180

Post by nektro »

onion2k wrote: post #36

My first impression is that this should enable approximately what Apple is doing with their AI strategy (local on-device first, then filling back to a first party API, and finally something like ChatGPT), but for web users. Having it native in the browser could be really positive for a lot of use cases depending on whether the local version can do things like RAG using locally stored data, and generate structured inf…

> LLM-powered apps are here to stay,

i dont like that you take this as a given. we as users choose.

> I don't think this is a terrible idea.

it's deplorable

Post reply on HN