Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser

twitter.com

Post reply on HN
Print view View original

191–194 of 194 posts

Re: Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser

#191

Post by niutech »

kinlan wrote: post #109
lolinder wrote: post #65

> The code below is all you need to stream text with Chrome AI and the Vercel AI SDK. ... `chromeai` implements a Provider that uses `window.ai` under the hood Leave it to Vercel to announce `window.ai` on Google's behalf by showing off their own abstraction but not the actual Chrome API. Here's a blog post from a few days ago that shows how the actual `window.ai` API works [0]. The code is extremely simple and reall…

Fwiw, this is a very experimental API and we're not really promoting this as we know the API shape will have to change. It's only available by enabling a flag so we're working with a lot of developers via the preview program (link below) Overview: https://developer.chrome.com/docs/ai/built-in Sign-up: https://docs.google.com/forms/d/e/1FAIpQLSfZXeiwj9KO9jMctffH...

Finally there is the Prompt API explainer: https://github.com/explainers-by-googlers/prompt-api

Re: Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser

#192

Post by ngkw »

Seemingly very interesting moves, but I wonder what specific needs remain for a 'browser-level' local LLM, because local LLMs will be on devices in the near future. So if we're not connected to the internet, maybe a device-level LLM would be better. On the other hand, when we open the browser, we're connected to the great internet! I know browser-level LLMs can have several benefits like speed, privacy protection, and cost-effectiveness, but these features are covered by internet-based LLM APIs or device-level LLM APIs.

Re: Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser

#193

Post by cuu508 »

ac29 wrote: post #188
cuu508 wrote: post #105

Earlier quoted context omitted.

The video plays fine on both, yes, but the Windows laptop, generally speaking, gets hotter, and runs out of battery sooner.

If you compare a random older Windows laptop to a new or nearly new Mac, sure. But new Windows/x86 PCs have gotten pretty efficient. Here's a review showing a Meteor Lake laptop getting 15 hours of video playback on battery: https://www.anandtech.com/show/21282/intel-core-ultra-7-115h...

I'm comparing laptops of similar age and in the same price range.

Re: Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser

#194

Post by smolder »

cuu508 wrote: post #193
ac29 wrote: post #188

Earlier quoted context omitted.

If you compare a random older Windows laptop to a new or nearly new Mac, sure. But new Windows/x86 PCs have gotten pretty efficient. Here's a review showing a Meteor Lake laptop getting 15 hours of video playback on battery: https://www.anandtech.com/show/21282/intel-core-ultra-7-115h...

I'm comparing laptops of similar age and in the same price range.

No, you aren't. You compared windows laptops to Apple generally. Apple laptops are expensive.
Post reply on HN