I see nothing about adding 'window.ai' from google. Am I missing it? I see some stuff about sdks but no 'window.ai'
Vercel's chromeai is a wrapper on top of window.ai
Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser
141–150 of 194 posts
Re: Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser
#142So it's loading an instruct model for inference? That seems a fair bit less useful than a base model, at least for more advanced use cases. What about running LoRAs, adjusting temperature, configuring prompt templates, etc? It seems pretty early to build something like this into the browser. The technology is still changing so rapidly, it might look completely different in 5 years. I'm a huge fan of local AI, and of…
The base model can be found on HF ( https://huggingface.co/wave-on-discord/gemini-nano ) and run in any web browser using MediaPipe on WebGPU: https://x.com/niu_tech/status/1807073666888266157 As for temperature and topK, you can set them in the AITextSessionOptions object as an argument to `window.ai.createTextSession(options)` (source: https://source.chromium.org/chromium/chromium/src/+/main:thi... ) You should als…
Appreciate the info and links.
Re: Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser
#143Earlier quoted context omitted.
1.8B/3.25B is still too much for edge devices. Ideally tens or hundreds mega would be ok. Is there an option to change the builtin Gemini Nano to other smaller models? By the way, haven't touch the lastest JS code for a while, what does this new syntax mean: "import { chromeai } " Also not get the textStream code: for await (const textPart of textStream) { result = textPart; } does result get override for each loop s…
These are 4-bit models.
Made by a by a two-bit company that...
Re: Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser
#144If they're going to cram a small LLM in the browser, they might as well start cramming a small image generating diffusion model + new image format to go along with it. I believe we can start compressing down the amount of data going over the wire 100x this way...
> I believe we can start compressing down the amount of data going over the wire 100x this way... What?
Just discard images and have the LLM describe them on the other side.
Re: Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser
#145If this is the API that Google are going with here: const model = await window.ai.createTextSession(); const result = await model.prompt("3 names for a pet pelican"); There's a VERY obvious flaw: is there really no way to specify the model to use? Are we expecting that Gemini Nano will be the one true model, forever supported by this API baked into the world's most popular browser? Given the rate at which models are…
Presumably something like model.includes("gemini-nano:0.4") could work?
can we make everything constant like C# does please
Models.GeminiNano04
boom
Re: Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser
#146If this is the API that Google are going with here: const model = await window.ai.createTextSession(); const result = await model.prompt("3 names for a pet pelican"); There's a VERY obvious flaw: is there really no way to specify the model to use? Are we expecting that Gemini Nano will be the one true model, forever supported by this API baked into the world's most popular browser? Given the rate at which models are…
Testing LLM/AI output sounds like an oxymoron to me.
Re: Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser
#147And how do I turn this cancer off permanently?
Re: Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser
#148And how do I turn this cancer off permanently?
That's the thing - you don't.
Re: Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser
#149Re: Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser
#150And how do I turn this cancer off permanently?
Use Firefox.