31–40 of 150 posts
On Firefox Nightly on my Steam Deck it "cannot find WebGPU in the environment".
Apparently nightly is supposed to support it: https://developer.mozilla.org/en-US/docs/Mozilla/Firefox/Exp...
IMO eventually users should be able to advertise what embedding models they have so we don't redundantly redownload.
Different webapps can't share common dependencies stored in localstorage afaik.
IMO eventually users should be able to advertise what embedding models they have so we don't redundantly redownload.
That's not possible with current web tech, is it? Different webapps can't share common dependencies stored in localstorage afaik.
Earlier quoted context omitted.
That's not possible with current web tech, is it? Different webapps can't share common dependencies stored in localstorage afaik.
This need wasn’t super prevalent in the pre LLM days. It’s rare to have a multi-GB blob that should be commonly used across sites.
This is awesome. I have been using ChatGPT4 for almost a year and haven't really experimented with locally running LLMs because I assumed that the processing time would take too long per token. This demo has shown me that my RTX 2080 running Llama 3 can compete with ChatGPT4 for a lot of my prompts. This has sparked a curiosity in me to play with more LLms locally, thank you!
My pixel 6 was able to run tinyllama and answer questions with alarming accuracy. I'm honestly blown away.
Earlier quoted context omitted.
That's not possible with current web tech, is it? Different webapps can't share common dependencies stored in localstorage afaik.
This need wasn’t super prevalent in the pre LLM days. It’s rare to have a multi-GB blob that should be commonly used across sites.
A lot of unity games could easily be web games, but aren't because of many roadblocks. I believe this is one of them.
Tried this in Chrome under Windows, it does work but does not seem to use the RTX4060, only the integrated Iris Xe. Is this a bug or intentional?