Show HN: WebGPU enables local LLM in the browser – demo site with AI chat

Post by yahoozoo » Sun, Aug 03, 2025, 10:54 AM UTC

AndrewDucker wrote: post #38

I asked "Why is the sky blue?" and got back a response of "coppia RR TalentDevExpressincer+'.//////////////////////////////////////////////////////////////////////// cha ولا.AutoSizesaving proleงคicate Like"/> infos эти za cornerback economical (%]\ enumligne.execRELEASEPropagation_station Bucks проHEME seas GASPOST[Unit(suffix Gloves" (and so on, for a few more paragraphs). Am I missing something?

Post by gorkish » Sun, Aug 03, 2025, 2:23 PM UTC

AndrewDucker wrote: post #38

I asked "Why is the sky blue?" and got back a response of "coppia RR TalentDevExpressincer+'.//////////////////////////////////////////////////////////////////////// cha ولا.AutoSizesaving proleงคicate Like"/> infos эти za cornerback economical (%]\ enumligne.execRELEASEPropagation_station Bucks проHEME seas GASPOST[Unit(suffix Gloves" (and so on, for a few more paragraphs). Am I missing something?

Post by phatskat » Sun, Aug 03, 2025, 8:47 PM UTC

fooker wrote: post #46

apitman wrote: post #41

Earlier quoted context omitted.

You can open a file for performant access in all major browsers. It's the same API used for uploading files ( ), but you can also just load them into memory and do stuff.

Sure, with the caveat that the file is specifically selected by the user.

Post by imatrix » Mon, Aug 04, 2025, 1:28 PM UTC

Post by owebmaster » Mon, Aug 04, 2025, 8:01 PM UTC

imatrix wrote: post #58

imatrix wrote: post #57

Its not working. Loading model: waiting WebGPU error: WebGPU is NOT supported on this browser. Im on macOS and Safari.

Same on iOS and mobile Safari - not working.