WebGPU GPT Model Demo

Post by DustinBrett » Sat, Apr 22, 2023, 7:05 AM UTC

fredrickd wrote: post #8

DustinBrett wrote: post #4

It indeed works and loads quick. I am more interested currently in the Vicuna 7B example from https://mlc.ai/web-llm/ Also instead of just "Update Chrome to v113" the domain owner could sign up for an origin trial https://developer.chrome.com/origintrials/#/view_trial/11821...

Thanks for the tip!

I actually just tried this on my own domain and although it enabled WebGPU it had another error, which was:

"Find an error initializing the WebGPU device Error: Cannot initialize runtime because of requested maxBufferSize exceeds limit. requested=1024MB, limit=256MB. This error may be caused by an older version of the browser (e.g. Chrome 112). You can try to upgrade your browser to Chrome 113 or later."

Re: WebGPU GPT Model Demo

Re: WebGPU GPT Model Demo