Worked on my M1 Macbook! Is there a cost on your side to hosting this type of program that you can share? Or is the computation done on the user's side?

Re: Show HN: Run Llama 3.1 8B in the browser

Post by gulan28 » Wed, Jul 31, 2024, 3:10 PM UTC

Vayu wrote: post #3

gulan28 wrote: post #2

OP here, You'd need a GPU and the latest version of chrome to run this.

Worked on my M1 Macbook! Is there a cost on your side to hosting this type of program that you can share? Or is the computation done on the user's side?

Computation's done entirely on the client side.

Post reply on HN