Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: BrowserAI – Run LLMs directly in browser using WebGPU (open source)

github.com

Post reply on HN
Print view View original

1–10 of 25 posts

Show HN: BrowserAI – Run LLMs directly in browser using WebGPU (open source)

#1

Post by shreyash_gupta »

Check out this impressive project that enables running LLMs entirely in the browser using WebGPU.

Key features: - Zero token costs, no cloud infrastructure required - Complete data privacy through local processing - Simple 3-line code integration - Built on MLC and Transformer.js

The benchmarks show smaller models can effectively handle many common tasks.

Currently the project roadmap includes: - No-code AI pipeline builder - Browser-based RAG for document chat - Analytics/logging - Model fine-tuning interface

Show HN: BrowserAI – Run LLMs directly in browser using WebGPU (open source)
github.com

Re: Show HN: BrowserAI – Run LLMs directly in browser using WebGPU (open source)

#5

Post by sauravpanda »

astlouis44 wrote: post #4

Deepseek R1 just got ported to WebGPU as well! Exciting future for local web AI: Thread - https://news.ycombinator.com/item?id=42795782

Yes, we do plan to add it soon, we are focusing on something cool right now! Stay tuned!

Re: Show HN: BrowserAI – Run LLMs directly in browser using WebGPU (open source)

#6

Post by sauravpanda »

Philpax wrote: post #2

This is a wrapper around WebLLM [0] and transformers.js [1]. What exactly are you offering on top of those two libraries? [0]: https://github.com/mlc-ai/web-llm [1]: https://huggingface.co/docs/transformers.js/en/index

This is the start so yes at the current state, we aren't offering much, if you check the GitHub repo, we don't directly use Transformers.js but have forked their code to ts and removed things that caused build issues in some frameworks like next, etc due to node modules.

We are adding features like RAG and observability integrations so people can use these llms to perform more complicated tasks!

Re: Show HN: BrowserAI – Run LLMs directly in browser using WebGPU (open source)

#7

Post by sauravpanda »

bazmattaz wrote: post #3

This is great. If I was a developer I would have two projects in mind for this; 1. Decline cookie notices automatically with a browser extension 2. Build a powerful autocorrect/complete browser extension to fix my poor typing skills

Haha, we are thinking of 2. It makes sense, but I would love for you to check it out!

Re: Show HN: BrowserAI – Run LLMs directly in browser using WebGPU (open source)

#8

Post by cloudking »

bazmattaz wrote: post #3

This is great. If I was a developer I would have two projects in mind for this; 1. Decline cookie notices automatically with a browser extension 2. Build a powerful autocorrect/complete browser extension to fix my poor typing skills

1. related: https://github.com/brave/cookiemonster

Re: Show HN: BrowserAI – Run LLMs directly in browser using WebGPU (open source)

#10

Post by sauravpanda »

cloudking wrote: post #8
bazmattaz wrote: post #3

This is great. If I was a developer I would have two projects in mind for this; 1. Decline cookie notices automatically with a browser extension 2. Build a powerful autocorrect/complete browser extension to fix my poor typing skills

1. related: https://github.com/brave/cookiemonster

Would love to help, wanna give it a try to browser? I can help fix any issues you run with or just jump on a call!

This seems like the perfect use case for Browserai!

Post reply on HN