Live data from Hacker News

Show HN: In-Browser Graph RAG with Kuzu-WASM and WebLLM

blog.kuzudb.com

21–30 of 30 posts

Re: Show HN: In-Browser Graph RAG with Kuzu-WASM and WebLLM

#22

Earlier quoted context omitted.

Why the Blockchain there? I don't really see the value. But maybe I misunderstand. It's just that I tend to be pretty dismissive of products mentioning blockchain. Mostly from the time when this tech was severely overhyped. Like Metaverse after it and now of course AI. I do know there's some usecases for it, I just wonder what they are and why you chose it. I think I like the idea but I don't think I fully understand…

Take this with a grain of salt, as I run a startup in the industry. Blockchain has taken a weird path. It started with Bitcoin offering something genuinely new - a Byzantine fault-tolerant mechanism for decentralized value exchange without trusted intermediaries. But the industry has drifted toward "web3" hype where the technology often isn't necessary. Companies pick tech stacks for all sorts of reasons beyond techn…

It is wise to be suspicious - spending even a small amount of time near the "web3" space will make attentive person suspicious of scams and parlour tricks.

I use the network to host the webxr experiences, which are bundled wasm files, from unity. All of the code lives on the blockchain so, in this sense, i really couldn't do without it.

If you are referring to blockchain-specific functionality, then this is largely true, however i have implemented some demostrations of the consensus mechanism being used from inside an immersive space. This is really to illustrate that it is possible, rather than try to sell you a meme coin.

In the near future I expect to be using the ICP for a lot more, however, since it provides some rather interesting technical opportunities. It is wrapped around something called a 'network nervous system' which acts as a sort of administrator for proposals, so your point about abstraction is accurate, but this is the case with any large vendor.

I choose to build on the ICP because it is more secure and straightforward for my particular stack, plus it has a lot of potential, despite the noise. I've implemented webrtc messaging to keep the cost of normal multiplayer data transfer as low as possible, because consensus is expensive and the network runs on a pay-per-use compute model.

I'm offering a new route, outside of big tech, if you don't consider Unity a menace, which i acknowledge that some do. I am taking an admittedly more radical stance, by including the hosting in this.

Re: Show HN: In-Browser Graph RAG with Kuzu-WASM and WebLLM

#23

I absolutely love this. I make VR experiences that run on the ICP, which delivers wasm modules as smart contracts - I've been waiting for a combo of node-friendly, wasm deployable tools and webLLM. The ICP essentially facilitates self-hosting of data and provides consensus protocols for secure messaging and transactions. This will make it super easy for me to add LLM functionality to existing webxr spaces, and I'm ex…

Why the Blockchain there? I don't really see the value. But maybe I misunderstand. It's just that I tend to be pretty dismissive of products mentioning blockchain. Mostly from the time when this tech was severely overhyped. Like Metaverse after it and now of course AI. I do know there's some usecases for it, I just wonder what they are and why you chose it. I think I like the idea but I don't think I fully understand…

Yes, the hype waves have been painful. I am still annoyed by the lack of good tools and content for VR lovers. I am personally trying to do something by offering a toolkit for building VR websites in unity.

My website has a few examples on it, including domestic interior, bowling simulator. Recently I helped to make a VR museum, which will be there soon, and I'm working on a flying game with realistic aerodynamics.

I've open-sourced both the toolkit and template for self-hosting, essentially providing a no-code route for creating interactive webxr spaces. Putting it on the IC means you can also self-host your creation and keep control of the data, code and costs of running it.

You could equally just use the unity toolkit and host it elsewhere, but i wouldn't be able to provide the same level of support, if it broke in unexpected ways.

What i like about the original post was the fully in-browser RAG and webLLM, as it looks compatible with the rest, so i could, for example, broadcast responses across webrtc data channels. So many options...

Re: Show HN: In-Browser Graph RAG with Kuzu-WASM and WebLLM

#24
post #21

I'm new to the world of graph, and I just started building with SurrealDB in embedded mode. If you don't mind taking a few minutes, what are the main reasons to use Kuzu instead?

Hi, glad to help! I'm a DevRel advocate at Kuzu, and have spent a decent amount of time in other database paradigms thinking about these things. I'm familiar with SurrealDB too.

Although I cannot comment too much SurrealDB's exact capabilities and performance at this point, I can definitely highlight that at the data modeling and query language-level: Kuzu's data model is a property graph model (so an actual "graph" model rather than a multi-model database) and Kuzu implements Cypher as its query language, which is already widely adopted in the industry and is very intuitive to write (for both humans and LLMs).

Although Surreal DB does indeed offer an embedded mode, Kuzu is by design 100% embedded, is super-lightweight and can run natively in many environments, such as browsers, Android applications, AWS Lambda (serverless) and we're especially designed to be a VERY Python-friendly graph database that integrates with pretty much all well-known Python libraries. Because of its columnar storage layer, Kuzu can seamlessly read and write different data formats, such as Panda/Polars DataFrame, Arrow tables, Iceberg or Delta Lake tables and seamlessly move data between advanced graph analytics libraries like NetworkX. For anything related to graph computation, Kuzu is likely to have all the right tools and utilities to help you solve the problem at hand.

In my opinion, it's a myth that databases are heavy, monolithic pieces of software, and hopefully, using Kuzu will demonstrate that it's totally possible to have data in your primary store but seamlessly move it to a performant graph storage layer when required, and move the results back with minimum friction and cost. Hope that helps!

Re: Show HN: In-Browser Graph RAG with Kuzu-WASM and WebLLM

#25
Could it be viable to have one or multiple kuzu databases per user? What’s the story like for backups with kuzu?

I saw you recently integrated FTS which is very exciting. I love everything about Kuzu and want to use it, but currently tempted to use Turso to allow for multiple sqlite dbs per user (eg one for each device).

Or would it be possible to use Kuzu to query data stored on sqlite?

Great work through and through tho. Really amazing to see the progress you’ve all made!

Re: Show HN: In-Browser Graph RAG with Kuzu-WASM and WebLLM

#26

Earlier quoted context omitted.

Take this with a grain of salt, as I run a startup in the industry. Blockchain has taken a weird path. It started with Bitcoin offering something genuinely new - a Byzantine fault-tolerant mechanism for decentralized value exchange without trusted intermediaries. But the industry has drifted toward "web3" hype where the technology often isn't necessary. Companies pick tech stacks for all sorts of reasons beyond techn…

It is wise to be suspicious - spending even a small amount of time near the "web3" space will make attentive person suspicious of scams and parlour tricks. I use the network to host the webxr experiences, which are bundled wasm files, from unity. All of the code lives on the blockchain so, in this sense, i really couldn't do without it. If you are referring to blockchain-specific functionality, then this is largely t…

Hi Will!

Thanks for taking the time to reply to this.

Now that I have the context, I find what you're doing super interesting, and well thought out. And greatly value the passion you're building it with as well.

I want to clarify, my message wasn't intended as a dig at what you are doing - especially since I didn't actually look into it at all before writing my reply.

By definition, and especially when explained with enough detail, anything that we do couldn't be done with a different tool, in the sense it'd have to be done differently.

What my comment was meant to address was the original comment's question regarding the value of doing something "on-chain". Mainly because it's something that I've been thinking about a lot, being a founder as well in a similarly-hyped vertical.

At it's core, blockchains are a database, and so any high level goal - beyond the composability/interoperability of on-chain primitives through tokens and shared state - can be achieved without a blockchain.

However, there are many reasons to leverage the position of a blockchain project beyond the technical _need_ for a DLT.

The VC environment might be attractive to some -leveraging the network effects of a sufficiently decentralized network, tapping into ecosystem incentives and growth programs, personal alignment with the moral values typically associated with decentralization, personal connections in the industry/vertical, etc.

All that to say; no one asks why you're using a relational database or a graph database with as much suspicion or caution as they do why you're putting your stuff on-chain, and while that makes sense because of the... unique circumstances of DLTs, there's a lot more nuance to it from a business perspective than just asking yourself the "is it a grift?" question.

Re: Show HN: In-Browser Graph RAG with Kuzu-WASM and WebLLM

#27
post #16

Since I already have a browser connected to the Internet where this would execute, could one have the option of transparently executing the webGPU + LLM in a cloud container communicating with the browser process?

I think WebGPU is mostly for running inside the browser. If one has the option to use a cloud container + GPU, running LLM inference directly with CUDA/ROCm/TPU will be possible and runs more efficiently.

Re: Show HN: In-Browser Graph RAG with Kuzu-WASM and WebLLM

#28

Earlier quoted context omitted.

It is wise to be suspicious - spending even a small amount of time near the "web3" space will make attentive person suspicious of scams and parlour tricks. I use the network to host the webxr experiences, which are bundled wasm files, from unity. All of the code lives on the blockchain so, in this sense, i really couldn't do without it. If you are referring to blockchain-specific functionality, then this is largely t…

Hi Will! Thanks for taking the time to reply to this. Now that I have the context, I find what you're doing super interesting, and well thought out. And greatly value the passion you're building it with as well. I want to clarify, my message wasn't intended as a dig at what you are doing - especially since I didn't actually look into it at all before writing my reply. By definition, and especially when explained with…

I guess what i wanted to get across was that ICP is considerably more than a database, but tbh it's a massive rabbit hole, unless you're already into cryptography. I'm impressed by the foresight and scale of it though.

I thinks it's also the first thing i would call an AI governor, and there is a whole liquid democracy protocol that's pretty well thought out, imo

Thanks for the kind words

Re: Show HN: In-Browser Graph RAG with Kuzu-WASM and WebLLM

#29
post #14

Earlier quoted context omitted.

Your concern makes sense, but in the demo we show, all your private data AND the graph database AND the LLM (basically, everything) is confined to your client session in the browser, and no data actually ever leaves your machine. That's the whole point of Wasm! The graph that you build is more for your own exploration and not for sharing with the outside world.

Still, using non-personal example would mean the user wouldn't have to consider whether to trust you on that point (or do the analysis), and would make the technology demo friction-free. imo, privacy shouldn't be the driver but the kicker, because it's so inflammatory.

https://demo.kuzudb.com is our general WASM explorer with some synthetic data you can try.

Also note that Kuzu is open source. You can try running the explorer locally using Docker: https://github.com/kuzudb/explorer?tab=readme-ov-file#webass...

Re: Show HN: In-Browser Graph RAG with Kuzu-WASM and WebLLM

#30

Could it be viable to have one or multiple kuzu databases per user? What’s the story like for backups with kuzu? I saw you recently integrated FTS which is very exciting. I love everything about Kuzu and want to use it, but currently tempted to use Turso to allow for multiple sqlite dbs per user (eg one for each device). Or would it be possible to use Kuzu to query data stored on sqlite? Great work through and throug…

Hi! Work at Kuzu here.

> would it be possible to use Kuzu to query data stored on sqlite? Yes, we have a SQLite extension (https://docs.kuzudb.com/extensions/attach/rdbms/) that can read data from SQLite databases.

> Could it be viable to have one or multiple kuzu databases per user? What’s the story like for backups with kuzu? You can have multiple databases, but con only connect to one at a time for now. We don't have support for backups for now, but we'd like to hear more about your specific use cases. Would be great if you could join our discord (https://kuzudb.com/chat) or contact us through contact@kuzudb.com, and we can chat more there.

Post reply on HN