Viewing profile — elchiapp

Bare worklet with IPC, exactly. Let me know if there's anything I can help with.

Curious to hear what constraints are there that aren't tackled by the current offering of local runtimes/SDKs for inference.

You can build anything! Check out our tutorials here: https://docs.qvac.tether.io/sdk/tutorials/ Although an LLM chat is the starting point for many, there are many other use cases…

Hey folks, I'm part of the QVAC team. Happy to answer any questions!

That line means that you don't need to create an account and get an API key from a provider (i.e. "asking for permission") to run inference. The main advantage is precisely that lo…

How is that different from choosing not to adopt a technology because it’s not widely used therefore not widely documented? It’s the timeless mantra of “use boring tech” that seems…

Has anyone tried emulating linux/amd64 on Silicon with GPU support? I'm testing an engine to run LLMs locally that only runs on that, no support for arm.