Viewing profile — Evan-Almloff

> Because WebAssembly modules lack direct access to the DOM, they rely on an additional JavaScript interoperability layer, which can introduce extra overhead. Blazor is slow for ot…

Most of the optimizations apply equally to calling into webview JS from a native application for something like dom manipulation. There is a wry example that uses the system webvie…

The two projects have different usecases so they can't be directly compared. Slegehammer bindgen makes calling javascript from rust faster in the browser. Wasmtime is a native runt…

There are several good community component libraries now. daisy rsx is one that is already updated with 0.6 support: https://crates.io/crates/daisy_rsx

Kalosm is a library for pre-trained text, audio and visual models in Rust. It includes support for: - Whisper for audio transcription - Llama, phi and mistral models for text gener…

It is pretty good. I am working on an application that uses SVGs as a way to draw a workflow editor UI with Dioxus: https://github.com/floneum/floneum

We have a web components example here: https://github.com/DioxusLabs/dioxus/blob/fd21c971038840130f... Everything should work like normal except: attributes are not typed, custom e…

All data you insert into a generational box needs to be allowed to last for the 'static lifetime (have no internal temporary pointers). You cannot insert something like &'a str int…

Dioxus web compiles to WASM, but we compile to native code for desktop rendering to make it easier to interact with native APIs like the filesystem. We just use the web browser for…

We are copying the reference to the data, not the data itself. The reference to the data lasts for the lifetime of the program. Generational box lets you insert data that last for …

I would love to integrate llava in the future!

Yes, you can set the source to any local file instead of a huggingface model. Here is a example: https://gist.github.com/ealmloff/3398d172180fa783f043b4a2696...

Hi everyone, I'm happy to announce the release of Kalosm! [Kalosm]( https://floneum.com/kalosm/ ) is a framework for embedded AI in rust. ## What is Kalosm? Kalosm provides a simpl…

It's here: https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2

Kalosm is a meta-framework for AI written in Rust. Kalosm supports local quantized large language models like Llama, Mistral, Phi-1.5, and Zephyr. It also supports other quantized …

Floneum is a graph editor for local AI workflows. The project focuses on ease of use and extensibility. The application is a single installer with no external dependencies. Here ar…

There are a bunch of tasks that require some minimal level of language processing/reasoning that people do that are repetitive. I mentioned a few in my previous response: - Cross r…

Absolutely, I would love to integrate other types of models (mentioned at the end of the anointment post)! Stable diffusion and whisper.cpp could be a good place to start It is a b…

1. I would love to support additional model runners including exLlama and API based models like chat GPT. I'm less familiar with how c transformers and GPTQ compare to llama.cpp. G…

Floneum is still early in development, as it becomes more mature I plan to expand the documentation. In the meantime, you can always ask questions on the discord! Getting feedback …

Currently, I'm hoping to find more developers who are interested in contributing to the project (specifically building plugins). Once Floneum is more complete, the target users are…