1–10 of 48 posts
Show HN: We made our own inference engine for Apple Silicon
github.com
How was your experience using Rust on this project? I'm considering a project in an adjacent space and I'm trying to decide between Rust, C, and Zig. Rust seems a bit burdensome with its complexity compared to C and Zig. Reminds me of C++ in its complexity (although not as bad). I find it difficult to walk through and understand a complicated Rust repository. I don't have that problem with C and Zig for the most part.
But I'm wondering if I just need to invest more time in Rust. How was your learning curve with the language?
What's your deliberate, well-thought roadmap for achieving adoption similar to llama cpp?
>faster than llama cpp in all of the use cases What's your deliberate, well-thought roadmap for achieving adoption similar to llama cpp?
just curios, will it be supported on iOS, it would be great to build local llm app with this project.