Viewing profile — mukel

I built llama3.java in the past, this is a follow-up: Gemma 4 running entirely on the JVM. No Python. No JNI. No native code. Just Java. It’s (mostly) a single Java file implementi…

Code: https://github.com/mukel/llama3.java

Features: - Single file, no dependencies - GGUF format parser - Llama 3 tokenizer - Support Llama 3, 3.1 (ad-hoc RoPE scaling) and 3.2 (tie word embeddings) - Fast matrix-vector mu…

Llama3.java: featuring .GGUF file format support, Q8_0 and Q4_0 quantizations, fast matrix/vector multiplication routines using Java's Vector API; served by a simple CLI with a --c…

This will boost adoption at so many levels: - Importing a Truffle language as a regular Maven dependency - Ease integration with mainstream package managers - Ability to update to …

Author here: I implemented several versions of matmul with different unrolling schemes using the Vector API and I got a ~4X speedup with a single thread, but the speedup fades the …

A Java port of llama2.c that performs very close to C on large models. Llama 2 7B runs at a whooping 1.6 tokens/s.

GraalVM team member here. Implementing any mainstream language is indeed a challenge, more so if you have to maintain bug-compatibility and cope with all the bits of bad design tha…

The goal is not to compete, but rather complement HotSpot/GraalVM with: - (Polyglot) scripting with Java - Augmenting native images e.g. native javac with instant startup + annotat…

It's a Linux-only trick: https://github.com/kt97679/tetris/blob/52dfb3a703e4dd5b37990...

Java on Truffle is a normal Java application, it can run on a vanilla OpenJDK, doesn't need the bootstrap step. Currently Graal/Truffle implements the first Futamura projection: yo…

Running on HotSpot is an advantage for the development of Java on Truffle itself; the tooling is amazing, debugger, inspectability, you can debug the VM as a normal Java applicatio…

Java on Truffle is an implementation of the Java Virtual Machine Specification, Java SE 8 and Java SE 11, built upon GraalVM as a Truffle interpreter. It is a minified Java VM that…

Google is going downhill, the day I finished my internship I sweared I'll never in my life work on any money-making, no-challenge project. A bunch of engineers do enjoy what they d…