Viewing profile — frwickst

What you learn at a uni is not really about learning a trade, sure it gives you a taste of the basics in many areas, but you will never be an supeb developer (or another profession…

It is a tokenizer artifact most likely ( https://github.com/huggingface/transformers/issues/4786 ). So the output is not properly decoded in this case, it should just be a space.

Since the output is quite long, here is a link: https://pastebin.com/k76wiVGP

I'm getting 6.55t/s using the Qwen3.5-397B-A17B-4bit model with the command: ./infer --prompt "Explain quantum computing" --tokens 100 MacBook Pro M5 Pro (64GB RAM)

Last posted 16 days ago: https://news.ycombinator.com/item?id=46661308

You can use Every Code [1] (a Codex fork) for this, it can invoke agents, but not just codex ones, but claude and gemini as well. [1] https://github.com/just-every/code

Hi! Creator of the pyhuum library and the Huum integration here. If you need someone else to double-check anything, please let me know. I would be more than happy to help out here,…

Thanks for a neat project! I tried it on one of our more complex pipelines and created a few issues for you ;)

Hi, one of the developers here. Happy to answer any questions that you might have.