Viewing profile — bashbjorn

There is an RSS feed now: https://nobodywho.ooo/feed.xml

It's just an eleventy site: https://github.com/nobodywho-ooo/website No RSS feed currently, but it's a good idea to add one!

Cool technique, but I'm not sure I'd call it simple. Doing this means that you can't just tokenize the string output of the chat template as one big string. You might need to token…

You're right, there must be a good and simple way to do it. Obviously the prefix-with-backslash convention won't do it. The escaping system could be something like inserting a char…

The model sees one token per marker - but the overlap with ingested actual text is still relevant, because the tokenizer will ingest regular text, where it will turn " " into the s…

Yeah, TheBloke era of local LLMs were good times. TBF Unsloth are doing a fantastic job of publishing quants of the major models quickly - they just don't have nearly the volume of…

I love mistral, but that model is... not the best. Maybe try out Gemma 4 e4b, it's a similar size to Mistral 7B, and should run great on your 4070 ("E4B" is slightly misleading nam…

whoops, my bad. Just a typo in the markdown. Fixed :)

Oh hey I'm also working on a thing to solve the devx of llama.cpp: https://github.com/nobodywho-ooo/nobodywho In contrast to Ollama, this is a self-contained library, not a server.…

NobodyWho | Copenhagen, Denmark | Software Engineer, ML Engineer, DevRel | Full-time | ONSITE NobodyWho is making developer tools for running small language models in local-first a…

I made something silly to this effect last year: https://gitlab.com/AsbjornOlling/nixllm You provide the prompt to a nix function, and it deterministically generates the source cod…

I'm working on a plugin[1] that runs local LLMs from the Godot game engine. The optimal model sizes seem to be 2B-7B ish, since those will run fast enough on most computers. We rec…

What makes you say that these are all Stenbergs creations? Could it be that these are just projects that use libcurl in some way? I'm having trouble finding any sources that say th…

Neat. I wish that I could test the regex immediately in the browser. Tools like regexr.com are great for convincing myself that my regex works.

Python, Typescript, Nim, Rust, C++, C and Elm.

The MNT Reform[1] is a pretty sexy open hardware laptop with a mechanical keyboard, optional trackball, and a small ARM processor. A cursory glance at geekbench shows that you can …

I did AoC in Nim one year and was very happy with it! I also became infatuated with Nim that year..

I highly recommend it to explore new programming styles in general. As some others, I use it as an excuse to learn a new language each year. While I think python is a really great …

Shameless plug: My project, Cactus Comments[1] does something similar, although for commenting, instead of support chat. We ship a web-embeddable Matrix client. The users' browser …

Hey, thanks! It's a small web I guess.

Aforementionend friend and Cactus Comments dev here. We don't support any sort of threading yet, although Cerulean-style threading is definitely somewhere down the road. Although s…

There is one bundled with a standard nim installation, and I use it regularly (when working in nim). It works, but it's not very good. I expect the developers to know this, since i…

I'm currently studying a CS(-ish) bachelors degree (and I'm currently procrastinating on a group assignment) so I have some experience with this. Our uni gives us quite a lot of gr…