Viewing profile — curioussquirrel

As usual, take it with a grain of salt.

[dead]

My first real programming achievement was building a website for an Ultima Online shard. I wrote some really terrible PHP and HTML, but it worked for 20+ years afterwards. Great me…

V4 is definitely a step-up from V3.2 on our multilingual benchmarks. Two caveats: - when inferring through Openrouter, we've had a lot of issues with very slow speeds (TPS) and an …

Came here to say the same. Please add a few screenshots!

MoE is mostly an optimization of the active parameters and therefore lowering the compute requirements, but it can provide some performance improvements over dense models in some c…

There are architectural changes (such as reasoning or mixture of experts) that measurably improve how well models perform. So the improvements are definitely not just from data. I …

Here you go! https://news.ycombinator.com/item?id=47847282

Just saw your thinking edit! That's a great question and one I wanted to study in depth, but these days you don't really get access to the raw thinking data. It's usually summarize…

I am fairly convinced that there's a certain polyglot snowball effect: once the LLM is fluent in 20 languages, it can pick up on similarities in vocabulary, syntax etc. and learn t…

One more thing: we're working on a multilingual benchmark that will evaluate core linguistic proficiency in 30 languages. We already have a lot of data internally and I can tell yo…

Disclosure: I work at RWS/TrainAI, we did this study. Recently I alluded to it in a comment and was encouraged to share it, so here it is! We focus on multilingual proficiency, whi…

Yes, but post training cannot possibly account for all possible use cases. Sane defaults are fine, you can't really do much about sampling parameters in chatbots and coding harness…

After Anthropic, Moonshot is another model provider who restricts tweaking of sampling parameters. I do like the idea of the vendor verifier, though.

There's been quite a few threads about Opus 4.7 but none of them seems to have discussed some breaking changes on the API side, particularly removal of sampling parameters. From th…

Will do! Thanks for the encouragement

Claude's tokenizers have actually been getting less efficient over the years (I think we're at the third iteration at the least since Sonnet 3.5). And if you prompt the LLM in a la…

Thanks for sharing! Have been begrudgingly using Darktable since that seems to be your best option on Linux, but the UI/UX never really clicked with me. I wish this was opensource …

Thank you for the transparency and insights! Very helpful. We actually did the same thing re generating charts in brand style to avoid any mishaps, since then I sleep much better

Absolutely unhinged and very entertaining. Thanks for sharing!

Give Gemma 31B a shot for translation, it does a very good job at that given its size.

We're doing multilingual testing and I can confirm what you've observed: Gemma 4 is surprisingly good at multilingual tasks, especially given its size. This is mostly true for the …