Viewing profile — dot_treo

It is actually an insurance kind of thing as far as I understand. I've had plenty of cases where the bus couldn't continue due to being in a traffic jam, and people who would have …

Reminds me very much of https://music.ishkur.com/ which is the same kind of thing but for electronic music.

By the looks of it, it will take a couple more follow up PRs to clean things up a bit and get the most performance from MTP. I hope that by that point it will be easier to add more…

And it also looks like the original authors are working on qwen 3.5 too: https://github.com/chiennv2000/orthrus/issues/1#issuecomment...

I would probably treat the (3 GatedDeltaNet + 1 GatedAttention) Blocks as one transformer block, when generating next steps one would therefore use the kv cache for the gated atten…

I've tried MTP, and that got me about 1.5x on average with a very spec friendly benchmark. I didn't run the full benchmark with the demo code, just picked up a single prompt from i…

Just to get it into a GGUF file would be fairly trivial. But using that GGUF file would need a bunch of additional things. One would need to create a new architecture derived from …

It is all about moving the bottleneck. During prompt processing everything can be calculated in parallel, while during token generation you create a single token at a time. For exa…

Do you plan on releasing the training code?

True, but how many 18 year olds do you know that will just randomly get their balls checked?

It used to be that way, and probably will be that way again. I know of a few of people who got an early testicular cancer diagnosis that way. So it seems that there is a medical us…

I don't care too much about the article being written with LLM support. There is actual work being done that is being showcased here. I'd rather read an LLM version of it, rather t…

The linguistic argument is fascinating. One particular thing, unrelated to the linguistic argument itself, stood out to me. In the PCA visualisation, we can see that some sequences…

Looks like we discovered it at essentially the same time, and in essentially the same way. If the pth file didn't trigger a fork-bomb like behavior, this might have stayed undiscov…

It actually wasn't. That was one of the reasons why I looked into what was changed. Even 1.82.6 is only at an RC release on github since just before the incident. So the fact that …

Yeah, that release has the base64 blob, but it didn't contain the pth file that auto triggers the malware on import.

Even just having an import statement for it is enough to trigger the malware in 1.82.8.

[dead]

About an hour ago new versions have been deployed to PyPI. I was just setting up a new project, and things behaved weirdly. My laptop ran out of RAM, it looked like a forkbomb was …

The main reason is just how hard it is to actually create anything that integrates with Teams. You have to jump through so meany hoops, wade through so many deprecated APIs, guess …

In the past I've been trying to adopt the stoic mindset, but always struggled. But I continued to read and learn about it. Unrelatedly, I came across a recomendation for David Burn…