Viewing profile — kouteiheika

> On 2x RTX Pro 6000 Blackwell, its ~8k tok/s prefill and ~250 tok/s on a single stream. For reference, on a 1x B300 it's over 400 tok/s decode on a single stream.

> This is a really disingenuous way to characterize the article (CO2 and global warming were much more of a focus than water, so your "or something" is doing a lot of work). Remind…

Note that this describes an older, currently pretty much obsolete technique which does lobotomize the model somewhat.

You can find the current state-of-art tool for censorship removal here: https://github.com/p-e-w/heretic

> The most important pieces of information in this report are (a) the confirmation that the PRC models have no guardrails and will participate in offensive activity This isn't real…

> Noticed none of the comparisons mention Kimi K3. That's by design. Anthropic wants to make open-weight models illegal (not my speculation -- Dario explicitly said so), so I assum…

Assuming they did then they surely paid for them, which makes it "not stealing". Am I also "stealing proprietary U.S. technology" by harvesting my Claude chats from my `.claude` di…

It's an open-weight model so it literally doesn't matter whether it refuses by default or not, because it's pretty trivial to uncensor[1] any open-weight model and make it not refu…

> So they are essentially a protection against spurious errors Only coincidentally. Sampling nonsense tokens will certainly degrade its performance and/or brick it, but it's also t…

Obligatory "The Conspiracy Against High Temperature Sampling": https://gist.github.com/Hellisotherpeople/71ba712f9f899adcb0...

> And then there's the fact Fable is barely usable because it randomly downgrades to Opus out of nowhere whenever it thinks about exploits. I suspect it's not what you meant, but i…

...until you get rug-pulled (like with Fable recently) because the model you're depending on is proprietary, then you have fun with no model at all. The sooner Chinese labs catch u…

> In other words, it's the most average, the most flat. [..] And when you think about it, the AI's training data comes from the broadest consumer distribution. It spits out that ki…

> AI polished it [...] Compared to purely human writing [...] reads better than you'd expect I'd hard disagree here. Not when you're bombarded with this every single day. First, yo…

> the mechanics that make zoning real: why #[repr(C)] is load-bearing, why the magic number is often 128 and not 64, and why adding prefetch hints can make things worse. > The hone…

> HauHauCS has large collection but there are many others Before anyone recommends these models to other people I'd suggest they read this thread: https://old.reddit.com/r/LocalLLa…

> But if you assume he's just a villain You don't have to assume anything. A true "good guy" doesn't openly say that he's fine with autonomous, AI-powered weapons being used agains…

It's pretty much the same as when "installing programs on your computer" is called "sideloading". Deliberately deceptive, weaponized language to make it seem like a bad thing.

> That will put them in direct competition with Steam, though. Suddenly their cheaper console will result in way higher cost for the lifetime of the console. ...funny that so many …

> So although it's nice to have capable open models, it will increasingly bad for us all if open models keep fast-following closed model capabilities as they have been Cat's out of…

> What is Krea's approach to content such as pornography and gore? You mean whether it's censored? Of course it is. They even say so themselves[1]: > The open source version needed…

> Neither change has any technical reason. The only reason why either name change was desired is because some contributors were upset by the names. Indeed, neither has any technica…

> Well, because it's true: many of the repositories are named after "Wacom". It's a historical legacy on GNU/Linux. It's also a decade-long debate that these repos should be rename…

> the main thing that we've done is we've commissioned additional research on this because I've not been happy with the evidence. Ah, yes, the existing research doesn't agree with …

> I am pretty sure there are entire YouTube channels dedicated to this. There is: https://www.youtube.com/@Dr.Semiconductor