Viewing profile — mhjkl

If you adjust for writing speed, this model is already more efficient than humans. It can run at 233 tps on a 5090 which is roughly 10k words per minute compared to human typing sp…

This will make more money for Claude from individuals unofficially acting as meat puppets in more inefficient workflows

All big LLMs already visibly watermark all their text with easy to detect annoying phrases and turns of speech that everyone is already sick of hearing. Why do AI companies keep ma…

I’ve seen Chinese open weights models say “can’t use this if you’re in Europe” in their licenses, so I doubt they would invest too much into complying

You must not use any open source software, because much of it comes with a whole paragraph of ”IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES O…

If you’re on AMD, use llamacpp with the vulkan backend. For the 35B I get around 115 tps without mtp and 150-170tps with it. Also the pcie slot you use affects it

I'd say Anki has more friction that writing physical cards though

How do you make these compressed prompts like that

This comment would go hard in a sci-fi novel 5 years ago

During the dot com boom they said data centers consumed 8% of US electricity. It was later proven to be a lie, created with fake studies by coal companies to trick the US into buil…

Reminds me of the “Has The Turing Test Been Passed” website. It says no, but if you read on they cite “The relatively minimal funding allocated to AI research” as one of the reason…

Nim

Antis: "If AI is so useful, where are the AI shovelwares? Where are the AI open source contributions? It's all hype" 6 months later: Matz used Claude and now Ruby runs 86 times fas…

Reminds me of the Enron dataset

They didn’t need to wrap it because it’s modular arithmetic so the result after casting to int is the same regardless of wrapping behavior. 4294990000 after wrapping is 22704 and 4…

But the TSTMP_GEQ macro casts the difference to int, so any number above the signed integer limit (about 2 billion) becomes negative and the comparison returns false as they said

OP had no problem with pointers prior to trying C++. I think there is a case to be made that C(++) makes pointers unnecessarily confusing and there is no real disconnect between un…

You can remove and replace the switches too

What exactly broke? I had this problem recently and thought the keyboard was done for, but turns out you can also replace the switches (not keycaps) and that solved the issue in my…

Couldn't he just subcontract it out to whoever he needs to make his chips? Doesn't need to do anything himself

Afaik sodium batteries are much safer than li-ion and already in mass production. Unless Donut scales up really quick I think it will be more viable to just use sodium batteries fo…

There's a big difference between things like Metaverse, social media and AI. The former are mainly entertainment/communication products that rely on network effects, so if people d…

What RAM? OpenAI booked the silicon wafers, they can print anything they want on them. I wouldn't call them "far behind" on hardware when OpenAI are actively buying Cerebras chips.…

Because as we all know the EU would never try using AI for mass surveillance /s

Might as well just encode the Unix timestamp at creation into proquints.