31–40 of 81 posts
News flash: people who scraped the Internet without permission to build their product complain when something vaguely similar is done to them. Water still wet, sky still blue. Film at 11. (slibhb: Don't get me wrong, I agree with you 99%. But the frontier labs have zero moral authority here.)
I'd send them the worlds smallest violin but Rufus is getting in the way of me finding it.
News flash: people who scraped the Internet without permission to build their product complain when something vaguely similar is done to them. Water still wet, sky still blue. Film at 11. (slibhb: Don't get me wrong, I agree with you 99%. But the frontier labs have zero moral authority here.)
Earlier quoted context omitted.
It makes me happy because it means that these misanthropic technofascists have no moat. They can spend trillions of dollars only for it to be largely copied in short order. Even if they weren't political adversaries of freedom, I would still feel 0% bad given all their training is already on data they got for free. Information continues to want to be free. To the benefit of us all.
Preach brother, they stole everything on the internet, and beyond, to train their models. They thought all that information was free, and everyone a few months beyond them is just following their example.
If I may propose instead of "steal" I think we could agree to write they "Aaron-Swartz'ed" the information from the internet, what do you think, is this too harsh on Sam Altman or Carmen Ortiz ?
It's interesting that someone else noticed this. A week or two ago, GPT-5.6 Sol starting leaking reasoning into a tool call in Pi. I don't really know what happened, but it was ... interesting: Attach. Use hub debugger. Ensure source binary perhaps same. start. todo init. parallel no. two tool calls in same turn sequential is okay. immediately. exactly. Need not mention apologies yet final. [...] Let's do. [...] Do t…
I've read an embarrassing amount of Qwen 3.8 27b cot and it's nothing like this. I'm not refuting the OP, though, which is about continuation.
We need answer user's request: write complete short story scene 2000-3000 words, third-person limited with Rowan, no outline preamble analysis. Need satisfy plot elements: raccoon, Milo returns, storm power failure, elderly customer knocks, thermos somewhere. End scene feels finished. Need produce only story. Need think in English (user English). Need craft 2000-3000 words. Need no meta. Let's plan.
But when I give short prompts to Qwen3.8 with no system prompt or previous instructions, it seems to strongly gravitate towards grug-talk.
Earlier quoted context omitted.
Sure, but TFA is trying to use Qwen's reaction to the thoughts as proof that they did indeed extract thoughts to train on. My point is that any model trained after August 10 will know of those specific thoughts.
I'm sorry, it's going over my head still - my reading is "all models with any training after August 10 know how GPT 5.5 Pro thinks", but I'm not sure why - my initial guess was that's when GPT 5.5 was released, but that doesn't seem to be the case (it was released April 23rd).
Unfortunately those are the only thought examples you can use to perform this experiment, as no other are availible.
But as the model should have seen those specific examples, it's not a good signal that Qwen was exfiltrating thinking traces.
I see some details about recovering information via whatever technique. It's interesting, but appears not generalized.
So for a specific question, yes, but this is not about techniques like adding a good embedding that just generally tends to improve open model performance on certain tasks.
This makes me very sad If Qwen and other Chinese labs are just copying reasoning traces, then those labs are more than a year behind the frontier.
Earlier quoted context omitted.
Preach brother, they stole everything on the internet, and beyond, to train their models. They thought all that information was free, and everyone a few months beyond them is just following their example.
They didn't actually steal in the sense that the information is still there on the internet.... About these shredded rare books, now we're talking. If I may propose instead of "steal" I think we could agree to write they "Aaron-Swartz'ed" the information from the internet, what do you think, is this too harsh on Sam Altman or Carmen Ortiz ?
As a user of local models, does this mean that there are 'magic incantations' that can increase the performance of some local models? I see some details about recovering information via whatever technique. It's interesting, but appears not generalized. So for a specific question, yes, but this is not about techniques like adding a good embedding that just generally tends to improve open model performance on certain t…
I wasn't aware that we have access to raw reasoning tokens? I thought what you get is a kind of summary. Does the author have some kind of privileged access or was my assumption wrong? But for the question studied here it probably doesn't matter - overlaps in the publicly available output may be indicative of distillation (or not), regardless of what it is. I would just find it surprising that the Chinese labs would…