721–730 of 1001 posts
Earlier quoted context omitted.
If humans can figure out to optimize to circumvent bottlenecks, I have no doubt each new bottleneck will also get routed around, just now automated.
How do you automate the mines to get the raw materials to make the compute from, and build additional fabs that take a almost a decade to stand up. You're actually delusional.
Is this the one that was allegedly based on someone else's actual work & prompts? https://news.ycombinator.com/item?id=49605915 https://bsky.app/profile/quantian.bsky.social/post/3muyhwbcd... https://cims.nyu.edu/~tristanb/statement.pdf
Yes, that was the allegation last night. I work at OpenAI, though not on the team that did this, and my understanding is: - we decided to ask our model for Millenium problem solutions because of two reasons: (a) our new model was looking incredibly good and (b) we heard rumors that some Millenium problems had been solved and were curious if our models could solve them (the goal here was not to scoop any particular in…
> How we found the proof Easy, we stole it from Levent and Tristan https://x.com/kyanyang_/status/2097211154669998337
This is the academic equivalent of Trump saying "they stole the election". There's no proof of it but rah rah fuck OpenAI. It's incredibly tiresome and you'd think people could put more effort into it than just following whatever vibes they agree with. Oh well.
having a result means the math can keep moving forward, and having openai and anthropic train against how mathematicians use their models should let math continue to move faster, and the rest of us get to benefit.
I think these traces however should be public domain and publicly available, since they are basically university work
Earlier quoted context omitted.
If they opted out of training, then we definitely did not train on them. If they did not opt out, then I don't personally know if training signals came from their chats, and I don't think we'd be able to tell without their cooperation in identifying them. And even if signals were trained on in some manner, I highly doubt it made a difference to a problem as challenging as the NS proof. Reasons for my doubt: - I know…
That's not what your Chief Research Officer, Mark Chen, says on X: "Do we use user feedback and de-identified data to improve ChatGPT and Codex in a holistic way? Yes. And so does every LLM company." https://x.com/markchen90/status/2097400166554993041
Earlier quoted context omitted.
It's incredible to me that every single time there's a new model people scream "singularity" from the rooftops and every time they are wrong. This is an impressive result, but there is absolutely zero evidence of "the singularity".
It is not reasonable to not believe anything unless there is "evidence" (narrowly construed as an observation incompatible with the negation of some state of affairs). Beliefs have a wide spectrum of characterizations, and not all belief must wait until publicly corroborated evidence is available. Some events defy evidence and we can and should use experience and reasoning to infer unobservable states of affairs.
Earlier quoted context omitted.
Whether or not ways exist to work around the singularities, that they exist is surely of note. Before von Neumann formalized QM people were still doing QM, okay fine. But it's wrong to then say von Neumann was doing no physics of note.
"Does there exist a pathological combination of smooth body forces and initial conditions for this set of PDEs, where singularities appear, which by the way is completely impossible to actually create in the real world unless you are a literal God?" is a question of math, not physics. This is a hill I will die on.
Earlier quoted context omitted.
Let's wait until AI solves a longstanding practical problem before "dawn of the singularity" (which could be tomorrow, but still).
Practical?! The goalposts will keep moving until morale improves (narrator: it doesn't)
"Moving the goalposts" as shallow dismissal doesn't work if e.g. someone points out AI hasn't even built a new type of spaceship yet in response to a claim that AI is on the verge of building a Dyson sphere.
Earlier quoted context omitted.
Everyone knows that they train on the discounted rate plans data. All the labs are upfront about this too. If you need privacy, then you are going to have to pay full price for those tokens (API). This has been true since day one. Everyone knows it, I guess though this is the first time that it has become "real".
> If you need privacy, then you are going to have to pay full price for those tokens (API). At this point, how can we even trust that they aren't accidentally training on those tokens too?
Earlier quoted context omitted.
>If anyone has counterpoints to this I'd love to hear them! Sure. A proof without an unknown amount of human steering (and/or stolen research) would be an unquestionable achievement. To this day there's zero (0) evidence of any result by an LLM alone (maybe I'm wrong). If I just prompt ChatGPT right now with "give me a proof of the Riemann Hypothesis" and this thing delivers, I'm sold. But anything close to "yeah Cha…
The amount of goalpost moving is insane. "Yeah it can solve Millenium problems, but can it do it with nothing more than a one sentence prompt?" Also there are proofs where the only human steering was "keep going".