451–460 of 596 posts
At the risk of being off topic (well, definitely): > in a post on X, formerly Twitter It keep surprising me that someone can so completely torpedo their brand that news organisations feel compelled to keep referring to the old name so people have some idea of what they’re talking about.
At the risk of being off topic (well, definitely): > in a post on X, formerly Twitter It keep surprising me that someone can so completely torpedo their brand that news organisations feel compelled to keep referring to the old name so people have some idea of what they’re talking about.
The last time I recall the press using similar language was when the subject was intentionally damaging their own brand due to a contract grievance: "[glyph] (the artist formerly known as Prince)"
Many are speculating that Sam Altman could just move on and create another OpenAI 2.0 because he could easily attract talent and investors. What this misses is all the regulatory capture that he’s been campaigning for. All the platforms have now closed their gardens. Authors and artists are much more vigilant about copyright etc. So it’s now a totally different game compared to 3 years ago because the data is not jus…
I don't think getting training data is that hard still, the biggest platforms that locked down their APIs still use them for their mobile apps and can easily be reverse engineered to find keys or undocumented endpoints (or in the case of reddit, an entirely different internal API with less limits and a lot more info leaks...)
https://academictorrents.com/details/89d24ff9d5fbc1efcdaf9d7...
Earlier quoted context omitted.
From everything I can piece together the underlying problem is that Sam defunded Ilya's alignment research because they only have so much compute and they needed all of it to keep up with the demand for ChatGPT and the APIs, especially after dev day. Ilya losing access to the GPUs he needs to do his research so that the company can service a few more customers seemed like a fundamental betrayal to him and a sign that…
> If Elon is able to promise him the resources he needs to do his research then I think it could work out. Who on earth would ever trust an Elon promise at this point? The guy literally can’t open his mouth without making a promise he can’t keep. Unless Ilya is getting something in a bulletproof contract and is willing to spend a decade fighting for it in court, he’s an idiot doing anything with Elon.
Earlier quoted context omitted.
I was under the impression that the transformer is the tech making openai function, and that Ilya's name is not on the 2017 paper introducing the idea.
I believe you're underestimating how key RLHF seems to be to getting a functioning chatbot with human-like behaviors.
Earlier quoted context omitted.
I don't think getting training data is that hard still, the biggest platforms that locked down their APIs still use them for their mobile apps and can easily be reverse engineered to find keys or undocumented endpoints (or in the case of reddit, an entirely different internal API with less limits and a lot more info leaks...)
Easier than that would just be downloading the torrent of all of Reddit through Sept 2023. https://academictorrents.com/details/89d24ff9d5fbc1efcdaf9d7...
I assume this must be only the text portion, and heavily compressed?
Earlier quoted context omitted.
The board were literally doing their job. Anyone claiming incompetence is just mistaken about the stated goal of openai: safe available agi for all. Throw in a huge investment, a 90 billion dollar valuation and a rockstar ceo. It’s pretty clear the court of public opinion is wrong about this case.
Competence is generally about effectiveness of execution, and less about intent. This was a foreseeable hot mess executed with staggering naïveté.
Then, he progressively sold more and more of the companies future to Ms.
You don’t need chatgpt and it’s massive gpu consumption to achieve the goals of openai. A small research team and a few million, this company becomes a quaint quiet overachiever.
The company started to hockey stick and everyone did what they knew, Sam got the investment and money. The tech team hunkered down and delivered gpt-4 and soon -5
Was there a different path? Maybe.
Was there a path that didn’t lead to selling the company for “laundry buddy”, maybe also.
On the other hand, Ms knew what they were getting into when its hundredth lawyer signed off on the investment. To now turn around as surprised pikachu when the board starts to do its job and their man on the ground gets the boot is laughable.
Many are speculating that Sam Altman could just move on and create another OpenAI 2.0 because he could easily attract talent and investors. What this misses is all the regulatory capture that he’s been campaigning for. All the platforms have now closed their gardens. Authors and artists are much more vigilant about copyright etc. So it’s now a totally different game compared to 3 years ago because the data is not jus…
Is the logic here that training a base model isn’t as easy or even possible in the same way that OpenAI did in the past, and that what they have in a trained model is valuable in that even with all the code and experience it couldn’t be reproduced today with new restrictions?
The data has to come from somewhere, and all of the outlets that were used to train ChatGPT, stable diffusion, etc. have since been locked down. Any new company that Sam Altman makes in the AI space won't be competing just on merits of talent and product, they will also need to pay for and negotiate access to data.
I'd actually expect this to get far worse going forward, now that other organizations have an idea of how valuable their data is. It's also trivial to justify locking it down under the guise of protecting people, privacy, etc.