Live data from Hacker News

OpenAI's plans according to sama

humanloop.com

221–230 of 269 posts

Re: OpenAI's plans according to sama

#221

Earlier quoted context omitted.

When you stop listening to what Sam Altman says and just focus on what he does, you can see the guy is a bit of a snake. Greedy power-hungry man imho.

I can't judge the individual, but his words do not align with the company's actions in the slightest. >> 4. OpenAI will avoid competing with their customers — other than with ChatGPT On this I would not bet a dime.

He didn't even pinky promise.

Re: OpenAI's plans according to sama

#222
post #184

Earlier quoted context omitted.

'It's not AGI yet' - the implication is insufferable. It's a language model that is incapable of any kind of reasoning, the talk of 'AGI' is a glib utopianism, a very heavy kind of koolaid. If we were to have referred to this tech as anything other than 'intelligence' - for example, if we chose 'adaptive algorithms' or 'weighted node storage' etc. we'd likely have a completely different popular mental model for it. T…

> incapable of any kind of reasoning If this were true the debate would be a hell of lot easier. Unfortunately, it is not.

In fact, comments like the one your are responding to are the most effective way to respond to ‘it hallucinates’.

Re: OpenAI's plans according to sama

#223

If they open source it, everyone would know that they used fuck ton of pirated content to train their models

As far as I'm aware training does not currently constitute "piracy". It's fine to advocate for a redefinition but be explicit about it.

I think the point here is about the procurement of the training data, in violation of copyright laws ("piracy"), rather than that the training itself is piracy.

The suspicion[0] is that OpenAI trained their models on a large text dump including libgen (in the so-called "books2").

If a person downloads a book from Library Genesis, they're a pirate; if OpenAI does it, so are they.

[0] https://twitter.com/theshawwn/status/1320282152689336320

Re: OpenAI's plans according to sama

#224

> OpenAI will avoid competing with their customers — other than with ChatGPT. Quite a few developers said they were nervous about building with the OpenAI APIs when OpenAI might end up releasing products that are competitive to them. Sam said that OpenAI would not release more products beyond ChatGPT. He said there was a history of great platform companies having a killer app and that ChatGPT would allow them to make…

Is this guy Aes Sedai? Technically he can claim that OpenAI will not release competing products while Microsoft plugs AI into everything . Microsoft just announced at Build 2023 that they'll have OpenAI tech integrated with: Windows, Bing, Outlook, Word, Teams, Visual Studio, Visual Studio Code, Microsoft Fabric, Dynamics, GitHub, Azure DevOps, and Logic Apps. I probably missed a bunch. Very soon now, everything Micr…

> Is this guy Aes Sedai?

Haha having just finished the Wheel of Time, I'm super tickled by this reference.

It doesn't seem to be too common, only two uses of it on HN in the past year (at least, found by searching for the phrase "Aes Sedai")

Re: OpenAI's plans according to sama

#225
post #224

Earlier quoted context omitted.

Is this guy Aes Sedai? Technically he can claim that OpenAI will not release competing products while Microsoft plugs AI into everything . Microsoft just announced at Build 2023 that they'll have OpenAI tech integrated with: Windows, Bing, Outlook, Word, Teams, Visual Studio, Visual Studio Code, Microsoft Fabric, Dynamics, GitHub, Azure DevOps, and Logic Apps. I probably missed a bunch. Very soon now, everything Micr…

> Is this guy Aes Sedai? Haha having just finished the Wheel of Time, I'm super tickled by this reference. It doesn't seem to be too common, only two uses of it on HN in the past year (at least, found by searching for the phrase "Aes Sedai")

It's the only such reference I could think of that others might recognise.

I'm reading the web serial Pact right now, where the main character can lie but it costs him dearly each time: https://pactwebserial.wordpress.com/

I also really enjoyed the ending of the Confederation Trilogy by Peter F Hamilton, which revolved around the inability of the Tyrathca race to tell lies.

PS: Just for laughs, I used to practice talking like an Aes Sedai, never telling an outright lie while actively deceiving people. It's an interesting skill to acquire and surprisingly easy. Once you learn how to do it, you'll never see a press conference or a political speech the same way ever again.

Re: OpenAI's plans according to sama

#227

> He reiterated his belief in the importance of open source and said that OpenAI was considering open-sourcing GPT-3. Part of the reason they hadn’t open-sourced yet was that he was skeptical of how many individuals and companies would have the capability to host and serve large LLMs. Am I reading this right? "We're not open sourcing GPT-3 because we don't think it would be useful to anyone else"

If small organizations and teams can’t use it, then open sourcing it mostly just benefits big tech That’s not ideal How does open source licensing work with respect to trained ai models anyway? Is something like the mit license even that valuable here? Or is it?

If the only barrier to a small team/org using it is cost/effort of hosting (as opposed to some licensing shenanigans), I fail to see how not releasing it is better for the world than releasing it would be. Even if it benefits big tech more than a small team.

Am I somehow being protected by a benevolent sama not open-sourcing the model?

Re: OpenAI's plans according to sama

#229
post #102

Earlier quoted context omitted.

if this was currently possible wouldn't it lead to sentient/superhuman AI rapidly? >tell AI to make itself more efficient by finding performance improvements in human written code >that newly available processing power can now be used to find more ways to improve itself >flywheel effect of AI improving itself as it gets smarter and smarter eventually you'd turn it loose on improving the actual hardware it runs on. I…

Within a couple of years of improvement processes like you suggest will actually be really dangerous and stupid. Also don't confuse all other types of human/animal characteristics like sentience with intelligence. They are different things. Things like sentience, subjective stream of experience, or other aspects of being alive don't just accidentally fall out of larger training datasets. And we should be glad. The mo…

> Things like sentience, subjective stream of experience, or other aspects of being alive don't just accidentally fall out of larger training datasets.

I disagree, language is all we need. Agency? Encode your “internal needs” as prompts, periodically generate prefixes from these, append them to incoming prompts. Self-awareness? Summarize this internal dialogue, reflect on it with a few iterations, add the results to the common prefix. Sentience? Attach some sensors, summarize their observations with the language model, prepend to prefix. Actions? Make the model output commands that some servos or other interfaces understand. Etc, etc.

And, of course, it would be extremely _cool_ to make something like that into a living creature, and lots of labs are already doing that. Fear and luddism should not stay in the way of curiosity.

If we humans cannot improve our own intelligence, making something smarter than us is an evolutionary imperative.

Re: OpenAI's plans according to sama

#230
post #224

Earlier quoted context omitted.

> Is this guy Aes Sedai? Haha having just finished the Wheel of Time, I'm super tickled by this reference. It doesn't seem to be too common, only two uses of it on HN in the past year (at least, found by searching for the phrase "Aes Sedai")

It's the only such reference I could think of that others might recognise. I'm reading the web serial Pact right now, where the main character can lie but it costs him dearly each time: https://pactwebserial.wordpress.com/ I also really enjoyed the ending of the Confederation Trilogy by Peter F Hamilton, which revolved around the inability of the Tyrathca race to tell lies. PS: Just for laughs, I used to practice tal…

I think we have very similar tastes. I haven't read Pact yet, but I'm a huge fan of Worm (I consider it one of my top 5 favorite works of fiction).

I also haven't read Confederation, but I have read a different work for Hamilton (The Commonwealth Saga). I actually thought it was a bit too long, but it's one of the series I think about most often (so many great ideas and characters in it).

Post reply on HN