Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI's plans according to sama

humanloop.com

Post reply on HN
Print view View original

191–200 of 269 posts

Re: OpenAI's plans according to sama

#191

Post by sroussey »

vpastore wrote: post #179
neximo64 wrote: post #178

Earlier quoted context omitted.

that just sounds ridiculous. Teams would have been over the legals for a $10bn investment. Not everyone is financially incentivised. Also he's already half way to being a billionaire anyway without OpenAI.

[flagged]

Dude, he absolutely loves to talk about incentives.

Now that’s neither here nor there response to yours… but since he is so in tune with the concept of incentives, and likes to discuss them, it does make me curious what his incentives are that he is acting on.

Re: OpenAI's plans according to sama

#192

Post by SanderNL »

jasmer wrote: post #184
twobitshifter wrote: post #136

Left the best part until the end. Scaling models larger is still paying off for openai. It’s not AGI yet, but how much bigger will a model need to get to max out? >The scaling hypothesis is the idea that we may have most of the pieces in place needed to build AGI and that most of the remaining work will be taking existing methods and scaling them up to larger models and bigger datasets. If the era of scaling was over…

'It's not AGI yet' - the implication is insufferable. It's a language model that is incapable of any kind of reasoning, the talk of 'AGI' is a glib utopianism, a very heavy kind of koolaid. If we were to have referred to this tech as anything other than 'intelligence' - for example, if we chose 'adaptive algorithms' or 'weighted node storage' etc. we'd likely have a completely different popular mental model for it. T…

> incapable of any kind of reasoning

If this were true the debate would be a hell of lot easier. Unfortunately, it is not.

Re: OpenAI's plans according to sama

#193

Post by courseofaction »

TapWaterBandit wrote: post #132
sharkjacobs wrote: post #24

> He reiterated his belief in the importance of open source and said that OpenAI was considering open-sourcing GPT-3. Part of the reason they hadn’t open-sourced yet was that he was skeptical of how many individuals and companies would have the capability to host and serve large LLMs. Am I reading this right? "We're not open sourcing GPT-3 because we don't think it would be useful to anyone else"

When you stop listening to what Sam Altman says and just focus on what he does, you can see the guy is a bit of a snake. Greedy power-hungry man imho.

I can't judge the individual, but his words do not align with the company's actions in the slightest.

>> 4. OpenAI will avoid competing with their customers — other than with ChatGPT

On this I would not bet a dime.

Re: OpenAI's plans according to sama

#194

Post by antupis »

razcle wrote: post #120
sharkjacobs wrote: post #24

> He reiterated his belief in the importance of open source and said that OpenAI was considering open-sourcing GPT-3. Part of the reason they hadn’t open-sourced yet was that he was skeptical of how many individuals and companies would have the capability to host and serve large LLMs. Am I reading this right? "We're not open sourcing GPT-3 because we don't think it would be useful to anyone else"

I think I worded this poorly. What he said was that a lot of people say they want open-source models but they underestimate how hard it is to serve them well. So he wondered how much real benefit would come from open-sourcing them. I think this is reasonable. Giving researchers access is great but for most small companies they're likely better off having a service provider manage inference for them rather than naviga…

If it goes same way as other open sourced models it takes about 5 days that someone will get it running at m1.

Re: OpenAI's plans according to sama

#195

Post by adlpz »

r3trohack3r wrote: post #162
sovietmudkipz wrote: post #7

I’m hoping GPT will remove the information cutoff date. I write plenty of terraform/AWS and it’s a bit of a pain that the latest API isn’t accessible by GPT yet. There’s been quite a bit happening in the programming space since sept 2021. I use GPT to keep things high level and then do my normal research methodology for implementation details.

Injecting the context yourself can help a lot. I frequently copy in a bunch of example code at the beginning of the conversation to help prime ChatGPT on APIs it knows nothing about. For smaller projects that will fit, I've taken to: `xclip *` and then pasting the entire collection of files into ChatGPT before describing what I want to do.

Keep in mind that GPT-4 has a max context size of ~8000 tokens, if I recall correctly. That means that in any given ChatGPT session the bot only remembers roughly the last ~6k words, as a trailing window. It'll forget the stuff at the beginning fast.

Re: OpenAI's plans according to sama

#196

Post by 55555 »

legendofbrando wrote: post #154
brucethemoose2 wrote: post #118

Earlier quoted context omitted.

Anthropic's Claude is said to be very good. Instruction tuned LLaMA 65B/Falcon 40B are good, especially with an embeddings database. ...But OpenAI has all the name recognition and ease of use now, so it might not even matter if others ambiguously surpass OpenAI models.

The problem with Claude is that it is quite literally impossible to get off the waiting list to use it. To OpenAI’s credit they actually ship the product in an accessible way to developers.

Poe.com. Takes 1 minute to sign up and then you can use it for 7 days for free. Pretty sweet deal. Not affiliated.

Re: OpenAI's plans according to sama

#197

Post by f6v »

mellosouls wrote: post #146
TapWaterBandit wrote: post #132

Earlier quoted context omitted.

When you stop listening to what Sam Altman says and just focus on what he does, you can see the guy is a bit of a snake. Greedy power-hungry man imho.

Sam Altman is responsible for leading the team that have revolutionised AI in its position within society. There is plenty to criticise OpenAI for but what he and they have achieved is extraordinary, and there is no need for that sort of toxic personal attack.

I can’t comment on his personality because I don’t know him. But it’s delusional to think the leadership’s personal qualities are irrelevant to developing AI. There’s going to be a lot of subjectivity in fine-tuning the answers.

Re: OpenAI's plans according to sama

#198

Post by f6v »

bane wrote: post #188
sharkjacobs wrote: post #24

> He reiterated his belief in the importance of open source and said that OpenAI was considering open-sourcing GPT-3. Part of the reason they hadn’t open-sourced yet was that he was skeptical of how many individuals and companies would have the capability to host and serve large LLMs. Am I reading this right? "We're not open sourcing GPT-3 because we don't think it would be useful to anyone else"

Most of the companies I work with are actively putting in place policies to prevent employees from using OpenAI's service because nobody wants to send their proprietary IP to them. Almost all of these companies have the technical ability, desire, and means to self-host for their employee community. Imagine the internal coup for CTO/CIOs everywhere to buy whatever is the latest Nvidia GPU cluster box, stick it in the…

> Almost all of these companies have the technical ability, desire, and means to self-host for their employee community.

Well, one of companies I worked for could have hosted a canary service for cron jobs. But we bought it instead of building because we were focused on building features. And here you’re talking about hosting an entire LLM.

Re: OpenAI's plans according to sama

#199

Post by seattle_spring »

TapWaterBandit wrote: post #132
sharkjacobs wrote: post #24

> He reiterated his belief in the importance of open source and said that OpenAI was considering open-sourcing GPT-3. Part of the reason they hadn’t open-sourced yet was that he was skeptical of how many individuals and companies would have the capability to host and serve large LLMs. Am I reading this right? "We're not open sourcing GPT-3 because we don't think it would be useful to anyone else"

When you stop listening to what Sam Altman says and just focus on what he does, you can see the guy is a bit of a snake. Greedy power-hungry man imho.

I know it doesn't seem related on the surface, but I've found all startup CEOs who ban remote work to be snake-like and dishonest. Interesting coincidence at least.

Re: OpenAI's plans according to sama

#200

Post by pindab0ter »

jeffybefffy519 wrote: post #145

Title needs an update as Sama is also the name of the company which helped classify training data for ChatGPT: https://time.com/6247678/openai-chatgpt-kenya-workers/

I agree. Not using the actual name is also gate keeping for anyone not familiar enough. The fact that “sama” isn’t even capitalised adds to this.
Post reply on HN