Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI's plans according to sama

humanloop.com

Post reply on HN
Print view View original

231–240 of 269 posts

Re: OpenAI's plans according to sama

#231

Post by MaxPengwing »

seattle_spring wrote: post #199
TapWaterBandit wrote: post #132

Earlier quoted context omitted.

When you stop listening to what Sam Altman says and just focus on what he does, you can see the guy is a bit of a snake. Greedy power-hungry man imho.

I know it doesn't seem related on the surface, but I've found all startup CEOs who ban remote work to be snake-like and dishonest. Interesting coincidence at least.

Might it be that because they know that their own morals and ethics are so fluid that they therefore think than everyone else is the same and thus has to be surveilled to be sure to have "performance...? Just a thought....

Re: OpenAI's plans according to sama

#232

Post by poulpy123 »

brucethemoose2 wrote: post #118
purplecats wrote: post #32

> Cheaper and faster GPT-4 — This is their top priority. In general, OpenAI’s aim is to drive “the cost of intelligence” down as far as possible and so they will work hard to continue to reduce the cost of the APIs over time. this certainly aligns with the massive (albeit subjective and anecdotal) degradation in quality i've experienced with ChatGPT GPT-4 over the past few weeks. hopefully a superior (higher quality)…

Anthropic's Claude is said to be very good. Instruction tuned LLaMA 65B/Falcon 40B are good, especially with an embeddings database. ...But OpenAI has all the name recognition and ease of use now, so it might not even matter if others ambiguously surpass OpenAI models.

I don't have access to GPT-4 but claude is competiting with gpt-3.5 (chatgpt) and bingAI (whatever they use)

Re: OpenAI's plans according to sama

#233

Post by askkk »

Imnimo wrote: post #161

>The fact that scaling continues to work has significant implications for the timelines of AGI development. The scaling hypothesis is the idea that we may have most of the pieces in place needed to build AGI and that most of the remaining work will be taking existing methods and scaling them up to larger models and bigger datasets. If the era of scaling was over then we should probably expect AGI to be much further a…

I always enjoy reading some of your comments, they ameliorate the hype about LLM and give a critical review. Anyway, I think a stronger model than GPT-4 could improve the way to use tools, so that the model is able to self-improve using tools. For example using all kind of solvers and heuristics to guide the model. I don't know how to estimate that risk just now.

Edited: Don't know if is a good thing to study the weak points of closed LLMs. Even asking LLMs can give hints about possible ways to improve. In my case I am happy I am certainly old and my mind is a lot weaker than before, but even in this case I prefer not to use LLMs for gaining insight because she will someday get a better insight than myself. But the lust of knowledge is a mortal sin.

Re: OpenAI's plans according to sama

#234

Post by PoignardAzur »

outside1234 wrote: post #177
neximo64 wrote: post #168

Earlier quoted context omitted.

In your world how would you consider Sam Altman having no equity in OpenAI? And everyone finding out after it had a viral hit

There is no way this guy hasn't figured out some way to get paid out of this. We just haven't figured out how yet.

I mean, Occam's Razor says if he wanted a way to get paid, he would just have equity or a very large salary, the normal things CEOs do when they want to make lots of money from their very profitable company.

Re: OpenAI's plans according to sama

#235

Post by ryanmercer »

outside1234 wrote: post #177
neximo64 wrote: post #168

Earlier quoted context omitted.

In your world how would you consider Sam Altman having no equity in OpenAI? And everyone finding out after it had a viral hit

There is no way this guy hasn't figured out some way to get paid out of this. We just haven't figured out how yet.

Or maybe he just doesn't need more money and wants to do something cool? If my basic needs were met, I'd go volunteer at any number of non-profits full time.

Re: OpenAI's plans according to sama

#236

Post by ryanmercer »

stavros wrote: post #64
sharkjacobs wrote: post #24

> He reiterated his belief in the importance of open source and said that OpenAI was considering open-sourcing GPT-3. Part of the reason they hadn’t open-sourced yet was that he was skeptical of how many individuals and companies would have the capability to host and serve large LLMs. Am I reading this right? "We're not open sourcing GPT-3 because we don't think it would be useful to anyone else"

Reads to me like "we don't know how many people will have hardware powerful enough to run this".

Exactly. If you make it open source, great, cool, but only well-funded entities - like massive corporations - can even afford the hardware costs.

Re: OpenAI's plans according to sama

#237

Post by laratiede »

theonlybutlet wrote: post #213
purplecats wrote: post #32

> Cheaper and faster GPT-4 — This is their top priority. In general, OpenAI’s aim is to drive “the cost of intelligence” down as far as possible and so they will work hard to continue to reduce the cost of the APIs over time. this certainly aligns with the massive (albeit subjective and anecdotal) degradation in quality i've experienced with ChatGPT GPT-4 over the past few weeks. hopefully a superior (higher quality)…

Has anyone compared the ChatGPT GPT-4 performance in the plus subscription to that of the API? Has the API performance deteriorated just as much? It would be strange if it did as I'd assume the models costs are priced in there.

People state this as if it is fact when there is no good way to measure this.

I have had random runs of good days and bad days since starting to use chatGPT.

Re: OpenAI's plans according to sama

#238

Post by stavros »

ryanmercer wrote: post #236
stavros wrote: post #64

Earlier quoted context omitted.

Reads to me like "we don't know how many people will have hardware powerful enough to run this".

Exactly. If you make it open source, great, cool, but only well-funded entities - like massive corporations - can even afford the hardware costs.

Eh, better than nobody.

Re: OpenAI's plans according to sama

#239

Post by PoignardAzur »

Imnimo wrote: post #175
sanxiyn wrote: post #163

Earlier quoted context omitted.

Someone did that calculation and the result is here: https://www.reddit.com/r/slatestarcodex/comments/13u40yf/ 100x GPT-4 to 85%.

And, if I'm reading their calculation right, that's 85% on the medium-difficulty bucket, not even the entire HumanEval benchmark? (quoting from the GPT-4 paper): >All but the 15 hardest HumanEval problems were split into 6 difficulty buckets based on the performance of smaller models. The results on the 3rd easiest bucket are shown in Figure 2

That does seem to support the idea that we're two or three major breakthroughs away from superintelligent AGI, assuming these scaling curves keep holding as they have.

Re: OpenAI's plans according to sama

#240

Post by ryanmercer »

boringuser2 wrote: post #3

>Dedicated capacity offering is limited by GPU availability. OpenAI also offers dedicated capacity, which provides customers with a private copy of the model. To access this service, customers must be willing to commit to a $100k spend upfront. How many shell corporations are intelligence agencies seeding right now?

Why bother with shell corps when they already back companies in the clear: look at In-Q-Tel.
Post reply on HN