OpenAI's plans according to sama • Hacker News Board

Re: OpenAI's plans according to sama

#51

Post by HarHarVeryFunny » Wed, May 31, 2023, 7:39 PM UTC

londons_explore wrote: post #5

> is limited by GPU availability. Which is all the more curious, considering OpenAI said this only in January: > Azure will remain the exclusive cloud provider for all OpenAI workloads across our research, API and products [1] So... OpenAI is severely GPU constrained, it is hampering their ability to execute, onboard customers to existing products and launch products. Yet they signed an agreement not to just go rent…

There's an interesting recent video here from Microsoft discussing Azure. The format is a bit cheesy, but lots of interesting information nonetheless.

https://www.youtube.com/watch?v=Rk3nTUfRZmo&t=5s "What runs ChatGPT? Inside Microsoft's AI supercomputer"

The relevance here is that Azure appears to be very well designed to handle the hardware failures that will inevitably happen during a training run taking weeks or months and using many thousands of GPUs... There's a lot more involved than just renting a bunch of Amazon GPUs, and anyways the partnership between OpenAI and Microsoft appears quite strategic, and can handle some build-out delays, especially if they are not Microsoft's fault.

Re: OpenAI's plans according to sama

#52

Post by m3kw9 » Wed, May 31, 2023, 7:39 PM UTC

If you look at their API limits, no serious company can use this to scale up beyond say 10k users. 3500 Reqs per min for gpt3.5 turbo. They have a long way to go to make it usable for the rest of the 95%

Re: OpenAI's plans according to sama

#53

Post by muskmusk » Wed, May 31, 2023, 7:43 PM UTC

asnyder wrote: post #18

His statements on open sourcing in this interview/write-up is somewhat in conflict with his recent statement made last week in Munich https://youtu.be/uaQZIK9gvNo?t=1170 , where he explicitly said the Frontier of GPT won't be open sourced due to what they perceive as safety reasons, https://youtu.be/uaQZIK9gvNo?t=1170 (19:30 - 22:00).

I don't see the conflict. They see current models as mostly harmless, but what comes next is dangerous.

It sounds a little too much sci-fi for me, but I guess he knows better.

Re: OpenAI's plans according to sama

#54

Post by m3kw9 » Wed, May 31, 2023, 7:45 PM UTC

boringuser2 wrote: post #3

>Dedicated capacity offering is limited by GPU availability. OpenAI also offers dedicated capacity, which provides customers with a private copy of the model. To access this service, customers must be willing to commit to a $100k spend upfront. How many shell corporations are intelligence agencies seeding right now?

They are not gonna give the weights for sure but it still will be inferencable, I’m not sure how but it’s be self destructive if they did

Re: OpenAI's plans according to sama

#55

Post by ren_engineer » Wed, May 31, 2023, 7:45 PM UTC

atemerev wrote: post #10

All AI companies (OpenAI included) are now working full tilt on making AIs improve themselves (writing their own code, inventing new pipelines etc). I don't know why choose anything else to work on. This is a prime directive, that will bring the greatest payoff.

if this was currently possible wouldn't it lead to sentient/superhuman AI rapidly?

>tell AI to make itself more efficient by finding performance improvements in human written code

>that newly available processing power can now be used to find more ways to improve itself

>flywheel effect of AI improving itself as it gets smarter and smarter

eventually you'd turn it loose on improving the actual hardware it runs on. I think the question now is really how far transformers can be taken and if they are really the path to "real" AI.

Re: OpenAI's plans according to sama

#56

Post by m3kw9 » Wed, May 31, 2023, 7:46 PM UTC

cwkoss wrote: post #19

boringuser2 wrote: post #3

>Dedicated capacity offering is limited by GPU availability. OpenAI also offers dedicated capacity, which provides customers with a private copy of the model. To access this service, customers must be willing to commit to a $100k spend upfront. How many shell corporations are intelligence agencies seeding right now?

Last night I was musing how many different countries' intelligence agencies have moles working at OpenAI currently. Gotta be at least 6, maybe as high as two dozen?

I bet the NSA has dossier on every employee there as well

Re: OpenAI's plans according to sama

#57

Post by m3kw9 » Wed, May 31, 2023, 7:47 PM UTC

flakiness wrote: post #44

If they open up fine-tuning API for their latest models, I wonder how the enthusiasm around the open source model is impacted. One of the advantages of the open source models is the ability to be fine-tuned. Are other benefits enough to keep the momentum going?

You better have deep pockets, have you check the prices and then the rates for using the tuned models? They sure 10x to 100x more expensive then nontuned models

Re: OpenAI's plans according to sama

#58

Post by m3kw9 » Wed, May 31, 2023, 7:50 PM UTC

atemerev wrote: post #10

All AI companies (OpenAI included) are now working full tilt on making AIs improve themselves (writing their own code, inventing new pipelines etc). I don't know why choose anything else to work on. This is a prime directive, that will bring the greatest payoff.

I think they are at least 1-2 new big research breakthroughs(on the level of Attention) away from having this.

Re: OpenAI's plans according to sama

#59

Post by boringuser2 » Wed, May 31, 2023, 7:50 PM UTC

m3kw9 wrote: post #54

boringuser2 wrote: post #3

>Dedicated capacity offering is limited by GPU availability. OpenAI also offers dedicated capacity, which provides customers with a private copy of the model. To access this service, customers must be willing to commit to a $100k spend upfront. How many shell corporations are intelligence agencies seeding right now?

They are not gonna give the weights for sure but it still will be inferencable, I’m not sure how but it’s be self destructive if they did

Exactly, with a private model you could easily extract the weights.

Re: OpenAI's plans according to sama

#60

Post by boringuser2 » Wed, May 31, 2023, 7:52 PM UTC

m3kw9 wrote: post #56

cwkoss wrote: post #19

Earlier quoted context omitted.

Last night I was musing how many different countries' intelligence agencies have moles working at OpenAI currently. Gotta be at least 6, maybe as high as two dozen?

I bet the NSA has dossier on every employee there as well

"Cooperate or we'll kill your family".

(Just to be clear, this is a hypothetical intelligence agent saying this, not me.)

I mean, it's not exactly rocket science, who wouldn't instantly fold to that?