Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI Status: Multiple engines are down

status.openai.com

Post reply on HN
Print view View original

21–30 of 167 posts

Re: OpenAI Status: Multiple engines are down

#21

Post by scratchyone »

la64710 wrote: post #15
TOMDM wrote: post #14

LLM's are incredibly expensive to run. I imagine the huge demand that ChatGPT is seeing would make any cloud vendor sweat if you were to suddenly lump it on top of the usual demand. To me it's entirely unsurprising that OpenAI would have trouble keeping up. Good luck to them.

This is precisely why they should really open source their model so that anyone can download and run it on their own infrastructure. Just like google or others have done and one is free to run it on their own laptop (some even without a GPU) , on premise or on any cloud provider infrastructure. They can continue to provide a hosted service for their model but they should allow it to be downloaded just like BERT.

Why did you comment this 3 separate times?

Re: OpenAI Status: Multiple engines are down

#22

Post by shric »

la64710 wrote: post #13
la64710 wrote: post #10

This is precisely why they should really open source their model so that anyone can download and run it on their own infrastructure. Just like google or others have done and one is free to run it on their own laptop (some even without a GPU) , on premise or on any cloud provider infrastructure. They can continue to provide a hosted service for their model but they should allow it to be downloaded just like BERT.

Not sure why this gets downvoted. But sometimes HN just cannot take the truth.

It might be the fact that you spammed identical posts at least 3 times in these comments

Re: OpenAI Status: Multiple engines are down

#23

Post by la64710 »

rom-antics wrote: post #18
la64710 wrote: post #10

This is precisely why they should really open source their model so that anyone can download and run it on their own infrastructure. Just like google or others have done and one is free to run it on their own laptop (some even without a GPU) , on premise or on any cloud provider infrastructure. They can continue to provide a hosted service for their model but they should allow it to be downloaded just like BERT.

I have a feeling ChatGPT requires hundreds of GB of GPU RAM, so no, you couldn't run it on your laptop.

ChatGPT might but The LLLM model may not require so many nodes specially if someone is running for their own dataset.

Re: OpenAI Status: Multiple engines are down

#24

Post by TOMDM »

la64710 wrote: post #15
TOMDM wrote: post #14

LLM's are incredibly expensive to run. I imagine the huge demand that ChatGPT is seeing would make any cloud vendor sweat if you were to suddenly lump it on top of the usual demand. To me it's entirely unsurprising that OpenAI would have trouble keeping up. Good luck to them.

This is precisely why they should really open source their model so that anyone can download and run it on their own infrastructure. Just like google or others have done and one is free to run it on their own laptop (some even without a GPU) , on premise or on any cloud provider infrastructure. They can continue to provide a hosted service for their model but they should allow it to be downloaded just like BERT.

Don't get me wrong, I'd love to be able to run GPT3 and the subsequent finetuned versions thereof myself, but OpenAI has essentially no financial incentive to do so.

A few years ago, we could maybe lean on their open aspirations to get that done, but with the "limited profitibility model" they've since instead adopted, I think that dream is mostly gone.

At least we still get the occasional treat like Whisper out of them.

Re: OpenAI Status: Multiple engines are down

#26

Post by [deleted] »

scratchyone wrote: post #21
la64710 wrote: post #15

Earlier quoted context omitted.

This is precisely why they should really open source their model so that anyone can download and run it on their own infrastructure. Just like google or others have done and one is free to run it on their own laptop (some even without a GPU) , on premise or on any cloud provider infrastructure. They can continue to provide a hosted service for their model but they should allow it to be downloaded just like BERT.

Why did you comment this 3 separate times?

[deleted]

Re: OpenAI Status: Multiple engines are down

#27

Post by [deleted] »

TOMDM wrote: post #14

LLM's are incredibly expensive to run. I imagine the huge demand that ChatGPT is seeing would make any cloud vendor sweat if you were to suddenly lump it on top of the usual demand. To me it's entirely unsurprising that OpenAI would have trouble keeping up. Good luck to them.

[deleted]

Re: OpenAI Status: Multiple engines are down

#28

Post by 29athrowaway »

la64710 wrote: post #19
29athrowaway wrote: post #17

Earlier quoted context omitted.

It takes a fortune to pay for the computing infrastructure to train a model. It takes an additional fortune to pay humans to do RLHF (reinforcement learning from human feedback). It takes an additional fortune to serve the model. There are also researchers getting paid there that live in one of the most expensive hubs in the world.

That’s fine .. but do you think Google didn’t do it? There is more at stake here than just dollars.

Their research business units (cost centers) are financed with revenue from their profit centers (adtech).

Re: OpenAI Status: Multiple engines are down

#30

Post by t3rmi »

la64710 wrote: post #15
TOMDM wrote: post #14

LLM's are incredibly expensive to run. I imagine the huge demand that ChatGPT is seeing would make any cloud vendor sweat if you were to suddenly lump it on top of the usual demand. To me it's entirely unsurprising that OpenAI would have trouble keeping up. Good luck to them.

This is precisely why they should really open source their model so that anyone can download and run it on their own infrastructure. Just like google or others have done and one is free to run it on their own laptop (some even without a GPU) , on premise or on any cloud provider infrastructure. They can continue to provide a hosted service for their model but they should allow it to be downloaded just like BERT.

Open AI's CEO Sam Altman's take is that they will only ever allow API access to their models to avoid misuse.

I don't get HN's take with wanting everything open sourced. Some things are expensive to create and dangerous in the wrong hands. Not everything can and should be open sourced.

Post reply on HN