Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI Status: Multiple engines are down

status.openai.com

Post reply on HN
Print view View original

81–90 of 167 posts

Re: OpenAI Status: Multiple engines are down

#81

Post by TOMDM »

scifibestfi wrote: post #55
t3rmi wrote: post #30

Earlier quoted context omitted.

Open AI's CEO Sam Altman's take is that they will only ever allow API access to their models to avoid misuse. I don't get HN's take with wanting everything open sourced. Some things are expensive to create and dangerous in the wrong hands. Not everything can and should be open sourced.

Isn't an open source ChatGPT inevitable? There's already open source AI art.

Check out the BLOOM models if you want to see a first stab at that.

If you can find an economical way of running it though, let me know.

Re: OpenAI Status: Multiple engines are down

#82

Post by [deleted] »

TOMDM wrote: post #64
ronsor wrote: post #57

Earlier quoted context omitted.

It's not as if anyone could afford to self-host the giant GPT-3 model anyway.

I'm rather sure there are a mid sized number of "anyones" who would buy the hardware required to run it given the opportunity. But I certainly agree that not everyone can, and very few individuals. The thing is a monster of a model.

[deleted]

Re: OpenAI Status: Multiple engines are down

#83

Post by Gigachad »

garrettjoecox wrote: post #32

Slightly funny but also slightly concerning, they were also having service issues a few days ago that resulted in ChatGPT giving me answers to prompts I wasn’t submitting. I reproduced this 30 or so times just to see the different results and it was interesting, everything from answering questions about mental health to marketing tips, to a request to write a thesis over social media and it’s negative effects on our…

I had the exact same issue, answers completely unrelated to my prompt and different every time I hit regenerate.

Re: OpenAI Status: Multiple engines are down

#84

Post by TOMDM »

DonHopkins wrote: post #71
rom-antics wrote: post #31

Earlier quoted context omitted.

Maybe if you post it a few more times your luck will change

Once all the GPTChat hn karma farming bots come back online.

Correlating user activity over periods of OpenAI API downtime would be an interesting activity.

"Okay guys, the API is down, you have until it's back up to talk to me about pink pigeons (or any other unpredictable topic of the referees choice you couldn't batch responses to ahead of time) to raise my confidence that you are in fact not a bot"

Re: OpenAI Status: Multiple engines are down

#85

Post by Gigachad »

la64710 wrote: post #16
ndneighbor wrote: post #7

Sending major hugs to their team, always hard to keep the lights on when I am sure that they are breaking scale records possibly every day.

This is precisely why they should really open source their model so that anyone can download and run it on their own infrastructure. Just like google or others have done and one is free to run it on their own laptop (some even without a GPU) , on premise or on any cloud provider infrastructure. They can continue to provide a hosted service for their model but they should allow it to be downloaded just like BERT.

The more realistic scenario is they charge money to use it. A few cents per query or so and you'll cut out almost all the traffic while still keeping it available to anyone making good use of it.

Re: OpenAI Status: Multiple engines are down

#86

Post by Gigachad »

CatWChainsaw wrote: post #46
mensetmanusman wrote: post #40

As an aside, I wonder when llm’s will be weaponized against authoritarian (China, etc) human censors, as they could be totally overwhelmed with content generation and be forced to censor all internet traffic…

I wonder when authoritarian censors will weaponize LLMs.

Seems like the more likely option. They could be used to live scan every post to work out what it's about and it's sentiment. Similar to how ChatGPT can work out if you are asking for something it won't answer, they could be used to work out if you are saying something not allowed.

Re: OpenAI Status: Multiple engines are down

#88

Post by localhost »

la64710 wrote: post #70
dontreact wrote: post #59

Earlier quoted context omitted.

Serving a request to one of their APIs requires orders of magnitude more compute than your typical web service

Really ? How do you know? Have they shared any credible data around it? Based on experience of BERT , yes maybe to get the best experience or to serve millions of users you need to run any model on compute intensive infrastructure , BUT if you just want to run for yourself and do some small testing you can very well download it from huggingface and elsewhere and run it on your laptop.

GPT3 is ~175B parameters. At float16 precision, that's 350GB of weights. BLOOM-176B is about the same size. Here's one person's experience; a token is ~0.75 words.

"The Python code in this tutorial generates one token every 3 minutes on a computer with an i5 11gen processor, 16GB of RAM, and a Samsung 980 PRO NVME..."

[1] https://towardsdatascience.com/run-bloom-the-largest-open-ac...

Re: OpenAI Status: Multiple engines are down

#89

Post by aliqot »

Gigachad wrote: post #85
la64710 wrote: post #16

Earlier quoted context omitted.

This is precisely why they should really open source their model so that anyone can download and run it on their own infrastructure. Just like google or others have done and one is free to run it on their own laptop (some even without a GPU) , on premise or on any cloud provider infrastructure. They can continue to provide a hosted service for their model but they should allow it to be downloaded just like BERT.

The more realistic scenario is they charge money to use it. A few cents per query or so and you'll cut out almost all the traffic while still keeping it available to anyone making good use of it.

I'd pay per query, but if it is per-token it's going to have to be free for what the machine says. It often repeats itself, or repeats certain phrases, or will restate an assertion it already agreed was incorrect.
Post reply on HN