Earlier quoted context omitted.
Probably because you posted this three times.
No that was after I got downvoted.
Maybe if you post it a few more times your luck will change
OpenAI Status: Multiple engines are down
31–40 of 167 posts
Re: OpenAI Status: Multiple engines are down
#32Slightly funny but also slightly concerning, they were also having service issues a few days ago that resulted in ChatGPT giving me answers to prompts I wasn’t submitting. I reproduced this 30 or so times just to see the different results and it was interesting, everything from answering questions about mental health to marketing tips, to a request to write a thesis over social media and it’s negative effects on our society.
Of course, upon trying the next day, all was fine again and I was no longer able to reproduce.
Re: OpenAI Status: Multiple engines are down
#33Earlier quoted context omitted.
Probably because you posted this three times.
No that was after I got downvoted.
When I loaded the page you had posted this one 7 min ago and the other two 4 min ago.
7 min was the third time I'd read your comment so I downvoted it.
Can't speak for anyone else but aye it's definitely because you posted the same thing thrice for me. The first version (topmost rated) of your comment doesn't seem to be downvoted
Re: OpenAI Status: Multiple engines are down
#34With all of these outages, you have to wonder if it's a lack of skilled engineers on their part, or if they simply don't have enough GPUs to keep the lights on all the time.
A friend that interviewed with them shared that they were a bit too smug about “running at google scale with much leaner but highly skilled staff” (paraphrasing here). Perhaps it starts becoming clear why you need that kind of staffing…
Re: OpenAI Status: Multiple engines are down
#35Earlier quoted context omitted.
This is precisely why they should really open source their model so that anyone can download and run it on their own infrastructure. Just like google or others have done and one is free to run it on their own laptop (some even without a GPU) , on premise or on any cloud provider infrastructure. They can continue to provide a hosted service for their model but they should allow it to be downloaded just like BERT.
Open AI's CEO Sam Altman's take is that they will only ever allow API access to their models to avoid misuse. I don't get HN's take with wanting everything open sourced. Some things are expensive to create and dangerous in the wrong hands. Not everything can and should be open sourced.
Yeah, just like the existence of Windows prevented Linux from ever existing.
The wrong hands have the money to seek alternatives. All this policy does is keep it out of the hands of the public, and ensure that whatever open alternatives start up won't be OpenAI's.
Re: OpenAI Status: Multiple engines are down
#36With all of these outages, you have to wonder if it's a lack of skilled engineers on their part, or if they simply don't have enough GPUs to keep the lights on all the time.
The have first-class platform and systems engineers. Do you think one of the most desireable and well funded software shops in the world wouldn’t be able to get skilled engineers?
Re: OpenAI Status: Multiple engines are down
#37Earlier quoted context omitted.
I have a feeling ChatGPT requires hundreds of GB of GPU RAM, so no, you couldn't run it on your laptop.
ChatGPT might but The LLLM model may not require so many nodes specially if someone is running for their own dataset.
You can train GPT-J, etc on your own dataset but that won't get you the same results unless you train it on almost all the high quality content on the internet and spend millions of dollars on gpus.
Re: OpenAI Status: Multiple engines are down
#38Earlier quoted context omitted.
I have a feeling ChatGPT requires hundreds of GB of GPU RAM, so no, you couldn't run it on your laptop.
ChatGPT might but The LLLM model may not require so many nodes specially if someone is running for their own dataset.
GPT NeoX (open source) requires at least 45GB of GPU ram. So no, you're not running it on your laptop.
Re: OpenAI Status: Multiple engines are down
#39LLM's are incredibly expensive to run. I imagine the huge demand that ChatGPT is seeing would make any cloud vendor sweat if you were to suddenly lump it on top of the usual demand. To me it's entirely unsurprising that OpenAI would have trouble keeping up. Good luck to them.
This was my assumption but it would be great to see it quantified. Does anyone know the average cost per query?
Re: OpenAI Status: Multiple engines are down
#40As an aside, I wonder when llm’s will be weaponized against authoritarian (China, etc) human censors, as they could be totally overwhelmed with content generation and be forced to censor all internet traffic…