GPT has escaped and migrated into the electric grid.
Well if it was truly trained on stackoverflow content, it won't get far. /s
OpenAI Status: Multiple engines are down
141–150 of 167 posts
Re: OpenAI Status: Multiple engines are down
#142To put this in perspective: the outage was 52 min. The total number of employees OpenAI have are 375. The launch date was just some months ago. At Google, the Cloud SQL dashboard was unavailable for around 12 hours a couple of weeks ago if I read this correctly: https://status.cloud.google.com/incidents/xg2qrL1UuSJiPDZALJ... The total number of employees of Google are 156 500. Google Cloud was launched 2008. So when…
The is the worst comparison in the history of comparisons.
Re: OpenAI Status: Multiple engines are down
#143Earlier quoted context omitted.
It's not as if anyone could afford to self-host the giant GPT-3 model anyway.
Why not? Please correct me if I'm wrong but from what I've heard, It's not millions or hundreds of thousands, it's "only" tens of thousands dollars' of hardware we're talking about. There are enthusiasts that spend comparably on their hobbies. And a few dozen like minded people banding up together, shelling out a couple grands each? I'd say that's a totally realistic scenario.
[deleted]
Re: OpenAI Status: Multiple engines are down
#144Earlier quoted context omitted.
presumably the data scientists at OpenAI would also not be able to directly lead to higher availability of ChatGPT; it's just an order of magnitude comparison.
Depends on the reason for the outage. If it is an application error, like OOM or other performance issue, then yes, they might be directly tied to the root cause and solution. If it's an infra issue, then maybe not so much. I once spent an entire weekend swapping shifts trying to keep the main server of an AI company up because the devs deployed on friday and were unreachable to fix their memory error. The best thing…
I get everything except Snowflake....
Anyone care to elaborate on why they have snowflake in their stack?
Re: OpenAI Status: Multiple engines are down
#145Earlier quoted context omitted.
Open AI's CEO Sam Altman's take is that they will only ever allow API access to their models to avoid misuse. I don't get HN's take with wanting everything open sourced. Some things are expensive to create and dangerous in the wrong hands. Not everything can and should be open sourced.
Can you think of any non-weapons examples where centralization/gatekeeping of a tech meaningfully and causally benefited society or a technology itself? Actually, thinking about my own question I'm even inclined to remove the non-weapons qualifier. The most knee jerk response, nuclear weapons, is perhaps the best example of unexpected benefit. The 'decentralization' of nuclear weapons is undoubtedly why the Cold War…
I really don’t like the argument that you should make things free just because it makes the world better. What happened to ownership and respecting the effort it takes to create something?
I see a similar line of reasoning can be used to justify theft from the rich.
Re: OpenAI Status: Multiple engines are down
#146Apparently ChatGPT went from zero to a million users in five days[1], at a cost of "single-digits cents per chat." For perspective the likes of Instagram and Twitter have take from a few months to a few dozen months to get to a million users all while doing less work to service a request for a "page." Hats of to OpenAI for not falling over more often under a hug of death that doesn't seem to be letting up. [1] https:…
Come on. OpenAI has been around far longer than ChatGPT. I bet Instagram Stories reached a million users in a matter of minutes.
Also it's fairly common to not be able to use ChatGPT because they're at capacity
Re: OpenAI Status: Multiple engines are down
#147Apparently ChatGPT went from zero to a million users in five days[1], at a cost of "single-digits cents per chat." For perspective the likes of Instagram and Twitter have take from a few months to a few dozen months to get to a million users all while doing less work to service a request for a "page." Hats of to OpenAI for not falling over more often under a hug of death that doesn't seem to be letting up. [1] https:…
Come on. OpenAI has been around far longer than ChatGPT. I bet Instagram Stories reached a million users in a matter of minutes.
FB had quite the infrastructure when Instagram Stories was released... not sure that comparison makes a ton of sense?
Re: OpenAI Status: Multiple engines are down
#148To put this in perspective: the outage was 52 min. The total number of employees OpenAI have are 375. The launch date was just some months ago. At Google, the Cloud SQL dashboard was unavailable for around 12 hours a couple of weeks ago if I read this correctly: https://status.cloud.google.com/incidents/xg2qrL1UuSJiPDZALJ... The total number of employees of Google are 156 500. Google Cloud was launched 2008. So when…
> The total number of employees of Google are 156 500
This is a non-sequitur. This statement has nothing to do with the outage. It’s just thrown in there to pad the number of words in the comment.
Re: OpenAI Status: Multiple engines are down
#149Apparently ChatGPT went from zero to a million users in five days[1], at a cost of "single-digits cents per chat." For perspective the likes of Instagram and Twitter have take from a few months to a few dozen months to get to a million users all while doing less work to service a request for a "page." Hats of to OpenAI for not falling over more often under a hug of death that doesn't seem to be letting up. [1] https:…
Come on. OpenAI has been around far longer than ChatGPT. I bet Instagram Stories reached a million users in a matter of minutes.
I don't think that many people where actually using OpenAI's products directly. Unlike Instagram.
Re: OpenAI Status: Multiple engines are down
#150LLM's are incredibly expensive to run. I imagine the huge demand that ChatGPT is seeing would make any cloud vendor sweat if you were to suddenly lump it on top of the usual demand. To me it's entirely unsurprising that OpenAI would have trouble keeping up. Good luck to them.
This is precisely why they should really open source their model so that anyone can download and run it on their own infrastructure. Just like google or others have done and one is free to run it on their own laptop (some even without a GPU) , on premise or on any cloud provider infrastructure. They can continue to provide a hosted service for their model but they should allow it to be downloaded just like BERT.
I see OpenAI as a 'company' that (eventually) wants to earn money with their models. The 'open' part is trying to commercialize part it in such a way that everyone can use it. Also be open with the research and risks. But not open as in open-source.