Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Major outages across ChatGPT and API

status.openai.com

Post reply on HN
Print view View original

171–180 of 617 posts

Re: Major outages across ChatGPT and API

#171

Post by phillipcarter »

btbuildem wrote: post #159
benterix wrote: post #63

Earlier quoted context omitted.

The point is, OpenAI spent a lot of money on training on all these copyrighted materials ordinary individuals/companies don't have access to, so replicating their effort would mean that you either 1) spend a ridiculous amount of money, 2) use Library Genesis (and still pay millions for GPU usage). So we have very little choice now. Open Source LLMs might be getting close to ChatGPT3 (opinions vary), but OpenAI is sti…

Don't underestimate Big Corp's resistance to using OpenAI's hosted solutions (even on Azure) for anything that's not marketing fluff.

You can say that about anything, though. BigCorps aren't exactly known for adopting useful tech on a reasonable timeline, let alone at all. I don't think anyone is under the impression that orgs who refuse to migrate off of Java 5 will be looking at OpenAI for anything.

Re: Major outages across ChatGPT and API

#172

Post by colinsane »

benterix wrote: post #63
michaelteter wrote: post #50

Lots of jokes to be made, but we are setting ourselves up for some big rippling negative effects by so quickly building a reliance on providers like OpenAI. It took years before most companies who now use cloud providers to trust and be willing to bet their operations on them. That gave the cloud providers time to make their systems more robust, and to learn how to resolve issues quickly.

The point is, OpenAI spent a lot of money on training on all these copyrighted materials ordinary individuals/companies don't have access to, so replicating their effort would mean that you either 1) spend a ridiculous amount of money, 2) use Library Genesis (and still pay millions for GPU usage). So we have very little choice now. Open Source LLMs might be getting close to ChatGPT3 (opinions vary), but OpenAI is sti…

the choice is to live 2 years behind (e.g. integrate the open source stuff and ride that wave of improvement). for businesses in a competitive space, that’s perhaps untenable. but for individuals and anywhere else where this stuff is just a “nice to have”, that’s really just the long-term sustainable approach.

it reminds me of a choice like “do i host my website on a Windows Server, or a Linux box” at a time when both of these things are new.

Re: Major outages across ChatGPT and API

#174

Post by rodnim »

edgyquant wrote: post #130
npilk wrote: post #29

It's at least nice to see a company call this what it is (a "major outage") - seems like most status pages would be talking about "degraded performance" or similar.

Most services have a lot more systems than OpenAI and thus it is degraded performance when a few of them don’t work. Degraded performance isn’t a good thing, I don’t understand the issue with this verbiage.

Having multiple systems down sure sounds like a major outage to me. Not a complete outage, sure, but still a major one.

Re: Major outages across ChatGPT and API

#175

Post by j45 »

michaelteter wrote: post #50

Lots of jokes to be made, but we are setting ourselves up for some big rippling negative effects by so quickly building a reliance on providers like OpenAI. It took years before most companies who now use cloud providers to trust and be willing to bet their operations on them. That gave the cloud providers time to make their systems more robust, and to learn how to resolve issues quickly.

The reliance to some degree is what it is until alternatives are available and easy enough to navigate, identify and adopt.

Some of the tips in this discussion threads are invaluable and feel good for where I might already be thinking about some things and other new things to think about.

Commenting separately on those below.

Re: Major outages across ChatGPT and API

#176

Post by JCharante »

SketchySeaBeast wrote: post #157
JCharante wrote: post #140

Earlier quoted context omitted.

I mean, if internet "internet" is down then society has collapsed and your job is probably gone anyways

I do admit, it'll be hard to sell 10 years experience building CRUD apps to the hunter gatherer commune.

Same situation here. I'm hoping being quadrilingual can help me serve as a diplomat or at least part of any envoys to distant communities. I also have some experience chopping down one tree in my backyard.

Re: Major outages across ChatGPT and API

#177

Post by j45 »

thibaut_barrere wrote: post #164
michaelteter wrote: post #50

Lots of jokes to be made, but we are setting ourselves up for some big rippling negative effects by so quickly building a reliance on providers like OpenAI. It took years before most companies who now use cloud providers to trust and be willing to bet their operations on them. That gave the cloud providers time to make their systems more robust, and to learn how to resolve issues quickly.

Not a joke and not everybody is jumping on "AI via API calls", luckily. As more models are released, it becomes possible to integrate directly in some stacks (such as Elixir) without "direct" third-party reliance (except you still depend on a model, of course). For instance, see: - https://www.youtube.com/watch?v=HK38-HIK6NA (in "LiveBook", but the same code would go inside an app, in a way that is quite easy to adap…

The average world and business user doesn't use an API directly.

It can be easy to lose sight of that.

Re: Major outages across ChatGPT and API

#178

Post by j45 »

IKantRead wrote: post #141
michaelteter wrote: post #50

Lots of jokes to be made, but we are setting ourselves up for some big rippling negative effects by so quickly building a reliance on providers like OpenAI. It took years before most companies who now use cloud providers to trust and be willing to bet their operations on them. That gave the cloud providers time to make their systems more robust, and to learn how to resolve issues quickly.

Provided we can keep riding this hype wave for a while, I think the logical long term solution is most teams will have an in house/alternative LLM they can use as temporary backup. Right now everyone is scrambling to just get some basic products out using LLMs but as people have more breathing room I can't image most teams not having a non-OpenAI LLM that they are using to run experiments on. At the end of the day, O…

I neither agree or disagree, but could you clarify which parts are hype to you?

Self-hosting though is useful internally if for no other reason having some amount of fall back architecture.

Binding directly only to one API is one oversight that can become a architectural debt issue. I"m spending some time fun time learning about API Proxies and Gateways.

Re: Major outages across ChatGPT and API

#179

Post by ctrlmeta »

thibaut_barrere wrote: post #164
michaelteter wrote: post #50

Lots of jokes to be made, but we are setting ourselves up for some big rippling negative effects by so quickly building a reliance on providers like OpenAI. It took years before most companies who now use cloud providers to trust and be willing to bet their operations on them. That gave the cloud providers time to make their systems more robust, and to learn how to resolve issues quickly.

Not a joke and not everybody is jumping on "AI via API calls", luckily. As more models are released, it becomes possible to integrate directly in some stacks (such as Elixir) without "direct" third-party reliance (except you still depend on a model, of course). For instance, see: - https://www.youtube.com/watch?v=HK38-HIK6NA (in "LiveBook", but the same code would go inside an app, in a way that is quite easy to adap…

Yes, sooner or later this is going to become the future of GPT in applications. The models are going to be embedded directly within the applications.

I'm hoping for more progress in the performance of vectorized computing so that both model training and usage can become cheaper. If that happens, I am hopeful we are going to see a lot of open source models that can embedded into the applications.

Re: Major outages across ChatGPT and API

#180

Post by YetAnotherNick »

michaelteter wrote: post #50

Lots of jokes to be made, but we are setting ourselves up for some big rippling negative effects by so quickly building a reliance on providers like OpenAI. It took years before most companies who now use cloud providers to trust and be willing to bet their operations on them. That gave the cloud providers time to make their systems more robust, and to learn how to resolve issues quickly.

Isn't microsoft azure team working closely with them? There is also azure endpoint which is managed separately.
Post reply on HN