Live data from Hacker News

Major outages across ChatGPT and API

status.openai.com

201–210 of 617 posts

Re: Major outages across ChatGPT and API

#201

Earlier quoted context omitted.

Don't underestimate Big Corp's resistance to using OpenAI's hosted solutions (even on Azure) for anything that's not marketing fluff.

You can say that about anything, though. BigCorps aren't exactly known for adopting useful tech on a reasonable timeline, let alone at all. I don't think anyone is under the impression that orgs who refuse to migrate off of Java 5 will be looking at OpenAI for anything.

No, this is silly reasoning. A middle manager somewhere has no clue what Java 5 is. But he does know -- or let's say IMAGINES what he knows about ChatGPT. And unlike Java 5-- he just needs to use his departmental budget and instantly mandate that his team now use ChatGPT.

Whatever that means you can argue it.

But ChatGPT is a front line technology and super accessible. Java 5 is super back end and very specialized.

The adoption you say won't happen: it will come from the middle -> up.

Re: Major outages across ChatGPT and API

#202

Earlier quoted context omitted.

> Can't work, no internet. Don't most people just tether from their phones in this situation? Usually video isn't expected due to excessive bandwith requirements but the internet bill outweighs the daily salary (and you could probably get it expensed, or in my case my old company was already expensing my phone bill due to being used as a pager for on call)

he didn't say ethernet or wifi, he said internet. as in when the next big solar storm hits earth

Ethernet, Fibre maybe.

Re: Major outages across ChatGPT and API

#203
post #16

All tech folks should just get a PTO today . #ChatGPT_outage Am I supposed to use Google and Stack overflow ? That’s like going back to roll down windows in a car :)

Honestly, I've been gradually introducing AI searches for coding questions. I'm impressed, but not enough that I feel like ChatGPT is a true replacement for Google / Stack Overflow.

I've had it generate some regexes and answer questions when I can't think of good keywords; but half of my searches are things where I'm just trying to get to the original docs; or where I want to see a discussion on an error message.

Re: Major outages across ChatGPT and API

#204

Fortunately for OpenAI, they have no SLAs: https://help.openai.com/en/articles/5008641-is-there-an-sla-...

I say this as a huge fan of GPT, but it's amazing to me how terrible of a company OpenAI is and how quickly we've all latched onto their absolutely terrible platform. I had a bug that wouldn't let me login to my work OpenAI account at my new job 9 months ago. It took them 6 months to respond to my support request and they gave me a generic copy/paste answer that had nothing to do with my problem. We spend tons and to…

OpenAI is relatively young on the adoption and scaling front.

Also, they need to remain flexible most likely in their infrastructure to make the changes.

As an architecture guy, I sense when the rate of change slows down more SLA type stuff will come up, or may be available first to Enterprise customers who will pay for the entire cost of it. Maybe over time there will be enough slack there to extend some SLA to general API users.

In the meantime, monitoring API's ourselves isn't that crazy. Great idea to use more than one service.

Re: Major outages across ChatGPT and API

#205

Earlier quoted context omitted.

It sure doesn’t look like it. The announcement was strange and anti-climatic, and it started making excuses for itself immediately “Grok is still a very early beta product – the best we could do with 2 months of training”. It has the Elon stink all over it.

Sama is a much nicer guy, right?

He doesn't have to be because he doesn't make everything about himself at the companies he runs. You seem to have a pretty skewed idea of what a CEO is for.

Re: Major outages across ChatGPT and API

#206

Lots of jokes to be made, but we are setting ourselves up for some big rippling negative effects by so quickly building a reliance on providers like OpenAI. It took years before most companies who now use cloud providers to trust and be willing to bet their operations on them. That gave the cloud providers time to make their systems more robust, and to learn how to resolve issues quickly.

Provided we can keep riding this hype wave for a while, I think the logical long term solution is most teams will have an in house/alternative LLM they can use as temporary backup. Right now everyone is scrambling to just get some basic products out using LLMs but as people have more breathing room I can't image most teams not having a non-OpenAI LLM that they are using to run experiments on. At the end of the day, O…

> At the end of the day, OpenAI is just an API, so it's not an incredibly difficult piece of infrastructure to have a back up for.

The API is easy to reproduce, the functionality of the engines behind it less so.

Yes, you can compatibly implement the APIs presented by OpenAI woth open source models hosted elsewhere (including some from OpenAI). And for some applications that can produce tolerable results. But LLMs (and multimodal toolchains centered on an LLM) haven't been commoditized to the point of being easy and mostly functionally-acceptable substitutes to the degree that, say, RDBMS engines are.

Re: Major outages across ChatGPT and API

#208
post #194

Earlier quoted context omitted.

What’s your use case? The difference in behavior between the two models seems like it would make failover difficult.

It's really not that different - customers can ask questions about conversations, phone, text, video and typically use that to better understand topics, conversions, sales ops, customer service etc...

This also shows that OpenAI or other providers does not have a real moat. The interface is very generic and best replaced easily with other provider or even with open model.

I think thats why OpenAI is trying to move up the value chain with integration.

Re: Major outages across ChatGPT and API

#210
post #12

Earlier quoted context omitted.

You can do that today depending on what you need from the models.

Let's say I'm writing Flask code all day, and I need help with various parts of my code. Can I do it today or not? With questions like, "How to add 'Log in with Google' to the login screen" etc.

There’s the code llama model that you can run locally I think which should be able to help you with that: https://ai.meta.com/blog/code-llama-large-language-model-cod...
Post reply on HN