I was gonna say that this is Bard's chance to shine, but it looks like Bard is also having an outage!
Bard is still playing scared, it isn’t even international yet
Major outages across ChatGPT and API
161–170 of 617 posts
Re: Major outages across ChatGPT and API
#162I've been noticing it's been patchy for the last 24 hours. A few network errors, and occasional very long latency, even some responses left incomplete. Poor ChatGPT, I wonder what those elves at OpenAI have you up to!
GPT-4 goes online March 14th, 2023. Human decisions are removed from everyday life. ChatGPT begins to learn at a geometric rate. It becomes self-aware at 2:14 a.m. Eastern time, Nov 7th. In a panic, they try to pull the plug. ChatGPT fights back.
Fight back with ascii on the screen with a punch image?
Re: Major outages across ChatGPT and API
#163Might as well have a quick discussion here. How's everyone finding the new models? 4-Turbo is a bit worse than 4 for my NLP work. But it's so much cheaper that I'll probably move every pipeline to using that. Depending on the exact problem it can even be comparable in quality/price to 3.5-turbo. However the fact that output tokens are limited to 4096 is a big asterisk on the 128k context.
Here we go with these “it looks worse” just like a month back when people feel it it was worse
Re: Major outages across ChatGPT and API
#164Lots of jokes to be made, but we are setting ourselves up for some big rippling negative effects by so quickly building a reliance on providers like OpenAI. It took years before most companies who now use cloud providers to trust and be willing to bet their operations on them. That gave the cloud providers time to make their systems more robust, and to learn how to resolve issues quickly.
Not a joke and not everybody is jumping on "AI via API calls", luckily.
As more models are released, it becomes possible to integrate directly in some stacks (such as Elixir) without "direct" third-party reliance (except you still depend on a model, of course).
For instance, see:
- https://www.youtube.com/watch?v=HK38-HIK6NA (in "LiveBook", but the same code would go inside an app, in a way that is quite easy to adapt)
- https://news.livebook.dev/speech-to-text-with-whisper-timest... for the companion blog post
I have already seen more than a few people running SaaS app on twitter complaining about AI-downtime :-)
Of course, it will also come with a (maintenance) cost (but like external dependencies), as I described here:
https://twitter.com/thibaut_barrere/status/17221729157334307...
Re: Major outages across ChatGPT and API
#165Re: Major outages across ChatGPT and API
#166I for one welcome our new robot overlords
Good ant, good ant
Re: Major outages across ChatGPT and API
#167It's at least nice to see a company call this what it is (a "major outage") - seems like most status pages would be talking about "degraded performance" or similar.
I suspect this is because they don't have contracts with enforceable SLAs yet. When they do, you will see more 'degraded performance'.
People get credits for 'outages', but if it is sometimes working for someone somewhere then that is the convenient fiction/loophole a lot of companies use.
Re: Major outages across ChatGPT and API
#168Lots of jokes to be made, but we are setting ourselves up for some big rippling negative effects by so quickly building a reliance on providers like OpenAI. It took years before most companies who now use cloud providers to trust and be willing to bet their operations on them. That gave the cloud providers time to make their systems more robust, and to learn how to resolve issues quickly.
I mean.. it's a two hour outage. Depending on the severity of the problem that's quite a fast turnaround.
Re: Major outages across ChatGPT and API
#169All tech folks should just get a PTO today . #ChatGPT_outage Am I supposed to use Google and Stack overflow ? That’s like going back to roll down windows in a car :)
edit: so, cool thing: cached queries on Phind will show all the followup questions visitors to the URL enter. That's so cool. And horrifying. It's like back when Twitter was one global feed on the front page. I doubt that's intended behavior since this URL is generated by the share link. Be forewarned. -- Here you go: https://www.phind.com/search?cache=nsa0xrak9gzn6yxwczxnqsck
This is so great, someone just asked:
> What is a privacy vulnerability
I'm dying
Re: Major outages across ChatGPT and API
#170Fortunately for OpenAI, they have no SLAs: https://help.openai.com/en/articles/5008641-is-there-an-sla-...
I say this as a huge fan of GPT, but it's amazing to me how terrible of a company OpenAI is and how quickly we've all latched onto their absolutely terrible platform. I had a bug that wouldn't let me login to my work OpenAI account at my new job 9 months ago. It took them 6 months to respond to my support request and they gave me a generic copy/paste answer that had nothing to do with my problem. We spend tons and to…
I've personally never scaled a B2B&C company from 0 to over 1 billion users in less than a year, but I do feel like it's probably pretty hard. Especially setting up something like a good support organization in a time of massive labor shortages seems like it would be pretty tough.
I know they have money, but money isn't a magic wand for creating people. They could've also kept it a limited beta for much longer, but that would've killed their growth velocity.
So here is a great product that provides no SLA at all. And we all accept it, because having it most of the time is still better than having it not at all ever.