Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Major outages across ChatGPT and API

status.openai.com

Post reply on HN
Print view View original

291–300 of 617 posts

Re: Major outages across ChatGPT and API

#291

Post by TeMPOraL »

giancarlostoro wrote: post #289
benterix wrote: post #63

Earlier quoted context omitted.

The point is, OpenAI spent a lot of money on training on all these copyrighted materials ordinary individuals/companies don't have access to, so replicating their effort would mean that you either 1) spend a ridiculous amount of money, 2) use Library Genesis (and still pay millions for GPU usage). So we have very little choice now. Open Source LLMs might be getting close to ChatGPT3 (opinions vary), but OpenAI is sti…

Kind of hilarious that the vast capabilities of an LLM are held back by copyright infringement.

Intellectual property rights will yet turn out to be one of the Great Filters.

Re: Major outages across ChatGPT and API

#292

Post by thenberlin »

rattlesnakedave wrote: post #275
kinonionioa wrote: post #253

Earlier quoted context omitted.

I don't get any time off. My full-time job is cleaning up after people who've been using ChatGPT.

Lucky you. Mine is using ChatGPT to review code written by curmudgeons that don't use it.

This comment has some real "startup based on some light prompt engineering atop ChatGPT gets put out of business by ChatGPT's latest feature" energy.

Re: Major outages across ChatGPT and API

#293

Post by zozbot234 »

giancarlostoro wrote: post #289
benterix wrote: post #63

Earlier quoted context omitted.

The point is, OpenAI spent a lot of money on training on all these copyrighted materials ordinary individuals/companies don't have access to, so replicating their effort would mean that you either 1) spend a ridiculous amount of money, 2) use Library Genesis (and still pay millions for GPU usage). So we have very little choice now. Open Source LLMs might be getting close to ChatGPT3 (opinions vary), but OpenAI is sti…

Kind of hilarious that the vast capabilities of an LLM are held back by copyright infringement.

I'd love to see a language model that was only trained on public domain and openly available content. It would probably be way too little data to give it ChatGPT-like generality, but even a GPT-2 scale model would be interesting.

Re: Major outages across ChatGPT and API

#294

Post by JimDabell »

leetharris wrote: post #160
harveywi wrote: post #57

Fortunately for OpenAI, they have no SLAs: https://help.openai.com/en/articles/5008641-is-there-an-sla-...

I say this as a huge fan of GPT, but it's amazing to me how terrible of a company OpenAI is and how quickly we've all latched onto their absolutely terrible platform. I had a bug that wouldn't let me login to my work OpenAI account at my new job 9 months ago. It took them 6 months to respond to my support request and they gave me a generic copy/paste answer that had nothing to do with my problem. We spend tons and to…

ChatGPT has been broken for me for two months, regardless of whether I use the iOS app or the web app. The backend is giving HTTP 500 errors – clearly a problem on their end. Yet in two months I haven’t been able to get past their first line of support. They keep giving me autogenerated responses telling me to do things like clear my cache, turn off ad blockers, and provide information I’ve already given them. They routinely ignore me for weeks at a time. And they continue to bill me. I see no evidence this technical fault has made it to anybody who could do anything about it and I’m not convinced an actual human has seen my messages.

Re: Major outages across ChatGPT and API

#295

Post by TeMPOraL »

zozbot234 wrote: post #293
giancarlostoro wrote: post #289

Earlier quoted context omitted.

Kind of hilarious that the vast capabilities of an LLM are held back by copyright infringement.

I'd love to see a language model that was only trained on public domain and openly available content. It would probably be way too little data to give it ChatGPT-like generality, but even a GPT-2 scale model would be interesting.

If, hypothetically, libraries in the US - including in particular the Library of Congress - were to scan and OCR every book, newspaper and magazine they have with copyright protection already expired, would that be enough? Is there some estimate for the size of such dataset?

Re: Major outages across ChatGPT and API

#296

Post by JimDabell »

lanstin wrote: post #198
donkeyd wrote: post #170

Earlier quoted context omitted.

I've personally never scaled a B2B&C company from 0 to over 1 billion users in less than a year, but I do feel like it's probably pretty hard. Especially setting up something like a good support organization in a time of massive labor shortages seems like it would be pretty tough. I know they have money, but money isn't a magic wand for creating people. They could've also kept it a limited beta for much longer, but t…

I wonder if they spend time trying to do support via GPT4 itself.

GPT-4 would be more responsive. They ignore support requests for weeks unless you keep reminding them.

Re: Major outages across ChatGPT and API

#297

Post by TeMPOraL »

dragonwriter wrote: post #272
halfcat wrote: post #123

Earlier quoted context omitted.

The app maker can screw the plug-in author at any moment. For general cloud, avoiding screwing might mean multi cloud. But for LLM, there’s only one option at the highest level of quality for now. People tend to over focus on resilience (minimizing probability of breaking) and neglect the plan for recovery when things do break. I can’t tell you how weirdly foreign this is to many people, how many meetings I’ve been i…

> For general cloud, avoiding screwing might mean multi cloud. But for LLM, there’s only one option at the highest level of quality for now. There's always only one at the highest level of quality at a fine-grained enough resolution. Whether there's only one at sufficient quality for use, and if it is possible to switch between them in realtime without problems caused by the switch (e.g., data locked up in the provid…

> There's always only one at the highest level of quality at a fine-grained enough resolution.

Of course, but right now, there highest quality level option is an outlier, far ahead of everyone else, so if you need this level of quality (and I struggle to imagine user-facing products where you wouldn't!), there is only one option in the foreseeable future.

Re: Major outages across ChatGPT and API

#298

Post by TeMPOraL »

thenberlin wrote: post #292
rattlesnakedave wrote: post #275

Earlier quoted context omitted.

Lucky you. Mine is using ChatGPT to review code written by curmudgeons that don't use it.

This comment has some real "startup based on some light prompt engineering atop ChatGPT gets put out of business by ChatGPT's latest feature" energy.

Oh no no, this sounds more like "ChatGPT catching up with and automating a human out of their job" kind of story.

Re: Major outages across ChatGPT and API

#299

Post by msp26 »

Zpalmtree wrote: post #247
msp26 wrote: post #26

Might as well have a quick discussion here. How's everyone finding the new models? 4-Turbo is a bit worse than 4 for my NLP work. But it's so much cheaper that I'll probably move every pipeline to using that. Depending on the exact problem it can even be comparable in quality/price to 3.5-turbo. However the fact that output tokens are limited to 4096 is a big asterisk on the 128k context.

4-Turbo is much faster, which for my use case is very important. Wish we could get more than 100 requests per day.. Is the limit higher when you have a higher usage tier?

Yeah it gets way higher. We were capped to 40k T/m when our org spend was under $250. Now it's 300k.

Re: Major outages across ChatGPT and API

#300

Post by seanhunter »

colinsane wrote: post #172
benterix wrote: post #63

Earlier quoted context omitted.

The point is, OpenAI spent a lot of money on training on all these copyrighted materials ordinary individuals/companies don't have access to, so replicating their effort would mean that you either 1) spend a ridiculous amount of money, 2) use Library Genesis (and still pay millions for GPU usage). So we have very little choice now. Open Source LLMs might be getting close to ChatGPT3 (opinions vary), but OpenAI is sti…

the choice is to live 2 years behind (e.g. integrate the open source stuff and ride that wave of improvement). for businesses in a competitive space, that’s perhaps untenable. but for individuals and anywhere else where this stuff is just a “nice to have”, that’s really just the long-term sustainable approach. it reminds me of a choice like “do i host my website on a Windows Server, or a Linux box” at a time when bot…

That's definitely what a lot of people think the choice is but learned helplessness is not the only option. It ignores the fact that for many many use cases small special-purpose models will perform as well as massive models. For most of your business use cases you don't need a model that can tell you a joke, write a poem, recommend a recipe involving a specific list of ingredients and also describe trig identities in the style of Eminem. You need specific performance for a specific set of user stories and a small model could well do that.

These small models are not expensive to train and are (crucially) much cheaper to run on an ongoing basis.

Opensource really is a viable choice.

Post reply on HN