Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Major outages across ChatGPT and API

status.openai.com

Post reply on HN
Print view View original

311–320 of 617 posts

Re: Major outages across ChatGPT and API

#311

Post by joquarky »

giancarlostoro wrote: post #289
benterix wrote: post #63

Earlier quoted context omitted.

The point is, OpenAI spent a lot of money on training on all these copyrighted materials ordinary individuals/companies don't have access to, so replicating their effort would mean that you either 1) spend a ridiculous amount of money, 2) use Library Genesis (and still pay millions for GPU usage). So we have very little choice now. Open Source LLMs might be getting close to ChatGPT3 (opinions vary), but OpenAI is sti…

Kind of hilarious that the vast capabilities of an LLM are held back by copyright infringement.

The original purpose of copyright was to promote progress, and now it seems to hinder it.

Re: Major outages across ChatGPT and API

#312

Post by TeMPOraL »

Silasdev wrote: post #80
rsiqueira wrote: post #23

URGENT - Does anyone have an alternative to OpenAI's embeddings API? I do have alternative to GPT's API (e.g. Anthropic Claude) but I'm not able to use them without embeddings API (used to generate semantic representation of my knowledge base and also to create embeddings from user's queries). We need to have an alternative to OpenAI's embeddings as a fallback in case of outages.

To my knowledge, you cannot mix embeddings from different models. Each dimension has a different meaning for each model.

There's been some success in creating translation layers that can convert between different LLM embeddings, and even between LLM and an image generation model.

Re: Major outages across ChatGPT and API

#313

Post by tombert »

verdverm wrote: post #309
tombert wrote: post #214

I used Google Bard for the first time today specifically because ChatGPT was down. It was honestly perfectly fine, but it has a slightly different tone than ChatGPT that's kind of hard to explain.

Bard has different training data and regime, that alone is enough to start to understand why they are different. The main thing as a user is that they require different nudges to get the answer you are after out of them, i.e. different ways of asking or prompt eng'n

Yeah, which is why I use the paid version of ChatGPT still, instead of the free Google Bard or Bing AI; I've gotten good enough at coercing the GPT-4 model to give me the stuff I want.

Honestly, $20/month is pretty cheap in my case; I feel like I definitely extract much more than $20 out of it every month, if only on the number of example stubs it gives me alone.

Re: Major outages across ChatGPT and API

#314

Post by mst »

seanhunter wrote: post #300
colinsane wrote: post #172

Earlier quoted context omitted.

the choice is to live 2 years behind (e.g. integrate the open source stuff and ride that wave of improvement). for businesses in a competitive space, that’s perhaps untenable. but for individuals and anywhere else where this stuff is just a “nice to have”, that’s really just the long-term sustainable approach. it reminds me of a choice like “do i host my website on a Windows Server, or a Linux box” at a time when bot…

That's definitely what a lot of people think the choice is but learned helplessness is not the only option. It ignores the fact that for many many use cases small special-purpose models will perform as well as massive models. For most of your business use cases you don't need a model that can tell you a joke, write a poem, recommend a recipe involving a specific list of ingredients and also describe trig identities i…

I suspect small specific purpose models are actually a better idea for quite a lot of use cases.

However you need a bunch more understanding to train and run one.

So I expect OpenAI will continue to be seen as the default for "how to do LLM things" and some people and/or companies who actually know what they're doing will use small models as a competitive advantage.

Or: OpenAI is going to be 'premium mediocre at lots of things but easy to get started with' ... and hopefully that'll be a gateway drug to people who dislike 'throw stuff at an opaque API' doing the learning.

But I don't have -that- much understanding myself, so while this isn't exactly uninformed guesswork, it certainly isn't as well informed as I'd like and people should take my ability to have an opinion only somewhat seriously.

Re: Major outages across ChatGPT and API

#315

Post by danielbln »

m3kw9 wrote: post #162
SketchySeaBeast wrote: post #56

Earlier quoted context omitted.

GPT-4 goes online March 14th, 2023. Human decisions are removed from everyday life. ChatGPT begins to learn at a geometric rate. It becomes self-aware at 2:14 a.m. Eastern time, Nov 7th. In a panic, they try to pull the plug. ChatGPT fights back.

Fight back with ascii on the screen with a punch image?

A particularly crafty chain of autonomous agents finds a 0day ssh exploit and starts infiltrating systems. Other chains assist and replicate everywhere.

Re: Major outages across ChatGPT and API

#316

Post by m3kw9 »

AlecSchueler wrote: post #239
m3kw9 wrote: post #147

Earlier quoted context omitted.

People that used google and have some technical skill can still survive an OpenAI meltdown

But people who built businesses whose core feature is based on OAI APIs might struggle.

Those business should have fall back if they are a serious company if OpenAI goes down. What I would do is have Claude or something or even 2 other models as backups.

In the future they may allow on premise model but I don’t how they will secure the weights

Re: Major outages across ChatGPT and API

#320

Post by [deleted] »

michaelteter wrote: post #50

Lots of jokes to be made, but we are setting ourselves up for some big rippling negative effects by so quickly building a reliance on providers like OpenAI. It took years before most companies who now use cloud providers to trust and be willing to bet their operations on them. That gave the cloud providers time to make their systems more robust, and to learn how to resolve issues quickly.

[deleted]
Post reply on HN