Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Major outages across ChatGPT and API

status.openai.com

Post reply on HN
Print view View original

221–230 of 617 posts

Re: Major outages across ChatGPT and API

#221

Post by espadrine »

msp26 wrote: post #199
m3kw9 wrote: post #163

Earlier quoted context omitted.

Here we go with these “it looks worse” just like a month back when people feel it it was worse

It's probably a smaller, updated (distilled?) version of gpt-4 model given the price decrease, speed increase, and turbo name. Why wouldn't you expect it to be slightly worse? We saw the same thing with 3-davinci and 3.5-turbo. I'm not going off pure feelings either. I have benchmarks in place comparing pipeline outputs to ground truth. But like I said, it's comparable enough to 4, at a much lower price, making it a…

I am betting on a combination of quantization and speculative sampling with a distilled smaller set of models: https://arxiv.org/pdf/2302.01318.pdf

Re: Major outages across ChatGPT and API

#222

Post by Rastonbury »

ilaksh wrote: post #197
IKantRead wrote: post #141

Earlier quoted context omitted.

Provided we can keep riding this hype wave for a while, I think the logical long term solution is most teams will have an in house/alternative LLM they can use as temporary backup. Right now everyone is scrambling to just get some basic products out using LLMs but as people have more breathing room I can't image most teams not having a non-OpenAI LLM that they are using to run experiments on. At the end of the day, O…

Except that it is currently impossible to replace GPT-4 with an open model.

Depends on use case if your product has text summarisation, copywriting or translation, you can swap to many when openAI goes down and your users may not even notice

Re: Major outages across ChatGPT and API

#225

Post by Aeolos »

xeckr wrote: post #134
resters wrote: post #118

Earlier quoted context omitted.

To the extend that systems like chat-GPT are valuable, I expect we'll have open source equivalents to GPT-7 within the next five years. The only "moat" will be training on copyrighted content, and OpenAI is not likely to be able to afford to pay copyright owners enough once the value in the context of AI is widely understood. We might see SETI-like distributed training networks and specific permutations of open sourc…

>distributed training networks Now that's an idea. One bottleneck might be a limit on just how much you can parallelize training, though.

There's a ton of work in this area, and the reality is... it doesn't work for LLMs.

Moving from 900GB/sec GPU memory bandwidth with infiniband interconnects between nodes to 0.01-0.1GB/sec over the internet is brutal (1000x to 10000x slower...) This works for simple image classifiers, but I've never seen anything like a large language model be trained in a meaningful amount of time this way.

Re: Major outages across ChatGPT and API

#226

Post by zone411 »

msp26 wrote: post #26

Might as well have a quick discussion here. How's everyone finding the new models? 4-Turbo is a bit worse than 4 for my NLP work. But it's so much cheaper that I'll probably move every pipeline to using that. Depending on the exact problem it can even be comparable in quality/price to 3.5-turbo. However the fact that output tokens are limited to 4096 is a big asterisk on the 128k context.

There is a ChatGPT Classic: https://chat.openai.com/g/g-YyyyMT9XH-chatgpt-classic

Re: Major outages across ChatGPT and API

#227

Post by jahsome »

__MatrixMan__ wrote: post #224
lgkk wrote: post #218

I'm imagining a bunch of Tech Priests doing rituals and chanting in front of the data center to encourage the Machine Spirit to restart.

I believe the chants sound more or less like this: https://youtu.be/0ZZb12Qp6-0?feature=shared&t=76

I am immensely disappointed to have clicked on that and not been greeted by the age of empires priest.

https://www.youtube.com/watch?v=BxVh7T41GAI

Re: Major outages across ChatGPT and API

#229

Post by JCharante »

Kye wrote: post #183
JCharante wrote: post #140

Earlier quoted context omitted.

I mean, if internet "internet" is down then society has collapsed and your job is probably gone anyways

It happens every so often with BGP tables going haywire due to a faulty announcement. Fortunately, I know how to use hand tools, so I'm secure in the post-internet future economy.

It hasn't happened in a while, I think this is the last major incident https://en.wikipedia.org/wiki/AS_7007_incident

Re: Major outages across ChatGPT and API

#230

Post by lopatin »

tombert wrote: post #214

I used Google Bard for the first time today specifically because ChatGPT was down. It was honestly perfectly fine, but it has a slightly different tone than ChatGPT that's kind of hard to explain.

I used it for the first time today too, for the same reason. It was slower and much worse at coding. I was just asking it for SQL aggregation queries and it just ignored some of my requirements for the query.
Post reply on HN