Earlier quoted context omitted.
> it's that the dataset really is the 'secret sauce' alwayshasbeen.jpg There have been articles about how "data is the new oil" for a couple of decades now, with the first reference I could find being from British mathematician Clive Humby in 2006 [0]. The fact that it rings even more true in the age of LLMs is simply just another transformation of the fundamental data underneath. [0] https://en.wikipedia.org/wiki/Cl…
2006? https://en.wikipedia.org/wiki/Scientia_potentia_est
Major outages across ChatGPT and API
571–580 of 617 posts
Re: Major outages across ChatGPT and API
#572Earlier quoted context omitted.
Yeah, which is why I use the paid version of ChatGPT still, instead of the free Google Bard or Bing AI; I've gotten good enough at coercing the GPT-4 model to give me the stuff I want. Honestly, $20/month is pretty cheap in my case; I feel like I definitely extract much more than $20 out of it every month, if only on the number of example stubs it gives me alone.
The custom prompts feature, and the "about me" mostly fixed this for me, with my usual conversations. In both, I convinced it that I'm competent, and that it doesn't need to hold my hand, so much. I've also noticed that API based clients (rather than the web or iOS client) result in conversations that hold my hand less. The voice client seems hopeless though, probably because I write ok, but have trouble saying what…
Re: Major outages across ChatGPT and API
#573Earlier quoted context omitted.
I say this as a huge fan of GPT, but it's amazing to me how terrible of a company OpenAI is and how quickly we've all latched onto their absolutely terrible platform. I had a bug that wouldn't let me login to my work OpenAI account at my new job 9 months ago. It took them 6 months to respond to my support request and they gave me a generic copy/paste answer that had nothing to do with my problem. We spend tons and to…
Let's not forget the most basic problem with OpenAI: It isn't open.
Re: Major outages across ChatGPT and API
#574Earlier quoted context omitted.
It was the first question in the thread, and I've been testing queries along these lines on it for a while. Interestingly, it started writing a response initially and then replaced it with that. It used to refuse to answer who Donald Trump is as well, but it seems that one has been fixed. Another interesting line of inquiry (potentially revealing some biases) is to ask it whether someone is a supervillain. For certai…
That's because these GPTs are trained to complete text in human language, but unfortunately the training data set includes human language + human culture. I really think they need to train on the wider dataset, then fine tune with some training on a machine specific dataset, then the model can reference data sources rather than have them baked in. A lot of the general purposeness but also sometimes says weird things…
If you ask the same questions to ChatGPT you tend to get much more refined answers.
Re: Major outages across ChatGPT and API
#575Re: Major outages across ChatGPT and API
#576Earlier quoted context omitted.
What is so special about OpenAI's cloud hardware that one can't build themselves a similar server to run AI models of similar size?
The hardware is primarily standard Nvidia GPUs (A100s, H100s), but the scale of the infrastructure is on another level entirely. These models currently need clusters of GPU-powered servers to make predictions fast enough. Which explains why OpenAI partnered with Microsoft and got billions in funding to spend on compute. You can run (much) smaller LLM models on consumer-grade GPUs though. A single Nvidia GPU with 8 GB…
It will definitely not be slower. Local inference with a 7b model on a 3090/4090 will outpace 3.5-turbo and smoke 4-turbo.
Re: Major outages across ChatGPT and API
#577I used Google Bard for the first time today specifically because ChatGPT was down. It was honestly perfectly fine, but it has a slightly different tone than ChatGPT that's kind of hard to explain.
People constantly recommend Bard to me, but it returns false and/or misleading info almost every time
Re: Major outages across ChatGPT and API
#578Earlier quoted context omitted.
If you are regularly updating your refrigerator's firmware or your refrigerator's firmware relies on an Internet connection to function, then I am very sorry to say this but you have lost control of your life :)
Depends on how much technology is in the fridge I guess. If it's just a plain old fridge then no need to be smart. If they say, found a way to make it xx% more efficient because they xyz and dynamically abc with some small arm processor then fair enough. Huh, the graph here is interesting: https://appliance-standards.org/blog/how-your-refrigerator-h... Shows you how creating and enforcing standards is the driver for…
That is an interesting idea, but I don't think an Internet connection would help with it :)
> Shows you how creating and enforcing standards is the driver for stuff like this.
Also agreed that is an interesting graph, I agree that it shows how standards and better production has led to decreased energy usage -- but notably, a lot of those standards are around better insulation and more efficient components.
Putting an extra layer of foam in your fridge or having sensors in your fridge that help regulate temperature definitely doesn't mean you've lost control of your life. But needing to download a firmware update to your Internet-enabled fridge that uses a Samsung account where you now can't access your grocery list until you finish the mandated update which changes your fridge's UI on its mobile app -- I think that means you've lost control of your life :)
Re: Major outages across ChatGPT and API
#579Earlier quoted context omitted.
Seems more like a crutch in that sense, then. If you can’t ride without it, it hasn’t trained you anything.
That's a pretty counter-intuitive statement. It's like making fun of modern humans for not being able to light their own fire with two sticks, when they lose their lighter wile camping. Or for someone to not know how to sew a rip in their clothes, when the clothing store is closed. Etc.
Re: Major outages across ChatGPT and API
#580Well I guess this is the best time to say that HuggingFace hosts many open source chat models, one of my favorites is a finetuned version of Mistral 7B: https://huggingface.co/spaces/HuggingFaceH4/zephyr-chat