Live data from Hacker News

ChatGPT loses users for first time, shaking faith in AI revolution

washingtonpost.com

91–100 of 305 posts

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#91
As others suggested, this is likely a summer vacation dip, but speaking for myself as a non-student, my GPT (4 + 3.5) usage has plummeted.

If you use it in a "what should be done" or "what is the right thing" sense, you get useless generalities. "It is important to remember that ... ". Suppose for example that you talk to it about combating judicial bias. It will largely insist that judges are unbiased because they're supposed to be unbiased according to their job description... You won't walk away with any insights from engaging it in ethics/morals topics.

If you dive into depth with some subject, it will invariably make errors and contradict itself in the details. I dove into how electricity works and it was saying and enthusiastically confirming electrical energy is encoded in electrons' kinetic energy. Then it started claiming that electrical energy is definitely not in the kinetic energy of electrons, that electrons don't lose speed when they bump into atoms, and instead the energy is "in the field". Ok... YouTube it is.

It's at least less convenient than a search engine at routine fact-finding due to its knowledge cutoff, inability to display images and links, etc. Ditto with translation. It's good but so is Google Translate and Google Translate has in-line suggestions for misspellings, a menu of languages, etc.

Ok, it's pretty good at writing hilarious poems, imitate people ("in the style of", etc.). Friends and I sometimes text each other hilarious things GPT said. But even there the machine is sort of laid bare, and you can see its creative limits. Its poetry is ultimately pretty lame, basically, and gets predictable. It's like an insistent and repetitive 8 year old with a lot of knowledge to pull from. It's not something I do often.

It's good at writing boilerplate code but honestly I just don't reach for that use case often. I like to stay in my own flow rather than constantly delegate to a robot and check its work, which I find flow-breaking, especially if it doesn't understand my APIs and makes mistakes often.

I do, sometimes, engage in architectural discussion about how I should design something at a high level. It's full of mistakes but bouncing ideas around can be useful. But I only feel the need to do that once in a great while.

These issues are exacerbated by being forced to downgrade to 3.5 after using 4 for a bit. You might feel like you're getting somewhere with 4, and then 3.5 starts laying doozies on you. This is another UI/product issue, but affects usability.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#92

I do think AI is here to stay, but that initial round of AI is going to destroy the world burned fast and hot. I can't even get ChatGPT (+ web plugin), when given a list of restaurants in NYC, to tell me which ones are still open vs have closed, and what their hours of operation / locations are. This is a pretty low bar request IMO. Showed me we still have a ways to go before AI is where we thought it was 3-4 months…

The issue there is that there is a difference between what an expert who gets lucky can do with a LLM, and what the average person can do with it. People are sold by articles about the former, but long term word of mouth depends on the latter, and some portion of normal people are going to get frustrated and give up using LLMs rather than build their skill set.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#93

I was using ChatGPT this week for help with a back injury I suddenly sustained. Because I don't have insurance I was looking for options as to what I should do and what it'd cost and where to go etc. I did get a suggestion that I followed up on for an in person visit. But my big beef with it was that it kept adding disclaimers: "I am not a doctor", "My current knowledge is up to September 2021, insurance and hospital…

The problem is that if they didn't give constant disclaimers then a lot of people would very happily sue them out of existence if possible and at the very least constantly condemn them at every opportunity.

This kind of AI capability challenges worldviews. And that means that many people are very eager to tear it down and find ways to dismiss it. Combine that with the general enthusiasm for excessive litigation, the fact that it actually will occasionally give advice that could be very misleading, general lack of cognitive ability of those consuming it, and it explains why there are so many disclaimers.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#95

The culprit seems to be: > " Chollet thinks he knows what’s going on: summer vacation... a significant portion of students using ChatGPT to do their homework. It’s one of the most common uses for ChatGPT, according to Sam Gilbert, a data scientist and author. " https://finance.yahoo.com/news/chatgpt-suddenly-isn-t-boomin...

Not a student, stopped using ChatGPT because OpenAI is unreliable. Moved on to other models and providers

I went self hosted.

It was about time to build a new desktop anyways (roughly 4 to 6 years before the old one goes to frolic at the server farm in the basement) and $2,000 will easily buy a machine that can run the quantized 65b models right now. So I spent slightly more than I normally do on this latest box and it's happily spitting out 10+ tokens a second.

You're not going to beat GPT-4 yet, but you have direct control over where your info goes, what model you're running, compliance with work policies against using public AI, and relatively cheap fixed costs.

Not to mention, the local version works with no internet and isn't subject to provider outages (not entirely true - but you're the provider and can resolve).

Seems like an easy win for anyone who might be buying a desktop for graphic/gaming anyways.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#96

Earlier quoted context omitted.

Not a student, stopped using ChatGPT because OpenAI is unreliable. Moved on to other models and providers

I went self hosted. It was about time to build a new desktop anyways (roughly 4 to 6 years before the old one goes to frolic at the server farm in the basement) and $2,000 will easily buy a machine that can run the quantized 65b models right now. So I spent slightly more than I normally do on this latest box and it's happily spitting out 10+ tokens a second. You're not going to beat GPT-4 yet, but you have direct con…

Super interesting! Can you point me to some of the models and repos you used to do this?

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#97

The culprit seems to be: > " Chollet thinks he knows what’s going on: summer vacation... a significant portion of students using ChatGPT to do their homework. It’s one of the most common uses for ChatGPT, according to Sam Gilbert, a data scientist and author. " https://finance.yahoo.com/news/chatgpt-suddenly-isn-t-boomin...

Mentioned ChatGPT to my teenager a few months ago.

Huge percentage of the teenagers at her school are using it to do their assignments.

Later I her to read a few chapters of her book for summer reading. When I quizzed her it, she got it right.

Found out later she used ChatGPT to give her a summary of the first chapters. She did not enjoy having first weeks of summer without a phone.

School is having to change all assignments to be written in class on paper. No phones allowed.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#98

Earlier quoted context omitted.

Not a student, stopped using ChatGPT because OpenAI is unreliable. Moved on to other models and providers

I went self hosted. It was about time to build a new desktop anyways (roughly 4 to 6 years before the old one goes to frolic at the server farm in the basement) and $2,000 will easily buy a machine that can run the quantized 65b models right now. So I spent slightly more than I normally do on this latest box and it's happily spitting out 10+ tokens a second. You're not going to beat GPT-4 yet, but you have direct con…

How does it seem to compare with GPT 3.5? That really seems like the baseline for what's usable.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#99
post #93

I was using ChatGPT this week for help with a back injury I suddenly sustained. Because I don't have insurance I was looking for options as to what I should do and what it'd cost and where to go etc. I did get a suggestion that I followed up on for an in person visit. But my big beef with it was that it kept adding disclaimers: "I am not a doctor", "My current knowledge is up to September 2021, insurance and hospital…

The problem is that if they didn't give constant disclaimers then a lot of people would very happily sue them out of existence if possible and at the very least constantly condemn them at every opportunity. This kind of AI capability challenges worldviews. And that means that many people are very eager to tear it down and find ways to dismiss it. Combine that with the general enthusiasm for excessive litigation, the…

[deleted]

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#100

I was using ChatGPT this week for help with a back injury I suddenly sustained. Because I don't have insurance I was looking for options as to what I should do and what it'd cost and where to go etc. I did get a suggestion that I followed up on for an in person visit. But my big beef with it was that it kept adding disclaimers: "I am not a doctor", "My current knowledge is up to September 2021, insurance and hospital…

You underestimate how absolutely stupid many people are.

[deleted]
Post reply on HN