Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT loses users for first time, shaking faith in AI revolution

washingtonpost.com

Post reply on HN
Print view View original

101–110 of 305 posts

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#101

Post by justapassenger »

WanderPanda wrote: post #74
justapassenger wrote: post #65

The more safeguards, regulations, copyrights they add, the less useful ChatGPT becomes. It's a thing with many products. And I don't think it's bad that it's happening - safeguards exist for a reason. And current generations of LLM is very prone to lying (I don't use term hallucination, as IMO it's an attempt to whitewash limits of AI). ChatGPT did a great job at showing people current state of AI. But they did even…

"Lying" has a deliberate notion to it which imo is not accurate in this case

It's deliberate.

It's not deliberate by the tech itself. But they pack it in the product and market it, with a general narrative that it's superhuman like experience that is going to replace humans. At this level, it's deliberate.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#102

Post by joekim »

horsawlarway wrote: post #95
verdverm wrote: post #84

Earlier quoted context omitted.

Not a student, stopped using ChatGPT because OpenAI is unreliable. Moved on to other models and providers

I went self hosted. It was about time to build a new desktop anyways (roughly 4 to 6 years before the old one goes to frolic at the server farm in the basement) and $2,000 will easily buy a machine that can run the quantized 65b models right now. So I spent slightly more than I normally do on this latest box and it's happily spitting out 10+ tokens a second. You're not going to beat GPT-4 yet, but you have direct con…

Would you be willing to create a guide? I think this would be of great help.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#104

Post by horsawlarway »

generalizations wrote: post #98
horsawlarway wrote: post #95

Earlier quoted context omitted.

I went self hosted. It was about time to build a new desktop anyways (roughly 4 to 6 years before the old one goes to frolic at the server farm in the basement) and $2,000 will easily buy a machine that can run the quantized 65b models right now. So I spent slightly more than I normally do on this latest box and it's happily spitting out 10+ tokens a second. You're not going to beat GPT-4 yet, but you have direct con…

How does it seem to compare with GPT 3.5? That really seems like the baseline for what's usable.

It depends heavily on the model you're running, and to some extent what you're doing with it. It also depends to on prompt effort. The quantized llama 65b model (you can do it yourself, or pull something like https://huggingface.co/TheBloke/llama-65B-GGML) is probably the highest quality for general purpose, but it does take a fair bit of effort to prompt since it's not tuned for a use-case.

It's also not licensed commercially, so I avoid some things with it (ex: I do a lot of personal learning/investigation, but it doesn't touch or write anything related to work or personal projects)

The open models are a little further behind, but it's interesting to see them spin off into niches where they have strengths based on tuning/training.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#106

Post by ben_w »

salgorithm wrote: post #10

If a lot of ChatGPT users were students, I would expect a drop during summer vacation. I predict another article from the Washington Post in August/September about how ChatGPT is seeing a rebound in usage.

What odds would you give that said autumn term article will be written by ChatGPT? :)

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#107

Post by gadflyinyoureye »

generalizations wrote: post #98
horsawlarway wrote: post #95

Earlier quoted context omitted.

I went self hosted. It was about time to build a new desktop anyways (roughly 4 to 6 years before the old one goes to frolic at the server farm in the basement) and $2,000 will easily buy a machine that can run the quantized 65b models right now. So I spent slightly more than I normally do on this latest box and it's happily spitting out 10+ tokens a second. You're not going to beat GPT-4 yet, but you have direct con…

How does it seem to compare with GPT 3.5? That really seems like the baseline for what's usable.

I don’t know about self-hosted, but it the company I contact at has 3.5 instance. It has better understanding of code examples I provide than ChatGPT. The company hasn’t tweaked the code to our standards.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#108

Post by konha »

treeman79 wrote: post #97
crazygringo wrote: post #39

The culprit seems to be: > " Chollet thinks he knows what’s going on: summer vacation... a significant portion of students using ChatGPT to do their homework. It’s one of the most common uses for ChatGPT, according to Sam Gilbert, a data scientist and author. " https://finance.yahoo.com/news/chatgpt-suddenly-isn-t-boomin...

Mentioned ChatGPT to my teenager a few months ago. Huge percentage of the teenagers at her school are using it to do their assignments. Later I her to read a few chapters of her book for summer reading. When I quizzed her it, she got it right. Found out later she used ChatGPT to give her a summary of the first chapters. She did not enjoy having first weeks of summer without a phone. School is having to change all ass…

That sounds incredibly backwards to me.

How about accepting new realities and changing homework assignments instead?

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#109

Post by root_axis »

generalizations wrote: post #98
horsawlarway wrote: post #95

Earlier quoted context omitted.

I went self hosted. It was about time to build a new desktop anyways (roughly 4 to 6 years before the old one goes to frolic at the server farm in the basement) and $2,000 will easily buy a machine that can run the quantized 65b models right now. So I spent slightly more than I normally do on this latest box and it's happily spitting out 10+ tokens a second. You're not going to beat GPT-4 yet, but you have direct con…

How does it seem to compare with GPT 3.5? That really seems like the baseline for what's usable.

If you're a diligent tester, none of the open source models can touch GPT 3.5 yet, however, in practical terms, some of the 60b and 30b parameter models are almost indistinguishable from GPT 3.5 from the layperson's perspective. Now, if you consider the uncensored models, then you actually have some capabilities that GPT 3.5 and 4 are completely lacking.

Based on the rate of progress in the open source world, it won't be more than a year before we have an open source model that is truly superior to GPT 3.5

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#110

Post by SoftTalker »

treeman79 wrote: post #97
crazygringo wrote: post #39

The culprit seems to be: > " Chollet thinks he knows what’s going on: summer vacation... a significant portion of students using ChatGPT to do their homework. It’s one of the most common uses for ChatGPT, according to Sam Gilbert, a data scientist and author. " https://finance.yahoo.com/news/chatgpt-suddenly-isn-t-boomin...

Mentioned ChatGPT to my teenager a few months ago. Huge percentage of the teenagers at her school are using it to do their assignments. Later I her to read a few chapters of her book for summer reading. When I quizzed her it, she got it right. Found out later she used ChatGPT to give her a summary of the first chapters. She did not enjoy having first weeks of summer without a phone. School is having to change all ass…

> School is having to change all assignments to be written in class on paper. No phones allowed.

They never should have moved away from this if they are worried about cheating.

But if students are using ChatGPT to summarize/prep for stuff at home, fine. No different from the Cliff Notes I used when I was that age.

Post reply on HN