Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT loses users for first time, shaking faith in AI revolution

washingtonpost.com

Post reply on HN
Print view View original

121–130 of 305 posts

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#121

Post by horsawlarway »

joekim wrote: post #102
horsawlarway wrote: post #95

Earlier quoted context omitted.

I went self hosted. It was about time to build a new desktop anyways (roughly 4 to 6 years before the old one goes to frolic at the server farm in the basement) and $2,000 will easily buy a machine that can run the quantized 65b models right now. So I spent slightly more than I normally do on this latest box and it's happily spitting out 10+ tokens a second. You're not going to beat GPT-4 yet, but you have direct con…

Would you be willing to create a guide? I think this would be of great help.

I started here https://github.com/ggerganov/llama.cpp

Which won't run everything, but will run model in the GGML format such as https://huggingface.co/TheBloke/llama-65B-GGML

The steps are basically:

1. Download a model

2. Make sure you have the latest nvidia driver for your machine, along with the cuda toolkit. This will vary by OS but is fairly easy on most linux distros.

3. compile https://github.com/ggerganov/llama.cpp following their instructions (in particular, look for LLAMA_CUBLAS for enabling GPU support)

4. Run the model following their instructions. There are several flags that are important, but you can also just use their server example that was added a few days ago - it gives a fairly solid chat interface.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#122

Post by vladgur »

horsawlarway wrote: post #95
verdverm wrote: post #84

Earlier quoted context omitted.

Not a student, stopped using ChatGPT because OpenAI is unreliable. Moved on to other models and providers

I went self hosted. It was about time to build a new desktop anyways (roughly 4 to 6 years before the old one goes to frolic at the server farm in the basement) and $2,000 will easily buy a machine that can run the quantized 65b models right now. So I spent slightly more than I normally do on this latest box and it's happily spitting out 10+ tokens a second. You're not going to beat GPT-4 yet, but you have direct con…

Can you describe your build?

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#123

Post by bilsbie »

crazygringo wrote: post #39

The culprit seems to be: > " Chollet thinks he knows what’s going on: summer vacation... a significant portion of students using ChatGPT to do their homework. It’s one of the most common uses for ChatGPT, according to Sam Gilbert, a data scientist and author. " https://finance.yahoo.com/news/chatgpt-suddenly-isn-t-boomin...

That’s the easy answer

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#124

Post by konha »

JimtheCoder wrote: post #120
konha wrote: post #116

Earlier quoted context omitted.

Have students work with ChatGPT and let them spot / mark where the AI is hallucinating or wrong? Might translate well to general competence wrt working with any kind of source online.

So they Google it?

So? Don‘t know what kind of homework you‘re thinking about. But using Google to do research doesn’t exactly sound like a problem to me.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#125

Post by dragonwriter »

stubybubs wrote: post #114
crazygringo wrote: post #39

The culprit seems to be: > " Chollet thinks he knows what’s going on: summer vacation... a significant portion of students using ChatGPT to do their homework. It’s one of the most common uses for ChatGPT, according to Sam Gilbert, a data scientist and author. " https://finance.yahoo.com/news/chatgpt-suddenly-isn-t-boomin...

Given that ChatGPT was just released last fall and it was expected to revolutionize practically everything, isn't it still telling that usage is falling? Where are the scientists, lawyers, doctors, office workers etc? You'd expect a slowing in the rate of growth, not shrinking. I don't know, if high school and undergrad students being off for the summer is enough to shrink your app maybe it's not all that? Edit: I un…

> Given that ChatGPT was just released last fall and it was expected to revolutionize practically everything, isn't it still telling that usage is falling?

Its not, though. ChatGPT, the website is basically an (increasingly non-exclusive, given BingAI) frontend. What is claimed to be revolutionary is the underlying models (in the narrow view) and similar generative AI systems (in the broader view). As more applications are built with either OpenAIs own underlying models or those from the broader space, the ChatGPT website should be expected to represent a smaller share of the relevant universe of use.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#126

Post by CydeWeys »

stubybubs wrote: post #114
crazygringo wrote: post #39

The culprit seems to be: > " Chollet thinks he knows what’s going on: summer vacation... a significant portion of students using ChatGPT to do their homework. It’s one of the most common uses for ChatGPT, according to Sam Gilbert, a data scientist and author. " https://finance.yahoo.com/news/chatgpt-suddenly-isn-t-boomin...

Given that ChatGPT was just released last fall and it was expected to revolutionize practically everything, isn't it still telling that usage is falling? Where are the scientists, lawyers, doctors, office workers etc? You'd expect a slowing in the rate of growth, not shrinking. I don't know, if high school and undergrad students being off for the summer is enough to shrink your app maybe it's not all that? Edit: I un…

I see people using ChatGPT, Bard, etc. to answer questions on mailing list threads. It'll be a long thread of thoughtful human written responses, and then someone will come along and say "I asked Bard what it thought about this issue, here's the response". And then out comes five paragraphs of text that I might as well not even bother reading, as it often contains falsehoods that I have to waste time looking up and double-checking. It bothers me so much that these LLMs don't have any inherent understanding of truth or facts, so the only thing they're really good at is writing fiction (e.g. I hear they're pretty good as a DM's assistant to flesh out flavor/scenario descriptions and such). The Midjourney generated images fall into the same fiction category and are generally pretty good too.

But for actual non-fiction usage, you have to spend so much time triple-checking everything they say to ensure that it isn't simply complete nonsense. What's the point?

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#127

Post by tomcam »

treeman79 wrote: post #97
crazygringo wrote: post #39

The culprit seems to be: > " Chollet thinks he knows what’s going on: summer vacation... a significant portion of students using ChatGPT to do their homework. It’s one of the most common uses for ChatGPT, according to Sam Gilbert, a data scientist and author. " https://finance.yahoo.com/news/chatgpt-suddenly-isn-t-boomin...

Mentioned ChatGPT to my teenager a few months ago. Huge percentage of the teenagers at her school are using it to do their assignments. Later I her to read a few chapters of her book for summer reading. When I quizzed her it, she got it right. Found out later she used ChatGPT to give her a summary of the first chapters. She did not enjoy having first weeks of summer without a phone. School is having to change all ass…

> She did not enjoy having first weeks of summer without a phone.

Good for you. I know that kind of situation is not fun for a parent either.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#128

Post by tomcam »

choppaface wrote: post #86
crazygringo wrote: post #39

The culprit seems to be: > " Chollet thinks he knows what’s going on: summer vacation... a significant portion of students using ChatGPT to do their homework. It’s one of the most common uses for ChatGPT, according to Sam Gilbert, a data scientist and author. " https://finance.yahoo.com/news/chatgpt-suddenly-isn-t-boomin...

While Francois Chollet is not actually an employee of OpenAI, and while that article simply quotes a tweet he made rather than a substantive interview .. .. this is still clearly a big problem for OpenAI as students trying to cheat on exams is a highly profitable $1T industry that Microsoft badly needs to disrupt.

> $1T industry

Does that mean $1 trillion? If so, citation badly needed.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#129

Post by disqard »

erichmond wrote: post #23
hashtag-til wrote: post #8

Earlier quoted context omitted.

Hey the initial round of AI was decades ago, FYI.

You and me reading books about fuzzy logic in the 80s didn't constitute the initial round of AI.

Lofti Zadeh ftw!

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#130

Post by vbezhenar »

Major issue for ChatGPT for me is its UI. It enables many things, but I feel like there's so much untapped potential. ChatGPT should act as autonomous agent, work on a problem, run things to test hypotheses, Google for up-to-date documentation, explore other code to learn code style and approaches and deliver final result. I guess it's not easy to implement those things, but once someone do it, they'd get a lot of value.
Post reply on HN