Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT loses users for first time, shaking faith in AI revolution

washingtonpost.com

Post reply on HN
Print view View original

171–180 of 305 posts

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#171

Post by frognumber »

joekim wrote: post #102
horsawlarway wrote: post #95

Earlier quoted context omitted.

I went self hosted. It was about time to build a new desktop anyways (roughly 4 to 6 years before the old one goes to frolic at the server farm in the basement) and $2,000 will easily buy a machine that can run the quantized 65b models right now. So I spent slightly more than I normally do on this latest box and it's happily spitting out 10+ tokens a second. You're not going to beat GPT-4 yet, but you have direct con…

Would you be willing to create a guide? I think this would be of great help.

I'll make a simpler guide:

1) Go to https://gpt4all.io/index.html

2) Click the downloader for your OS

3) Run the installer

4) Run gpt4all, and wait for the obnoxiously slow startup time

... and that's it. On my machine, it works perfectly well -- about as fast as the web service version of GPT. I have a decent GPU, but I never checked if it's using it, since it's fast enough.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#172

Post by gAI »

JohnFen wrote: post #167
CydeWeys wrote: post #126

Earlier quoted context omitted.

I see people using ChatGPT, Bard, etc. to answer questions on mailing list threads. It'll be a long thread of thoughtful human written responses, and then someone will come along and say "I asked Bard what it thought about this issue, here's the response". And then out comes five paragraphs of text that I might as well not even bother reading, as it often contains falsehoods that I have to waste time looking up and d…

> then someone will come along and say "I asked Bard what it thought about this issue, here's the response" At least they tell you where the text came from, so you know to skip it. It's worse when they just post an LLM response as their own.

I love this, honestly. If I don't notice, that's a win for AI. If I do, then I just treat it as the new Rick Roll.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#173

Post by bilsbie »

horsawlarway wrote: post #95
verdverm wrote: post #84

Earlier quoted context omitted.

Not a student, stopped using ChatGPT because OpenAI is unreliable. Moved on to other models and providers

I went self hosted. It was about time to build a new desktop anyways (roughly 4 to 6 years before the old one goes to frolic at the server farm in the basement) and $2,000 will easily buy a machine that can run the quantized 65b models right now. So I spent slightly more than I normally do on this latest box and it's happily spitting out 10+ tokens a second. You're not going to beat GPT-4 yet, but you have direct con…

Does it ever refuse to answer you?

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#174

Post by 7thaccount »

JohnFen wrote: post #167
CydeWeys wrote: post #126

Earlier quoted context omitted.

I see people using ChatGPT, Bard, etc. to answer questions on mailing list threads. It'll be a long thread of thoughtful human written responses, and then someone will come along and say "I asked Bard what it thought about this issue, here's the response". And then out comes five paragraphs of text that I might as well not even bother reading, as it often contains falsehoods that I have to waste time looking up and d…

> then someone will come along and say "I asked Bard what it thought about this issue, here's the response" At least they tell you where the text came from, so you know to skip it. It's worse when they just post an LLM response as their own.

This would annoy me significantly. Can I ask what field you're in?

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#175

Post by frognumber »

horsawlarway wrote: post #150
vladgur wrote: post #122

Earlier quoted context omitted.

Can you describe your build?

2 x 3090 (renewed) ~1800 128gb ram ~400 reasonable processor/mobo/psu ~600 2Tb m2 drive ~94 In hindsight - I don't know that the second GPU was worth the spend. The c++ tooling is doing a very good job right now at spreading work between GPU vram and main ram and still being fast enough. Even ~4/5 tokens a second is fast enough to not feel like you're waiting. I'd suggest skipping the second card and dropping the pri…

Are you using the second GPU at all?

My experience is only a few systems will share load across GPUs. I didn't bother with dual GPUs for that reason.

4-5 tokens per second is slower than my system. I'm getting in the teens. I'm a little surprised since yours is newer, faster, and has way more RAM.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#177

Post by [deleted] »

7thaccount wrote: post #174
JohnFen wrote: post #167

Earlier quoted context omitted.

> then someone will come along and say "I asked Bard what it thought about this issue, here's the response" At least they tell you where the text came from, so you know to skip it. It's worse when they just post an LLM response as their own.

This would annoy me significantly. Can I ask what field you're in?

[deleted]

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#178

Post by orwin »

ragequitta wrote: post #165
tempestn wrote: post #144

Earlier quoted context omitted.

The point is you need to collaborate with the LLM, not just expect it to provide fully-formed answers. I've saved countless hours of work over the past few months using GPT-4 to help me solve problems. One general framework can be to use it to help you google a solution instead of a problem. Googling a problem gives you all kinds of results, which you then need to dig through and understand in order to evaluate wheth…

It really is astonishing how much you can get done this way. I've been setting up a home lab for myself, and the answers Gpt4 gives are miles ahead of the stack overflow results or documentation of the apps or whatever else. Rarely (very rarely) it will give me a wrong answer, but then I paste in the error message or describe the problem I had and it almost always comes up with the correct answer 2nd try. Final step…

I disagree with that. It's very useful writing boilerplate and documentation, but two third the time I'm in front of a bug I'm to lazy to understand and ask ChatGPT, with context and all, the answer is wrong. I can fiddle with it to reduce that to a third of the time, but in the end, only the questions that are really, really hard to figure on your own are left.

Still, it's way better and more efficient than Google. Less than not being lazy and using my two braincells tbh.

My newest use is

Hello, i' m working on X, I use Y tech, my app do Z and I want to implement W. Can you provide a plan on how and where to start?

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#179

Post by digitcatphd »

crazygringo wrote: post #39

The culprit seems to be: > " Chollet thinks he knows what’s going on: summer vacation... a significant portion of students using ChatGPT to do their homework. It’s one of the most common uses for ChatGPT, according to Sam Gilbert, a data scientist and author. " https://finance.yahoo.com/news/chatgpt-suddenly-isn-t-boomin...

There is likely also a ton of users who were just playing with it and had no true use case beyond asking it to make haikus about cats and got bored. IMO their true product is and always has been the API.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#180

Post by DantesKite »

In a tweet, the account for Similar Web said they don't actually measure iOS app traffic. They just measure traffic to the specific URL (https://chat.openai.com/).

Tweets in question:

"This chart doesn't measure app usage, only traffic to the website on desktop and mobile." https://twitter.com/Similarweb/status/1676576445764624385?s=...

"The graph indeed shows traffic only to the specific URL, http://chat.openai.com. It should be reviewed in this context." https://twitter.com/Similarweb/status/1676573510490046467?s=...

If you notice the app came out in May 2023 and traffic decreases for the first time in the following month in June 2023.

Additionally, you may notice the tweets refer to a specific chart, which might give the impression if you go on the site, they have the actual data, but this is not so.

As of July 7, 2023, Similar Web can't measure iOS app usage. Only their relative ranking on the App Store which doesn't tell you much about daily traffic usage, although we might be able to infer some patterns.

"Usage data is currently available only for apps in Google Play Store. We're working hard to support iOS apps soon"

https://www.similarweb.com/app/app-store/6448311069/statisti...

Additionally, the article has this to say, which might also give a false impression:

> Downloads of the bot’s iPhone app, which launched in May, have also steadily fallen since peaking in early June, according to data from Sensor Tower.

Downloads isn't the same as traffic. Once you've downloaded an app, you don't generally delete it, then download it over and over again. You just use it and that isn't being measured. Although I would expect traffic usage to slow down or decrease somewhat as downloads decrease as well. I just think there are other factors playing a role here as well that aren't being documented.

Growth can't happen forever and it may be that it's slowed down considerably, but it's also possible the decrease is due to users switching the platform they use to access ChatGPT. As it stands, it's not clear from the data from what I've seen. It may be that users switched en masse to the iOS app or something else entirely.

Would need more data to clarify and confirm.

Also, what the heck is up with this tagline for their newsletter? It sounds so adversarial.

"Tech is not your friend. We are. Sign up for The Tech Friend newsletter."

Post reply on HN