Live data from Hacker News

ChatGPT loses users for first time, shaking faith in AI revolution

washingtonpost.com

201–210 of 305 posts

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#201

I asked ChatGPT last night how to debug a C function that was driving me nuts and it told me what I was doing wrong in one second.

Sometimes it's very good I had a list of strings in this format "foo:bar:baz" and needed to convert this into an dict {"foo":{"bar":"baz"} It wrote me the function and I got on with the rest of my work. Other times it's just completely wrong or doesn't get what I'm after is might be a "me" problem with my prompting

It's 11PM and the unclosed curly bracket here is going to prevent me from sleeping.

Did you mean ``` {"foo":{"bar":"baz"}} ```

?

By the way, have you had success at asking GPT to generate unit tests that include edge cases? I've been wondering about that.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#202

The article doesn't make it clear, but I doubt "users" includes consumers of the API (and the second-order users of the apps using the API). It seems not only reasonable but expected to see the general user count fall off in favor of people building more specialized alternatives that solve XYZ problem better. ChatGPT (the B2C SaaS) might have a lower user count, but ChatGPT (the model) and GPT (the technology) seem a…

"The number of people visiting AI chatbot ChatGPT’s website and downloading its app fell". That's the article's byline, to me that's quite clear they are talking about publicly available stats, not some internal metric of users or API usage.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#203

ChatGPT is too vanilla and is hiding a lot of "dark knowledge" - and I am not talking about obvious dangerous stuff, that should rightly so be censored, but rather being able to get insight how the rich operate, how they avoid paying taxes, how they build the financial structures, how they hide the money, what mechanisms they use to corrupt politicians or influence elections and how they get away with it and so on an…

Why downvotes? Are you not curious how these things work, so that we can as citizens work to stop it?

Security by obscurity?

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#204
post #135

Earlier quoted context omitted.

The marketing is what you're complaining about? Log in: > This is a free research preview. > Our goal is to get external feedback in order to improve our systems and make them safer. > While we have safeguards in place, the system may occasionally generate incorrect or misleading information and produce offensive or biased content. It is not intended to give advice. *next page* > Limitations > May occasionally genera…

What you describe is not marketing - it's legal-ish language. For marketing - listen to Sam Altman says. Listen to what VCs say. Listen to what influencers say.

“People are begging to be disappointed and they will be. The hype is just like... We don’t have an actual AGI and that’s sort of what’s expected of us.”

- Sam Altman in an interview about GPT-4 with StrictlyVC

"(GPT4) is a system that will look back and say it was a very early AI. It is slow, it is buggy, and it does not do a lot of things very well, but neither did the very earliest computers, and they still pointed to a path that is going to be really important in our lives even if it took a few decades,"

- Sam Altman in an interview about GPT-4 with Lex Fridman

The "influencers" may be saying any old rubbish; but that was always so, and the subjects of their fantasies should not be blamed for nonsense being spouted about them.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#205

The culprit seems to be: > " Chollet thinks he knows what’s going on: summer vacation... a significant portion of students using ChatGPT to do their homework. It’s one of the most common uses for ChatGPT, according to Sam Gilbert, a data scientist and author. " https://finance.yahoo.com/news/chatgpt-suddenly-isn-t-boomin...

Given that ChatGPT was just released last fall and it was expected to revolutionize practically everything, isn't it still telling that usage is falling? Where are the scientists, lawyers, doctors, office workers etc? You'd expect a slowing in the rate of growth, not shrinking. I don't know, if high school and undergrad students being off for the summer is enough to shrink your app maybe it's not all that? Edit: I un…

These metrics are based on traffic to chat.openai.com.

Speaking for myself, I used to use the crappy chat interface but I now exclusively use tooling I've built up around their API.

So, n=1, I'm using OpenAI much more, despite using chat.openai.com less.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#206

Earlier quoted context omitted.

It really is astonishing how much you can get done this way. I've been setting up a home lab for myself, and the answers Gpt4 gives are miles ahead of the stack overflow results or documentation of the apps or whatever else. Rarely (very rarely) it will give me a wrong answer, but then I paste in the error message or describe the problem I had and it almost always comes up with the correct answer 2nd try. Final step…

Oh come on. I fed Unreal c++ engine code to ChatGPT4 and it couldn't understand inheritence in Slate classes and therefore kept offering me the same broken solution for a parameter with the wrong type. The Unreal engine code is documented and publicly avaiable for OpenAI to ingest and it still gets the basics wrong. I wasted hours trying to get it to explain to me what I didn't know, if it doesn't understand the inte…

My observation (which could be wrong) is that ChatGPT as a programmer's aid is only useful for the simple cases. Not so much for complex stuff, and certainly not for something as complex as the Unreal engine.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#207

Earlier quoted context omitted.

I see people using ChatGPT, Bard, etc. to answer questions on mailing list threads. It'll be a long thread of thoughtful human written responses, and then someone will come along and say "I asked Bard what it thought about this issue, here's the response". And then out comes five paragraphs of text that I might as well not even bother reading, as it often contains falsehoods that I have to waste time looking up and d…

The point is you need to collaborate with the LLM, not just expect it to provide fully-formed answers. I've saved countless hours of work over the past few months using GPT-4 to help me solve problems. One general framework can be to use it to help you google a solution instead of a problem. Googling a problem gives you all kinds of results, which you then need to dig through and understand in order to evaluate wheth…

>Googling a problem gives you all kinds of results, which you then need to dig through and understand in order to evaluate whether there's something that can be adapted to your use case.

Exactly; search engines give you those blue links and short descriptions of the search results which are not enough for you to grasp what is the website about. I think what search engines need to do is tackle the complexity of going through the results of a search engine. Google page rank seemed like a silver bullet back in the day but the websites which are the most popular are not necessarily of the best quality. What we need is to lower the complexity for casual users when they deal with search results.

On the other hand ChatGPT is like an answer machine that can give you satisfactory answer on your fist try but if not, you need to talk with it, push it and explore what answers it gives you, just like you said. I think ChatGPT type search engine will be more suitable for people who are "lazy" or for the people who don't have time to "Google" and go through search results and look around the web for the helpful and useful information.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#208

Earlier quoted context omitted.

Given that ChatGPT was just released last fall and it was expected to revolutionize practically everything, isn't it still telling that usage is falling? Where are the scientists, lawyers, doctors, office workers etc? You'd expect a slowing in the rate of growth, not shrinking. I don't know, if high school and undergrad students being off for the summer is enough to shrink your app maybe it's not all that? Edit: I un…

Was ChatGPT supposed to revolutionize everything or was it the harbinger of LLMs?

ChatGPT is the Killer App that made people notice the potential of LLMs that had been brewing for several years.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#209

Earlier quoted context omitted.

It really is astonishing how much you can get done this way. I've been setting up a home lab for myself, and the answers Gpt4 gives are miles ahead of the stack overflow results or documentation of the apps or whatever else. Rarely (very rarely) it will give me a wrong answer, but then I paste in the error message or describe the problem I had and it almost always comes up with the correct answer 2nd try. Final step…

Do you have some sample chat logs of interactions like this you can share? I'm curious to see what kind of stuff it's coming up with, and how you're prompting it.

I don't tend to keep the chat logs, as the amount of them gets unwieldy very quickly. But examples of things I've done with it that are useful:

I wanted to create a web app, something I haven't done in a very long time. Just a simple throwaway back-of-the napkin app for personal use. I described what I wanted it to do, and asked what might be a good frontend/backend. It listed a few, I narrowed it down even more. Ended up deciding on flask/quasar.

After helping me setup VS Code with the proper extensions for fancy editing, and guiding me through the basic quasar/flask setup, it then was able to help me immensely creating a basic login page for the app. Then it easily integrated openAI api into it with all the proper quasar sliders for tokens/temperature/etc. Then it created a pretty good CSS template for the app as well, and a color scheme that I was able to describe as "something on adobe color that is professional and x and x (friendly, warm, whatever you want to put in)". Everything worked flawlessly with very little fuss, and I'd never used flask or quasar before in my life. You can also delve VERY deep into how to make the app more secure, as I did for fun one evening even though it's not going to be internet facing.

Another thing I did was go over some pfSense documentation with it. I had some clarifying questions about HAProxy, as well as setting up Acme Certificates with my specific DNS provider. It was extremely helpful with both. It also taught me about nitty gritty settings in the Unbound DNS resolver in a way that's much more informative than the documentation, and helped me set up some internal domains for pihole, xen orchestra, etc with certificates. Also helped me separate out my networks (IoT, Guest network, etc), and taught me about Avahi to access my hue lights through mDNS.These are things I always wanted to do, I just never felt like going down a google rabbit hole getting mostly the wrong answers.

Last example I'll give is it was able to help me set up docker-compose plex within portainer that then uses my nvidia GPU for acceleration. The only thing I had to change from the instructions it gave was to get updated nvidia driver #s and I grabbed the latest docker-compose file. I'd never used portainer in my life before, nor do I have experience with nvidia drivers within linux, and I feel like learning it was many times faster being able to ask a chatbot question vs trying to google everything. Granted I still had to RTFM for the basics, as everyone should always do.

I think perhaps my use cases are a bit more "basic" than many HN users. Like I said I'm not asking it to do problems most humans wouldn't be able to do, as I know it isn't quite there yet. But for things like XCP-ng, portainer, linux scripts, learning software you've never used before, or even just framing a problem I'm having in steps I hadn't thought of it's been invaluable to me. For me it's like documentation you can ask clarifying questions to. And almost none of the things I've asked it would work at all if it were wrong, I would know immediately.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#210

The culprit seems to be: > " Chollet thinks he knows what’s going on: summer vacation... a significant portion of students using ChatGPT to do their homework. It’s one of the most common uses for ChatGPT, according to Sam Gilbert, a data scientist and author. " https://finance.yahoo.com/news/chatgpt-suddenly-isn-t-boomin...

Given that ChatGPT was just released last fall and it was expected to revolutionize practically everything, isn't it still telling that usage is falling? Where are the scientists, lawyers, doctors, office workers etc? You'd expect a slowing in the rate of growth, not shrinking. I don't know, if high school and undergrad students being off for the summer is enough to shrink your app maybe it's not all that? Edit: I un…

> If they're really experiencing a decline in users that's not great for them.

If it's the case that "there are new tools coming, but most of them aren't out yet" - and I believe it is[0] - then the overall userbase of ChatGPT doesn't matter to OpenAI, because soon enough the same models will come back with a vengeance, in a different, more streamlined form.

In fact, I feel that the major change will happen if and when Microsoft gets their Office 365 and Windows copilots working and properly released: they'll have instant penetration into every industry, including scientists, lawyers, doctors, and office workers.

--

[0] - It's been only few months. Between playing around, experimenting, then developing, testing and marketing a tool, there just hasn't been enough time to do all of that.

Post reply on HN