Live data from Hacker News

ChatGPT loses users for first time, shaking faith in AI revolution

washingtonpost.com

211–220 of 305 posts

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#211

Earlier quoted context omitted.

It really is astonishing how much you can get done this way. I've been setting up a home lab for myself, and the answers Gpt4 gives are miles ahead of the stack overflow results or documentation of the apps or whatever else. Rarely (very rarely) it will give me a wrong answer, but then I paste in the error message or describe the problem I had and it almost always comes up with the correct answer 2nd try. Final step…

Do you have some sample chat logs of interactions like this you can share? I'm curious to see what kind of stuff it's coming up with, and how you're prompting it.

I think he means something like this discussion I had with it earlier today about assembling squat racks. I literally knew zero about the topic https://chat.openai.com/share/a74bb56b-fc5b-40ec-90a9-f46cc7...

A few weeks back I was looking into how white supremacy works cause I didn't get it at all. We both came to a nice insight (it's a lot like a business monopoly) https://chat.openai.com/share/930e257f-addd-4371-ac37-370261...

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#213
Re the summer vacation dip comments, keep in mind that university students are done exams in mid April, and the article said that the usage peak was June. And in high school, the number of assignments is just not very high compared to say the output of a 40 hour worker. While likely a factor, I really doubt this can be mostly attributed to students.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#214

Earlier quoted context omitted.

It really is astonishing how much you can get done this way. I've been setting up a home lab for myself, and the answers Gpt4 gives are miles ahead of the stack overflow results or documentation of the apps or whatever else. Rarely (very rarely) it will give me a wrong answer, but then I paste in the error message or describe the problem I had and it almost always comes up with the correct answer 2nd try. Final step…

Oh come on. I fed Unreal c++ engine code to ChatGPT4 and it couldn't understand inheritence in Slate classes and therefore kept offering me the same broken solution for a parameter with the wrong type. The Unreal engine code is documented and publicly avaiable for OpenAI to ingest and it still gets the basics wrong. I wasted hours trying to get it to explain to me what I didn't know, if it doesn't understand the inte…

>It doesn't parse, it doesn't explain, it does not grok. It guesses at best and the blood sucking robot-horse is not telling the truth.

In my experience with coding (I've only done javascript and python myself) you have to tell it to explain and grok. It takes on the role you give it. Even just saying something like "you are a professional unreal developer specializing in C++, I am your apprentice writing code to (x). I want you to parse the following code in chunks, and tell me what might be wrong with it" before typing your prompt can help the output immensely. It starts to parse things because it's taken on the role of a teacher.

People love to hate on the idea of "prompt engineering" but it really is important how you prime the thing before asking it a question. The other thing I do is feed it the code slowly, and in logical steps. Feeding it 20 lines of code with a particular purpose / question you'll get a much better answer than feeding 200 lines of code with "what's wrong here?" You still need to know 90% of what's going on, and it becomes very good at helping out with that 10% you're missing. But for all I know it is just really bad at C++, that wouldn't surprise me. The things I'm using it for are definitely more simple.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#215

Earlier quoted context omitted.

Not a student, stopped using ChatGPT because OpenAI is unreliable. Moved on to other models and providers

Can you name some models or providers? I've been frustrated with OpenAI's constraints and would love to know my options.

Google Cloud for both VertexAI & "self-hosted" (run any model on GPUs). We are already there with the rest of our cloud, better privacy when you use gcloud apis than OpenAI

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#216

Earlier quoted context omitted.

Given that ChatGPT was just released last fall and it was expected to revolutionize practically everything, isn't it still telling that usage is falling? Where are the scientists, lawyers, doctors, office workers etc? You'd expect a slowing in the rate of growth, not shrinking. I don't know, if high school and undergrad students being off for the summer is enough to shrink your app maybe it's not all that? Edit: I un…

I see people using ChatGPT, Bard, etc. to answer questions on mailing list threads. It'll be a long thread of thoughtful human written responses, and then someone will come along and say "I asked Bard what it thought about this issue, here's the response". And then out comes five paragraphs of text that I might as well not even bother reading, as it often contains falsehoods that I have to waste time looking up and d…

[dead]

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#217

Earlier quoted context omitted.

I see people using ChatGPT, Bard, etc. to answer questions on mailing list threads. It'll be a long thread of thoughtful human written responses, and then someone will come along and say "I asked Bard what it thought about this issue, here's the response". And then out comes five paragraphs of text that I might as well not even bother reading, as it often contains falsehoods that I have to waste time looking up and d…

The point is you need to collaborate with the LLM, not just expect it to provide fully-formed answers. I've saved countless hours of work over the past few months using GPT-4 to help me solve problems. One general framework can be to use it to help you google a solution instead of a problem. Googling a problem gives you all kinds of results, which you then need to dig through and understand in order to evaluate wheth…

[dead]

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#218

Earlier quoted context omitted.

How does it seem to compare with GPT 3.5? That really seems like the baseline for what's usable.

My experience with open source models places them as a little bit worse than GPT 3, and nowhere close to GPT3.5. That said: - For many uses, it doesn't matter. For many of the ways I use it, I don't care. For basic use (e.g. clean up an email for me), it's basically the same. For things like complex reasoning, algorithms, or foreign languages, the hosted service is critical. - GPT3-grade models have more soul. OpenAI…

> OpenAI trained GPT3.5 and 4 to never do anything offensive, and that has a lot of negative side effects, well-documented in research.

I'm absolutely disgusted by OpenAI for this "do no offense" approach. How can people so smart be so damn uneducated?

Then again, this industry has disgusted me for a long time so it's not really a surprise.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#219

Earlier quoted context omitted.

Was ChatGPT supposed to revolutionize everything or was it the harbinger of LLMs?

ChatGPT is the Killer App that made people notice the potential of LLMs that had been brewing for several years.

I see it as multiple things combining to reach a critical mass. Yes it was the killer app but it was also the first time it was actually good enough to chat with. Put another way- it's the shittiest LLM application going forward or the worst LLM application that people are willing to pay for. The hype isn't specifically for ChatGPT but imagining the trendline of LLMs or LLM adjacent tech projected forward combined with still falling compute cost and further democratization.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#220
post #142

Earlier quoted context omitted.

It is more so the fact that someone takes something from ChatGPT, and then just feeds potentially contentious assertions into Google to see if they are true or not. What does someone learn from doing this? What happens when they actually have to use their brain to do something hard? At this point, why bother?

If someone plugs math into a calculator, are they really learning something when it spits out an answer? Of course! How to apply the calculator to problems, and how to discern if a problem is calculator-solveable. We've decided as a society it's better for students to use calculators as a tool in mathematics, why is chatGPT different in literature?

You can't type your homework into a calculator and get the answer out (at least not after basic arithmetic).

You have to understand the problem and how to use the tool.

If one's understanding of how to use the tool is limited to "access the tool and dump in the question, then blindly paste the response into my homework document", I'd say you are not learning much. It's obvious that every contemporary teenager can learn that in a few minutes. That's not giving us the capabilities to move forward as a society.

Post reply on HN