Live data from Hacker News

ChatGPT loses users for first time, shaking faith in AI revolution

washingtonpost.com

71–80 of 305 posts

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#72

The culprit seems to be: > " Chollet thinks he knows what’s going on: summer vacation... a significant portion of students using ChatGPT to do their homework. It’s one of the most common uses for ChatGPT, according to Sam Gilbert, a data scientist and author. " https://finance.yahoo.com/news/chatgpt-suddenly-isn-t-boomin...

This is like insanely obvious. This is almost as bad as people freaking out that total traffic in Feb is down 10% from Jan.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#73

I do think AI is here to stay, but that initial round of AI is going to destroy the world burned fast and hot. I can't even get ChatGPT (+ web plugin), when given a list of restaurants in NYC, to tell me which ones are still open vs have closed, and what their hours of operation / locations are. This is a pretty low bar request IMO. Showed me we still have a ways to go before AI is where we thought it was 3-4 months…

Not all of us were fooled by it!

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#74

The more safeguards, regulations, copyrights they add, the less useful ChatGPT becomes. It's a thing with many products. And I don't think it's bad that it's happening - safeguards exist for a reason. And current generations of LLM is very prone to lying (I don't use term hallucination, as IMO it's an attempt to whitewash limits of AI). ChatGPT did a great job at showing people current state of AI. But they did even…

"Lying" has a deliberate notion to it which imo is not accurate in this case

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#75
post #68

Earlier quoted context omitted.

The hard part is the SQL query, because you need to make sure the SQL query is safe to execute. Collecting data is far easier by comparison, but you absolutely could use an LLM for that too.

Can you give an example of how you'd define safe operations? I think a lot of use cases could just be 1) set up a database with only public data and 2) use a read-only user. The much tricker use case is those where you want to allow inserts and updates but only on specific tables or rows.

That's mostly safe, but even then, a user could execute "SELECT SLEEP(100000000)" thousands of times and DoS your database. There are other unsafe functions that a readonly user can execute as well. I've written extensively on some of the attack surface here https://docs.heimdallm.ai/en/latest/attack_surface/sql.html

HeimdaLLM can allowlist functions and constrain queries to ensure that required conditions exist. This makes LLM + database usage have far more utility, for example, a user can be restricted to only data in their account. Support for INSERT and UPDATE is coming very soon.

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#77
post #58

I was using ChatGPT this week for help with a back injury I suddenly sustained. Because I don't have insurance I was looking for options as to what I should do and what it'd cost and where to go etc. I did get a suggestion that I followed up on for an in person visit. But my big beef with it was that it kept adding disclaimers: "I am not a doctor", "My current knowledge is up to September 2021, insurance and hospital…

I suspect that if OpenAI didn't have ChatGPT continuously output these disclaimers then they could get in a lot of legal trouble if, say, someone asked it for medical or legal advice and then sued when something bad happened.

I sincerely hope OP is doing this for entertainment purposes only or as a very basic aid to shopping around, and not actually accepting medical advice from ChatGPT (or the Internet in general). The fact that I might be wrong about that suggests those disclaimers are absolutely necessary!

Re: ChatGPT loses users for first time, shaking faith in AI revolution

#78

The more safeguards, regulations, copyrights they add, the less useful ChatGPT becomes. It's a thing with many products. And I don't think it's bad that it's happening - safeguards exist for a reason. And current generations of LLM is very prone to lying (I don't use term hallucination, as IMO it's an attempt to whitewash limits of AI). ChatGPT did a great job at showing people current state of AI. But they did even…

> I don't use term hallucination, as IMO it's an attempt to whitewash limits of AI

Lying implies intent. I don't think the GPT models are purposely telling you misinformation.

That's why we call them hallucinations. Because they model "thinks" it is telling the truth.

Post reply on HN