Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT is now finding bugs in databases

celerdata.com

Post reply on HN
Print view View original

11–20 of 204 posts

Re: ChatGPT is now finding bugs in databases

#11

Post by Swizec »

ldjkfkdsjnv wrote: post #5

Today at work I hadnt used apache spark in a long time. I needed to do some quick and dirty data analytics on large datasets. Rather than read documentation, I just put the queries i needed in english into chatGPT, and it spit out perfectly working code. The queries werent that complex, but it saved me hours googling a bunch of random spark SQL syntax. The old school way is google sends you links, and through those c…

I think this is what people are missing when they say AI can’t replace search — research was never the goal, it was/is a necessary evil in one’s way to the goal.

Yes, current AI is not a perfect replacement yet

Re: ChatGPT is now finding bugs in databases

#12

Post by derefr »

crazysim wrote: post #3

ChatGPT can't access the external internet. The example ChatGPT instruction where they "teach it" just has the user giving it a URL to their docs and ChatGPT is like "oh ok got it" (Figure 3). I'm not sure if the blog post writers are aware it's hallucinating what the JSON implementation is and hasn't actually read the documentation at all.

It can't access the internet now. But it was fed a snapshot of the Internet during training. So if you tell it a URL, it can potentially remember what the page looked like, if it happened to see it during training.

Re: ChatGPT is now finding bugs in databases

#13

Post by nextaccountic »

crazysim wrote: post #3

ChatGPT can't access the external internet. The example ChatGPT instruction where they "teach it" just has the user giving it a URL to their docs and ChatGPT is like "oh ok got it" (Figure 3). I'm not sure if the blog post writers are aware it's hallucinating what the JSON implementation is and hasn't actually read the documentation at all.

> ChatGPT can't access the external internet.

ChatGPT by itself can't but if you build a product on top of its API, you can fetch the url itself and send the data in the ChatGPT's prompt

Re: ChatGPT is now finding bugs in databases

#14

Post by lumost »

nextaccountic wrote: post #13
crazysim wrote: post #3

ChatGPT can't access the external internet. The example ChatGPT instruction where they "teach it" just has the user giving it a URL to their docs and ChatGPT is like "oh ok got it" (Figure 3). I'm not sure if the blog post writers are aware it's hallucinating what the JSON implementation is and hasn't actually read the documentation at all.

> ChatGPT can't access the external internet. ChatGPT by itself can't but if you build a product on top of its API, you can fetch the url itself and send the data in the ChatGPT's prompt

ChatGPT is also highly familiar with what keywords to search for.

Re: ChatGPT is now finding bugs in databases

#15

Post by ramraj07 »

endisneigh wrote: post #10
ldjkfkdsjnv wrote: post #5

Today at work I hadnt used apache spark in a long time. I needed to do some quick and dirty data analytics on large datasets. Rather than read documentation, I just put the queries i needed in english into chatGPT, and it spit out perfectly working code. The queries werent that complex, but it saved me hours googling a bunch of random spark SQL syntax. The old school way is google sends you links, and through those c…

> I just cant believe how much better it made my day. Wait until how great your day will become when you’re unnecessary ;).

People are always made unnecessary. The smart ones then find other ways in which they are. Not sure how this is any different.

Re: ChatGPT is now finding bugs in databases

#16

Post by polishdude20 »

crazysim wrote: post #3

ChatGPT can't access the external internet. The example ChatGPT instruction where they "teach it" just has the user giving it a URL to their docs and ChatGPT is like "oh ok got it" (Figure 3). I'm not sure if the blog post writers are aware it's hallucinating what the JSON implementation is and hasn't actually read the documentation at all.

Is it possible that it "remembers" that url from it's training and the content tied to it?

Re: ChatGPT is now finding bugs in databases

#17

Post by goatlover »

swatcoder wrote: post #9
crazysim wrote: post #3

ChatGPT can't access the external internet. The example ChatGPT instruction where they "teach it" just has the user giving it a URL to their docs and ChatGPT is like "oh ok got it" (Figure 3). I'm not sure if the blog post writers are aware it's hallucinating what the JSON implementation is and hasn't actually read the documentation at all.

Hah. Of course the authors are not aware. OpenAI handed this tool to people with effectively no guidance or instructions so that they can trade on the glow of misconceptions and harvest user data. The whole point of giving the thing away for free these last few months is to let people make fools of themselves like this while pumping up OpenAI’s value as a technology firm. It’s no accident that they don’t engage to cl…

The concern is the increasing number of anecdotes where people are taking ChatGPT's output at face value, even though everyone knows by now that it does sometimes get stuff wrong and does hallucinate. I thought it would take longer.

Re: ChatGPT is now finding bugs in databases

#18

Post by Retr0id »

polishdude20 wrote: post #16
crazysim wrote: post #3

ChatGPT can't access the external internet. The example ChatGPT instruction where they "teach it" just has the user giving it a URL to their docs and ChatGPT is like "oh ok got it" (Figure 3). I'm not sure if the blog post writers are aware it's hallucinating what the JSON implementation is and hasn't actually read the documentation at all.

Is it possible that it "remembers" that url from it's training and the content tied to it?

Assuming the earlier statements from ChatGPT were correct, the feature did not exist before the training data cutoff, so that's impossible.

Re: ChatGPT is now finding bugs in databases

#19

Post by paxys »

crazysim wrote: post #3

ChatGPT can't access the external internet. The example ChatGPT instruction where they "teach it" just has the user giving it a URL to their docs and ChatGPT is like "oh ok got it" (Figure 3). I'm not sure if the blog post writers are aware it's hallucinating what the JSON implementation is and hasn't actually read the documentation at all.

There's this internet phenomenon (common on Reddit and other such forums) where you find high-quality discussions on a variety of topics and everyone seems so clever and informative, until you come across a thread on a topic that you are actually an expert on and find that every top-voted comment is objectively incorrect. ChatGPT is essentially that but on steroids. Its primary ability is being able to sound extremely confident in all its responses.

Re: ChatGPT is now finding bugs in databases

#20

Post by rideontime »

goatlover wrote: post #17
swatcoder wrote: post #9

Earlier quoted context omitted.

Hah. Of course the authors are not aware. OpenAI handed this tool to people with effectively no guidance or instructions so that they can trade on the glow of misconceptions and harvest user data. The whole point of giving the thing away for free these last few months is to let people make fools of themselves like this while pumping up OpenAI’s value as a technology firm. It’s no accident that they don’t engage to cl…

The concern is the increasing number of anecdotes where people are taking ChatGPT's output at face value, even though everyone knows by now that it does sometimes get stuff wrong and does hallucinate. I thought it would take longer.

Apparently everyone doesn't!
Post reply on HN