Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT is now finding bugs in databases

celerdata.com

Post reply on HN
Print view View original

21–30 of 204 posts

Re: ChatGPT is now finding bugs in databases

#21

Post by postalrat »

endisneigh wrote: post #10
ldjkfkdsjnv wrote: post #5

Today at work I hadnt used apache spark in a long time. I needed to do some quick and dirty data analytics on large datasets. Rather than read documentation, I just put the queries i needed in english into chatGPT, and it spit out perfectly working code. The queries werent that complex, but it saved me hours googling a bunch of random spark SQL syntax. The old school way is google sends you links, and through those c…

> I just cant believe how much better it made my day. Wait until how great your day will become when you’re unnecessary ;).

Looking forward to that day.

Re: ChatGPT is now finding bugs in databases

#25

Post by jahsome »

ldjkfkdsjnv wrote: post #5

Today at work I hadnt used apache spark in a long time. I needed to do some quick and dirty data analytics on large datasets. Rather than read documentation, I just put the queries i needed in english into chatGPT, and it spit out perfectly working code. The queries werent that complex, but it saved me hours googling a bunch of random spark SQL syntax. The old school way is google sends you links, and through those c…

I've had numerous days just like this.

The perfect use case for ChatGPT for my personal workflow has been to give me the 70-percent-of-the-way-there skeleton for a given query, Terraform module, or even just to prevent myself from lookup up the syntax of for loops in for the 30,000th time. I can then take that 70 percent chunk and bolt on my edge cases as I go.

There hasn't really been a time where the answer didn't need some massaging and of course occasionally it's flat out wrong, but that's becoming more and more apparent to me those instances are the result of feeding it sub-optimal prompts. I've found it to be eerily similar to my experience learning to use search engines back before SEO titles were a "thing."

It's frankly incredible how little I find myself using a traditional search engine compared to six months ago, at least in the context of work stuff. I'm less inclined to feed it general knowledge prompts, but it's encouraging to see the remarkable LLM tech leaps from generation to generation, and in such short order.

Re: ChatGPT is now finding bugs in databases

#26

Post by taberiand »

micromacrofoot wrote: post #6
ceejayoz wrote: post #4

Earlier quoted context omitted.

> The example ChatGPT instruction where they "teach it" just has the user giving it a URL to their docs and ChatGPT is like "oh ok got it". Yep. I asked it to summarize a URL. It happily invented something completely fabricated and convincing sounding (until you go to the URL) based of the domain name and article slug.

we’ve made the startling discovery that we’re rather predictable

My hypothesis is that we will soon see the emergence of a super-human artificial intelligence, not because of some astounding breakthroughs in our understanding of intelligence, but because of irrefutable proof that humans just aren't all that complicated to surpass.

Re: ChatGPT is now finding bugs in databases

#27

Post by dcow »

goatlover wrote: post #17
swatcoder wrote: post #9

Earlier quoted context omitted.

Hah. Of course the authors are not aware. OpenAI handed this tool to people with effectively no guidance or instructions so that they can trade on the glow of misconceptions and harvest user data. The whole point of giving the thing away for free these last few months is to let people make fools of themselves like this while pumping up OpenAI’s value as a technology firm. It’s no accident that they don’t engage to cl…

The concern is the increasing number of anecdotes where people are taking ChatGPT's output at face value, even though everyone knows by now that it does sometimes get stuff wrong and does hallucinate. I thought it would take longer.

The problem is that people also sometimes get stuff wrong and hallucinate. So ChatGPT is just mimicking how we behave and it seems completely normal.

Re: ChatGPT is now finding bugs in databases

#28

Post by nuclearnice3 »

paxys wrote: post #19
crazysim wrote: post #3

ChatGPT can't access the external internet. The example ChatGPT instruction where they "teach it" just has the user giving it a URL to their docs and ChatGPT is like "oh ok got it" (Figure 3). I'm not sure if the blog post writers are aware it's hallucinating what the JSON implementation is and hasn't actually read the documentation at all.

There's this internet phenomenon (common on Reddit and other such forums) where you find high-quality discussions on a variety of topics and everyone seems so clever and informative, until you come across a thread on a topic that you are actually an expert on and find that every top-voted comment is objectively incorrect. ChatGPT is essentially that but on steroids. Its primary ability is being able to sound extremel…

Before the had the internet, back when we still had newspapers, we had a similar phenomenon referred to as Gell-Mann Amnesia.

> Briefly stated, the Gell-Mann Amnesia effect is as follows. You open the newspaper to an article on some subject you know well. In Murray’s case, physics. In mine, show business. You read the article and see the journalist has absolutely no understanding of either the facts or the issues.

> In any case, you read with exasperation or amusement the multiple errors in a story, and then turn the page to national or international affairs, and read as if the rest of the newspaper was somehow more accurate about Palestine than the baloney you just read. You turn the page, and forget what you know.

https://www.epsilontheory.com/gell-mann-amnesia/

Re: ChatGPT is now finding bugs in databases

#29

Post by grugagag »

derefr wrote: post #12
crazysim wrote: post #3

ChatGPT can't access the external internet. The example ChatGPT instruction where they "teach it" just has the user giving it a URL to their docs and ChatGPT is like "oh ok got it" (Figure 3). I'm not sure if the blog post writers are aware it's hallucinating what the JSON implementation is and hasn't actually read the documentation at all.

It can't access the internet now . But it was fed a snapshot of the Internet during training. So if you tell it a URL, it can potentially remember what the page looked like, if it happened to see it during training.

You’re saying ChatGPT has access to a an older snapshot of the internet with URLs and everything?

Re: ChatGPT is now finding bugs in databases

#30

Post by [deleted] »

crazysim wrote: post #3

ChatGPT can't access the external internet. The example ChatGPT instruction where they "teach it" just has the user giving it a URL to their docs and ChatGPT is like "oh ok got it" (Figure 3). I'm not sure if the blog post writers are aware it's hallucinating what the JSON implementation is and hasn't actually read the documentation at all.

[deleted]
Post reply on HN