Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT is now finding bugs in databases

celerdata.com

Post reply on HN
Print view View original

101–110 of 204 posts

Re: ChatGPT is now finding bugs in databases

#101

Post by ChatGTP »

stevenhuang wrote: post #92
pyuser583 wrote: post #79

Earlier quoted context omitted.

I’ve been quizzing ChatGPT about it’s knowledge of the oil industry - it has no idea what’s talking about. For example, I ask it to simulate a discussion between a flow engineer and a geologist, and it doesn’t seem to understand they work together regularly. Not like there’a a stack overflow for this sort of thing.

you need to prompt it with more specific knowledge; if you're generic in your prompts it will be generic in its responses. inject some field-specific terminology and be esoteric in your queries, etc its latent representation is vast, I find you can get much higher quality+interesting responses if the prompts are tuned appropriately

Here’s the thing though, when you keep having to “prompt it”, are you really doing the work yourself by coaxing a good enough bullshit answer that you’ll believe it? It could still be useful, not sure.

Re: ChatGPT is now finding bugs in databases

#102

Post by andrethegiant »

crazysim wrote: post #3

ChatGPT can't access the external internet. The example ChatGPT instruction where they "teach it" just has the user giving it a URL to their docs and ChatGPT is like "oh ok got it" (Figure 3). I'm not sure if the blog post writers are aware it's hallucinating what the JSON implementation is and hasn't actually read the documentation at all.

It absolutely will be able to access the external internet

Re: ChatGPT is now finding bugs in databases

#103

Post by vkou »

paxys wrote: post #62
danielvaughn wrote: post #56

Earlier quoted context omitted.

I think a lot of overly-eager and under-informed people are jumping on the bandwagon and shouting half-baked proclamations from the rooftops to get clicks and views. But underneath all the bullshit is something truly useful, so I wouldn't necessarily say that Confidently Incorrect™ is ChatGPT's primary ability. Coincidentally, over the past few weeks of this ChatGPT craze, I've needed to create a lot of fake data to…

While I agree with your premise, the "toil" that you mention is a very small use case for a tiny minority of people. And automating it away has always been trivial. What would have taken 30 minutes to write a Python script now takes 5 minutes to come up with the perfect prompt. And then you have to test and be sure that it does what you want. Neat, but not world-changing. Meanwhile ChatGPT is already being hailed as…

> Meanwhile ChatGPT is already being hailed as the Google killer.

The only Google-killing aspect of it is a better understanding of user queries.

Although given how often I have to remind it of the details of my questions, maybe it's not even good at that.

Re: ChatGPT is now finding bugs in databases

#104

Post by sbecker »

ilaksh wrote: post #72
ldjkfkdsjnv wrote: post #5

Today at work I hadnt used apache spark in a long time. I needed to do some quick and dirty data analytics on large datasets. Rather than read documentation, I just put the queries i needed in english into chatGPT, and it spit out perfectly working code. The queries werent that complex, but it saved me hours googling a bunch of random spark SQL syntax. The old school way is google sends you links, and through those c…

Well.. if we are doing ChatGPT anecdotes.. today I tried to "launch" the new version of https://aidev.codes . It integrates the ChatGPT API with Stability.ai (stable diffusion) for generating images and well as Eleven Labs text-to-speech and can create and immediately host an interactive web page on a custom subdomain. I need marketing help. Or I should just stop trying. I don't see how people are able to get posts o…

I just watched the demo and personally thought it was amazing. Don't give up! Keep going!

Re: ChatGPT is now finding bugs in databases

#105

Post by jimbokun »

jahsome wrote: post #38
ceejayoz wrote: post #4

Earlier quoted context omitted.

> The example ChatGPT instruction where they "teach it" just has the user giving it a URL to their docs and ChatGPT is like "oh ok got it". Yep. I asked it to summarize a URL. It happily invented something completely fabricated and convincing sounding (until you go to the URL) based of the domain name and article slug.

I asked it to generate me documentation for a handful Bicep definitions and include links to the official Microsoft Docs. It generated about 50% erroneous links, but once I updated my prompt and fed it the "root" of the MS docs I wanted it to use, it was able to correct all the urls. At the time it _seemed_ like it wasn't just doing a mindless string replace, because different parts of the url changed on most of the…

Wouldn’t it be wild if it just guessed the URLs correctly, because it had seen so many URLs from Microsoft URLs it was able to correctly predict the form of URLs it hadn’t seen yet?

Re: ChatGPT is now finding bugs in databases

#106

Post by jimbokun »

olalonde wrote: post #61
endisneigh wrote: post #37

Earlier quoted context omitted.

What we are discussing is something that removes the need for problem solving. What will the supposed smart do if there’s a magical machine that can solve all problems that can be represented as text?

I don't know about others but I'll be enjoying the beach, partying, watching movies, etc.

With what money?

Will we have UBI before ChatGPT (or whatever comes next) can do all our jobs?

Re: ChatGPT is now finding bugs in databases

#107

Post by ilaksh »

sbecker wrote: post #104
ilaksh wrote: post #72

Earlier quoted context omitted.

Well.. if we are doing ChatGPT anecdotes.. today I tried to "launch" the new version of https://aidev.codes . It integrates the ChatGPT API with Stability.ai (stable diffusion) for generating images and well as Eleven Labs text-to-speech and can create and immediately host an interactive web page on a custom subdomain. I need marketing help. Or I should just stop trying. I don't see how people are able to get posts o…

I just watched the demo and personally thought it was amazing. Don't give up! Keep going!

Thank you means a lot.

Re: ChatGPT is now finding bugs in databases

#108

Post by _0ffh »

paxys wrote: post #19
crazysim wrote: post #3

ChatGPT can't access the external internet. The example ChatGPT instruction where they "teach it" just has the user giving it a URL to their docs and ChatGPT is like "oh ok got it" (Figure 3). I'm not sure if the blog post writers are aware it's hallucinating what the JSON implementation is and hasn't actually read the documentation at all.

There's this internet phenomenon (common on Reddit and other such forums) where you find high-quality discussions on a variety of topics and everyone seems so clever and informative, until you come across a thread on a topic that you are actually an expert on and find that every top-voted comment is objectively incorrect. ChatGPT is essentially that but on steroids. Its primary ability is being able to sound extremel…

I don't think it's an internet phenomenon. It's a human phenomenon. It doesn't matter if it's a conversation or a piece in a newspaper (c.f. the Gell-Mann amnesia effect).

Re: ChatGPT is now finding bugs in databases

#109

Post by ryanjshaw »

ilaksh wrote: post #72
ldjkfkdsjnv wrote: post #5

Today at work I hadnt used apache spark in a long time. I needed to do some quick and dirty data analytics on large datasets. Rather than read documentation, I just put the queries i needed in english into chatGPT, and it spit out perfectly working code. The queries werent that complex, but it saved me hours googling a bunch of random spark SQL syntax. The old school way is google sends you links, and through those c…

Well.. if we are doing ChatGPT anecdotes.. today I tried to "launch" the new version of https://aidev.codes . It integrates the ChatGPT API with Stability.ai (stable diffusion) for generating images and well as Eleven Labs text-to-speech and can create and immediately host an interactive web page on a custom subdomain. I need marketing help. Or I should just stop trying. I don't see how people are able to get posts o…

If you listen to the people who have done this before (e.g. read/listen to indie hackers), Reddit/HN is very hit/miss.

Only thing seems to consistently work is Twitter - and then you should REALLY be building public if you have no audience so that you can build one. Have you tried this? If not, and you've been building in stealth mode, you've missed out on an opportunity but you can still start now.

You are figuring out so much stuff in an area without expert - make a Twitter post every day about what new problem you solved and you will quickly find a following as you establish authority in this new field. So many people are learning from each other about this stuff, it doesn't take much to become an expert.

I've been going through all the Indie Hackers podcasts. Consider listening to Indie hackers #008 or #009, I think they specifically talk about bootstrapping an audience from nothing.

You may even find people are more interested in an educational product from you than your service, and pivot, for instance.

Re: ChatGPT is now finding bugs in databases

#110

Post by colechristensen »

codebje wrote: post #77
colechristensen wrote: post #47

Earlier quoted context omitted.

These models have probably been trained on a large portion of the Internet. The training data however can be a few years old. I have noticed this when trying to get it to generate some code, it was clearly using considerably old versions.

> I have noticed this when trying to get it to generate some code, it was clearly using considerably old versions. I have noticed the same thing when trying to use junior devs to generate some code, usually correlating with how old the most popular Stack Overflow question on the subject is.

This is how we decided to describe chatgpt’s programming ability the other day. A very fast but somewhat inadequate jr developer. Is amazing really but you also have to ask for the same thing a dozen times and still spend quite a while figuring out what’s wrong with it.
Post reply on HN