Live data from Hacker News

Replacing a SQL analyst with 26 recursive GPT prompts

patterns.app

21–30 of 311 posts

Re: Replacing a SQL analyst with 26 recursive GPT prompts

#21

I used to work for a company that paid loads of money to an Oracle consultancy group to do things like optimize queries. Sometimes they'd even do a better job than the Oracle query optimizer :-)

> Sometimes they'd even do a better job than the Oracle query optimizer

Surprising that outperforming the Oracle query optimizer wasn't a regular occurrence

Re: Replacing a SQL analyst with 26 recursive GPT prompts

#22

Earlier quoted context omitted.

my opinion: probably will work for harder queries, because GPT is a form of general intelligence. (At least ChatGPT is. It is a much more advanced form of intelligence than davinci-003, which the poster used.)

It's not even close to being a form of general intelligence. It's an advanced language model trained on a large set of data. It gets confused for even the simplest of things, especially code. You can trick it into working more-or-less correctly on simple sets and simple tasks, but in the wrong run it will be more wrong than correct.

"It's not even close to being a form of general intelligence. ... It gets confused for even the simplest of things, especially code.

Congratulations, you just described most humans :)

Re: Replacing a SQL analyst with 26 recursive GPT prompts

#23

Earlier quoted context omitted.

my opinion: probably will work for harder queries, because GPT is a form of general intelligence. (At least ChatGPT is. It is a much more advanced form of intelligence than davinci-003, which the poster used.)

It's not even close to being a form of general intelligence. It's an advanced language model trained on a large set of data. It gets confused for even the simplest of things, especially code. You can trick it into working more-or-less correctly on simple sets and simple tasks, but in the wrong run it will be more wrong than correct.

So it fails your "not even close to being a form of general intelligence" bar.

For me it clearly unambiguously no-contest 100% definitely exhibits behaviors that qualify it as a limited form of general intelligence.

Re: Replacing a SQL analyst with 26 recursive GPT prompts

#24

You didn't replace a SQL Analyst, you just gave them a query generator. End data consumers don't understand the data model, assumptions, quirks, etc. If they fire the analyst, they are going to wind up drawing a lot of bad conclusions on anything more complicated than simple aggregations.

You just described most SQL analysts I've worked with

Yeah, that is an issue a friend of mine has right now with his team. He randomly ended up as the manger of the data analytics team despite no analytics background (or really much programming background either). And one of his main frustrations is that the analysts do not understand the data model or the business. Before he became their manager his team just took report requests and then wrote some SQL and delivered some numbers. Without understanding what those numbers were supposed to mean or the quirks of the underlying data.

Re: Replacing a SQL analyst with 26 recursive GPT prompts

#25

Earlier quoted context omitted.

It's not even close to being a form of general intelligence. It's an advanced language model trained on a large set of data. It gets confused for even the simplest of things, especially code. You can trick it into working more-or-less correctly on simple sets and simple tasks, but in the wrong run it will be more wrong than correct.

to be fair, we do not know how close it's to "general intelligence". Could be lightyears away, or could be surprisingly close. We just know that ChatGPT is not general intelligence, but there's also no agreed upon definition what general intelligence is.

> Could be lightyears away

or even parsecs away!

Re: Replacing a SQL analyst with 26 recursive GPT prompts

#26
I love those ChatGPT projects! Of course it's silly and nobody is really replacing somebody with a program that confidently get half it's answers wrong. But it's fun to just naively let ChatGPT solve the problem.

But I wonder what it's going to look like in a few years. Currently, it's really just a demo that got surprisingly huge traction. I think the most pressing problem is not to get ChatGPT smarter but to get it more reliable. I think more realistic use-cases would emerge if we could build systems that have a better understanding when they are out of breath. I don't think this needs a revolutionary breakthrough just more science.

Re: Replacing a SQL analyst with 26 recursive GPT prompts

#27

I wonder how much more accurate this would get if fine tuned on a set of SQL problems? Could even fine tune it on a per-company basis using queries that had been written by analysts in the past.

It could probably get much more accurate. The idea of using AI/ML to tune databases or optimize queries isn't new; I expect to see more recommendations from DB hosting providers as a premium service.

Re: Replacing a SQL analyst with 26 recursive GPT prompts

#28

Earlier quoted context omitted.

no it's not. It's just a neural network. Although it's impressive nobody is seriously calling it "general intelligence".

Tu quoque :) (You're "just a neural network" too.) I am seriously calling it general intelligence. Maybe I'm nobody, but my assistant does my bidding.

Then you're very much misinformed.

> my assistant does my bidding

It doesn't. Try asking it how to make a bomb, then search for the same on youtube. One of the two yields a useful result, the other gives a moralistic lecture.

Re: Replacing a SQL analyst with 26 recursive GPT prompts

#30
post #24

Earlier quoted context omitted.

You just described most SQL analysts I've worked with

Yeah, that is an issue a friend of mine has right now with his team. He randomly ended up as the manger of the data analytics team despite no analytics background (or really much programming background either). And one of his main frustrations is that the analysts do not understand the data model or the business. Before he became their manager his team just took report requests and then wrote some SQL and delivered s…

Clearly, the correct move here is to replace the entire team with Looker and let every department head create their own dashboards to track arbitrary kpis with no understanding of the product or underlying data model. /s
Post reply on HN