Live data from Hacker News

Show HN: Dataherald AI – Natural Language to SQL Engine

github.com

11–20 of 108 posts

Re: Show HN: Dataherald AI – Natural Language to SQL Engine

#11
Excellent! This blows writing SQL by hand out of the water.

In 10 years, programming languages like Java, SQL, etc will be dead.

I predict everyone will write in their native language (English, Chinese, etc) and a AI-based compiler will write the actual code for them.

Re: Show HN: Dataherald AI – Natural Language to SQL Engine

#12
We were using OpenAI's codex model with a bunch of few shot examples for natural language queries over blockchain data coupled with a finetuned completions model for plot the results when we were working on makerdojo.io.

Without the ability to fine tune Codex, we had to employ a bunch of techniques to pick the right set of examples to provide in the context to get good SQL. We have come very far since then and it has been great to see projects projects like sqlcoder and this.

Pieces of the pipeline powering makerdojo eventually became LLMStack (https://github.com/trypromptly/LLMStack). We are looking to integrate one of these SQL generators as processors in LLMStack so we can build higher level applications.

Re: Show HN: Dataherald AI – Natural Language to SQL Engine

#13
post #6

I’ve seen impressive demos with just LLM direct to SQL. Can’t wait to see what people build with these new tools.

Hi Dylan -- new GPT-4 class LLMs have gotten good at writing correct SQL, but while the SQL they generate almost always executes correctly they often write SQL that generates incorrect answers to the question. Some reasons for this can be the business context or definition is not in the table schema, or if the correct query is complex and requires multiple joins.

It's also because of the inherent nature and hallucinations in LLMs, likely impossible to remove completely, always double check the LLM's work

Re: Show HN: Dataherald AI – Natural Language to SQL Engine

#14

Excellent! This blows writing SQL by hand out of the water. In 10 years, programming languages like Java, SQL, etc will be dead. I predict everyone will write in their native language (English, Chinese, etc) and a AI-based compiler will write the actual code for them.

the future indeed!

Re: Show HN: Dataherald AI – Natural Language to SQL Engine

#15
"So is enterprise conversational BI impossible in 2023? Will there be a few more years of academic papers and company AI hackathon projects before a solution can be deployed in production? We don’t think so." -- from the medium article.

Want to put your attention to https://www.veezoo.com as well. A conversational self-service analytics solution that's been around since 2016 and productively deployed in fortune 500 companies and used by thousands of users daily :)

Congrats on the launch - and also reaching the top of the Spider dataset. We're very familiar with that dataset and its difficulties :)!

Happy to have a chat as well!

Re: Show HN: Dataherald AI – Natural Language to SQL Engine

#16
Neat! How difficult would it be to extend this to SQL like query languages like Hasura and PostgREST (via Supabase)?

- https://hasura.io/docs/latest/api-reference/graphql-api/quer...

- https://postgrest.org/en/stable/references/api/tables_views....

^ The advantage would be, these tools handle authorization.

Re: Show HN: Dataherald AI – Natural Language to SQL Engine

#17
post #15

"So is enterprise conversational BI impossible in 2023? Will there be a few more years of academic papers and company AI hackathon projects before a solution can be deployed in production? We don’t think so." -- from the medium article. Want to put your attention to https://www.veezoo.com as well. A conversational self-service analytics solution that's been around since 2016 and productively deployed in fortune 500 c…

[deleted]

Re: Show HN: Dataherald AI – Natural Language to SQL Engine

#18
post #12

We were using OpenAI's codex model with a bunch of few shot examples for natural language queries over blockchain data coupled with a finetuned completions model for plot the results when we were working on makerdojo.io. Without the ability to fine tune Codex, we had to employ a bunch of techniques to pick the right set of examples to provide in the context to get good SQL. We have come very far since then and it has…

[deleted]

Re: Show HN: Dataherald AI – Natural Language to SQL Engine

#19
post #6

Earlier quoted context omitted.

Hi Dylan -- new GPT-4 class LLMs have gotten good at writing correct SQL, but while the SQL they generate almost always executes correctly they often write SQL that generates incorrect answers to the question. Some reasons for this can be the business context or definition is not in the table schema, or if the correct query is complex and requires multiple joins.

It's also because of the inherent nature and hallucinations in LLMs, likely impossible to remove completely, always double check the LLM's work

Totally agree. In the hosted version built on top of the engine we block the answer from going to the question asker until an authorized user 'verifies' the answer. However these 'verified' answers are then stored in the context store and retrieved for few shot prompting.

Re: Show HN: Dataherald AI – Natural Language to SQL Engine

#20

Excellent! This blows writing SQL by hand out of the water. In 10 years, programming languages like Java, SQL, etc will be dead. I predict everyone will write in their native language (English, Chinese, etc) and a AI-based compiler will write the actual code for them.

said like a true swe
Post reply on HN