Live data from Hacker News

Show HN: Dataherald AI – Natural Language to SQL Engine

github.com

21–30 of 108 posts

Re: Show HN: Dataherald AI – Natural Language to SQL Engine

#21

Neat! How difficult would it be to extend this to SQL like query languages like Hasura and PostgREST (via Supabase)? - https://hasura.io/docs/latest/api-reference/graphql-api/quer... - https://postgrest.org/en/stable/references/api/tables_views.... ^ The advantage would be, these tools handle authorization.

It shouldn't be difficult, if we provide many examples and the db/table schema the agent can provide an accurate response

Re: Show HN: Dataherald AI – Natural Language to SQL Engine

#22

Excellent! This blows writing SQL by hand out of the water. In 10 years, programming languages like Java, SQL, etc will be dead. I predict everyone will write in their native language (English, Chinese, etc) and a AI-based compiler will write the actual code for them.

said like a true swe

A mix of magic and imagination.

Re: Show HN: Dataherald AI – Natural Language to SQL Engine

#23

Neat! How difficult would it be to extend this to SQL like query languages like Hasura and PostgREST (via Supabase)? - https://hasura.io/docs/latest/api-reference/graphql-api/quer... - https://postgrest.org/en/stable/references/api/tables_views.... ^ The advantage would be, these tools handle authorization.

Interesting. So far we have been focused on allowing non-technical users to self-serve from enterprise data warehouses. It might be possible to enable this scenario with a simple addition to the NL-2-SQL engine to translate the generated SQL to API calls. If that does not work, a custom imeplementation of the NL-2-SQL module would def solve this.

Do you have a specific use-case in mind? Would love to collaborate on adding it to the open-source library if you are open to it.

Re: Show HN: Dataherald AI – Natural Language to SQL Engine

#24
post #12

We were using OpenAI's codex model with a bunch of few shot examples for natural language queries over blockchain data coupled with a finetuned completions model for plot the results when we were working on makerdojo.io. Without the ability to fine tune Codex, we had to employ a bunch of techniques to pick the right set of examples to provide in the context to get good SQL. We have come very far since then and it has…

We are looking to partner with other open source projects. Let's connect. Shoot me a line at amir at dataherald.com

Re: Show HN: Dataherald AI – Natural Language to SQL Engine

#25
post #15

"So is enterprise conversational BI impossible in 2023? Will there be a few more years of academic papers and company AI hackathon projects before a solution can be deployed in production? We don’t think so." -- from the medium article. Want to put your attention to https://www.veezoo.com as well. A conversational self-service analytics solution that's been around since 2016 and productively deployed in fortune 500 c…

Amazing! Feel free to shoot me a line at amir at dataherald

Re: Show HN: Dataherald AI – Natural Language to SQL Engine

#26
post #23

Neat! How difficult would it be to extend this to SQL like query languages like Hasura and PostgREST (via Supabase)? - https://hasura.io/docs/latest/api-reference/graphql-api/quer... - https://postgrest.org/en/stable/references/api/tables_views.... ^ The advantage would be, these tools handle authorization.

Interesting. So far we have been focused on allowing non-technical users to self-serve from enterprise data warehouses. It might be possible to enable this scenario with a simple addition to the NL-2-SQL engine to translate the generated SQL to API calls. If that does not work, a custom imeplementation of the NL-2-SQL module would def solve this. Do you have a specific use-case in mind? Would love to collaborate on a…

Mostly my concerns are around authorization (who can access what) and those two tools handle that before generating a database query. So maybe the approach would be to go from natural lang -> SQL (as you do now) then to Hasura's or PostgREST's specific query syntax (which are already pretty SQL like). And specifically with Hasura, since it's GraphQL - you can get all the available types. But that might all be to far out of scope of what you're trying to do.

Re: Show HN: Dataherald AI – Natural Language to SQL Engine

#27
post #6

I’ve seen impressive demos with just LLM direct to SQL. Can’t wait to see what people build with these new tools.

Hi Dylan -- new GPT-4 class LLMs have gotten good at writing correct SQL, but while the SQL they generate almost always executes correctly they often write SQL that generates incorrect answers to the question. Some reasons for this can be the business context or definition is not in the table schema, or if the correct query is complex and requires multiple joins.

Yeah, you really shouldn’t be building this (or really any sort of important or destructive interface) with LLMs unless you have an intermediate representation which users can inspect and understand. Even if the understanding of English were perfect there are still ambiguities you’d need to sort out. You also need to be able to suggest something useful if the user asks a nonsense question (for example data that doesn’t exist in your schema or its contents). When I worked on this a decade ago we were quite good at mapping unknown queries to various suggestions drawn from a canonical subset of English for which we had very explicit semantics. But obviously the Soave of unknowns was huge.

I’ve no doubt the AIs will reach human parity at some point (and therefore still make mistakes!) but I’d be terrified deploying any sort of one-shot text-to-results pipeline today.

Re: Show HN: Dataherald AI – Natural Language to SQL Engine

#29
post #15

"So is enterprise conversational BI impossible in 2023? Will there be a few more years of academic papers and company AI hackathon projects before a solution can be deployed in production? We don’t think so." -- from the medium article. Want to put your attention to https://www.veezoo.com as well. A conversational self-service analytics solution that's been around since 2016 and productively deployed in fortune 500 c…

Very cool. I'm checking out veezoo.com now!
Post reply on HN