Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Vanna.ai: Chat with your SQL database

github.com

Post reply on HN
Print view View original

101–110 of 243 posts

Re: Vanna.ai: Chat with your SQL database

#101

Post by qiller »

swimwiththebeat wrote: post #76

I'm curious to see if people have tried this out with their datasets and seen success? I've been using similar techniques at work to build a bot that allows employees internally to talk to our structured datasets (a couple MySQL tables). It works kind of ok in practice, but there are a few challenges: 1. We have many enums and data types specific to our business that will never be in these foundation models. Those ha…

For 2. we ended up stuffing the prompt with examples for common date ranges "this month", "last year", "this year to date" and some date math, and examples of date fields (we have timestamp, and extracted Year, Month, Day, etc)

  Current date: `current_date()`
  3 days ago: `current_date() - INTERVAL 3 DAY`
  Beginning of this month: `date_trunc('month', current_date())`
  ...
4. I get best results with GPT-4, haven't tried Llama yet. 3.5 and 4-turbo tend to "forget" stuff for complex queries, but may be we need more tuning yet.

Re: Vanna.ai: Chat with your SQL database

#102

Post by hatsix »

codyvoda wrote: post #92
kszucs wrote: post #90

Earlier quoted context omitted.

Please add Ibis Birdbrain https://ibis-project.github.io/ibis-birdbrain/ to the list. Birdbrain is an AI-powered data bot, built on Ibis and Marvin, supporting more than 18 database backends. See https://github.com/ibis-project/ibis and https://ibis-project.org for more details.

note that Ibis Birdbrain is very much work-in-progress, but should provide an open-source solution to do this w/ 20+ backends old demo here: https://gist.github.com/lostmygithubaccount/08ddf29898732101... planning to finish it...soon...

soon like "check back in a month", or "Soon™"?

Re: Vanna.ai: Chat with your SQL database

#104

Post by samstave »

kulikalov wrote: post #100
samstave wrote: post #95

Earlier quoted context omitted.

Reverse idea: Use this to POPULATE sql based on captured NLP "surveillance" -- for example, build a DB of things I say as my thing listens to me, and categorize things, topics, place, people etc mentioned. Keep count of experiencing the same things.... When I say I need to "buy thing" build table of frequency for "buy thing" etc... Effectively - query anything you've said to Alexa and be able to map behaviors/habits/…

You are describing use case for a vector database

So you wouldnt be able to pull out specific phrases and store them in a typical RDBMS?

Re: Vanna.ai: Chat with your SQL database

#105

Post by codegeek »

bredren wrote: post #65
codegeek wrote: post #64

I have been keeping track of a few products like these including some that are YC backed. Interesting space as I am looking for a solution myself: - Minds DB (YC W20) https://github.com/mindsdb/mindsdb - Buster (YC W24) https://buster.so - DB Pilot https://dbpilot.io and now this one

Have you written up any results of your experience with each? I’m interested in a survey of this field so far and would read it.

Not yet but not a bad idea if I can get to test them all soon :)

Re: Vanna.ai: Chat with your SQL database

#106

Post by codyvoda »

hatsix wrote: post #102
codyvoda wrote: post #92

Earlier quoted context omitted.

note that Ibis Birdbrain is very much work-in-progress, but should provide an open-source solution to do this w/ 20+ backends old demo here: https://gist.github.com/lostmygithubaccount/08ddf29898732101... planning to finish it...soon...

soon like "check back in a month", or "Soon™"?

the "check back in a month" soon. I have versions of it that work but I just haven't been satisfied with. also, the major underlying dependency (Marvin) is going through a large refactor for v2. once that stabilizes a bit, I'm going to upgrade to it and that might simplify the code I need a lot

Re: Vanna.ai: Chat with your SQL database

#107

Post by bamboozled »

kulikalov wrote: post #99
pietz wrote: post #97

Earlier quoted context omitted.

I think you have a point. I also think people who share this mindset and keep sticking with it will have a tough future. The technical benefits and potentials clearly outshine the problems and challenges. That's also true in this example. You just have to let go of some principles that were helpful in the past but aren't anymore.

What technical benefits?

Your project manager can be an expert with SQL now too…and the novelty factor is high because using makes it feel like you’re in a “sci-fi” movie?

Re: Vanna.ai: Chat with your SQL database

#108

Post by zainhoda »

aussieguy1234 wrote: post #78

I've already done this with GPT-4. It goes something like this: Here's the table structure from MySQL cli `SHOW TABLE` statements for my tables I want to query. Now given those tables, give me a query to show me my cart abandonment rate (or, some other business metric I want to know). Seems to work pretty well.

Author of the package here. That's pretty much what this package does just with optimization around what context gets sent to the LLM about the database:

https://github.com/vanna-ai/vanna/blob/main/src/vanna/base/b...

And then of course once you have the SQL, you can put it in an interface where you the SQL can be run automatically and then get a chart etc.

Re: Vanna.ai: Chat with your SQL database

#109

Post by zainhoda »

pamelafox wrote: post #25

I love that this exists but I worry how it uses the term “train”, even in quotes, as I spend a lot of time explaining how RAG works and I try to emphasize that there is no training/fine-tuning involved. Just data preparation, chunking and vectorization as needed.

Author of the package here. I would be open to alternative suggestions on terminology! The problem is that our typical user has never encountered RAG before.

Re: Vanna.ai: Chat with your SQL database

#110

Post by ta8645 »

metflex wrote: post #33

that's it, we are going to lose our jobs

The extremely-lucrative days in IT for large numbers of people, are drawing to a close. On the other hand, while you won't make more than someone who works at 7/11, there will be rudimentary IT jobs available, if you want them.
Post reply on HN