Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Chat with your data using LangChain, Pinecone, and Airbyte

airbyte.com

Post reply on HN
Print view View original

31–40 of 61 posts

Re: Show HN: Chat with your data using LangChain, Pinecone, and Airbyte

#31

Post by bnchrch »

BoorishBears wrote: post #21
bnchrch wrote: post #2

Always so happy to see a tutorial with actual substance. So much on LLMs lately is mostly blog spam for SEO but this actually is information dense and practical. Definitely bookmarking this for tonight. Also really happy to see a bonus section on pulling in data from third party websites. I think this is where LLMs get really interesting. Not only is data much easier to query with these new models, its also orders of…

It's a little weird writing a comment worded like this if you work at Airbyte isn't it?

You know what, reading it, this is a very fair callout. Im sorry.

Last week I had seen a draft of this and thought to myself all these same things.

It was a well written tutorial, and that it was exactly the type of format I wouldve hopped for as a engineer. To the point, with a lot of examples.

It really is the same style I like to write in. So when I saw we were starting to share this I wanted to support what I thought was great work and writing.

But it was really unfair not to put a disclaimer on that I do work here.

Honestly, really sorry.

Also I owe Michel an apology because I dont think he realized either.

Re: Show HN: Chat with your data using LangChain, Pinecone, and Airbyte

#33

Post by mtricot »

ramesh31 wrote: post #16

I don't know what datasets you guys are working with that have no issues being shared in plain text across three separate proprietary paid services, but this is a nonstarter for me.

When reading the tutorial, we are describing one stack to build a specific app. But the stack is made of building blocks that you can replace with others if you need to.

- Airbyte has two self-hosted options: OSS & Enterprise

- Langchain: OSS

- OpenAI: you can host an OSS model if you want to

- Pinecone: there are OSS/self-hosted alternatives

Re: Show HN: Chat with your data using LangChain, Pinecone, and Airbyte

#34

Post by bnchrch »

bnchrch wrote: post #2

Always so happy to see a tutorial with actual substance. So much on LLMs lately is mostly blog spam for SEO but this actually is information dense and practical. Definitely bookmarking this for tonight. Also really happy to see a bonus section on pulling in data from third party websites. I think this is where LLMs get really interesting. Not only is data much easier to query with these new models, its also orders of…

A late but still very applicable disclaimer: I do work here!

My original comment had the intent of my own personal opinion as someone who reads/writes tutorials as fun.

But I owe an apology to the readers because I did not add any disclosure, and honestly I shouldve

Re: Show HN: Chat with your data using LangChain, Pinecone, and Airbyte

#35

Post by bnchrch »

kaveet wrote: post #23
BoorishBears wrote: post #21

Earlier quoted context omitted.

It's a little weird writing a comment worded like this if you work at Airbyte isn't it?

That's disappointing to see, and posted within 10 minutes no less.

Hey Kaveet, I dont know who have all seen the original post but I know you have so I wanted to say I'm sorry. This was my fault. I wanted to support good work as a member of the engineering community but I shouldve added a disclaimer about employment.

Re: Show HN: Chat with your data using LangChain, Pinecone, and Airbyte

#36

Post by johndhi »

mtricot wrote: post #8
johndhi wrote: post #6

How large of a dataset can I submit? I have hundreds of thousands of words of text.

Shouldn't have any limits here. Can you let us know how it goes?

hmm, as a person of low technical savvy, do you expect there will be a point at which I can upload a large text file and have you do all the work to let me chat with it? I'd pay for that today if it exists, but can't put a ton of effort into building/implementing something myself.

Re: Show HN: Chat with your data using LangChain, Pinecone, and Airbyte

#38

Post by mtricot »

everythingmeta wrote: post #37

nice to see a tutorial that recognizes the case where the underlying data can change and the embedding needs to be updated. Any plans to write a tutorial for fine-tuning local models?

Not at the moment but let me bring that to the team so we can brainstorm what it could look like.

Re: Show HN: Chat with your data using LangChain, Pinecone, and Airbyte

#40

Post by rahimnathwani »

_pdp_ wrote: post #17

A fantastic starting point for beginners! Personally, I believe this tutorial provides a solid foundation, but there's so much more to explore. Building something truly effective involves tackling various nuanced situations and special cases. While querying records in Pinecone can sometimes give you the right results, it can also be a bit unpredictable, depending on what and how you query. You might want to check out…

I'm curious: did you have ChatGPT lightly edit this comment before posting? A few things about the style (like the final sentence) sound similar to GPT-4 output.
Post reply on HN