LangChain supports local LLMs like Llama 2 with Ollama ( https://github.com/jmorganca/ollama ) as of this morning, in both their Python and Javascript versions: https://python.langchain.com/docs/integrations/llms/ollama This can be a great option if you'd like to keep your data local versus submitting it to a cloud LLM, with the added benefit of saving costs if you're submitting many questions in a row (e.g. in batch…
Show HN: Chat with your data using LangChain, Pinecone, and Airbyte
41–50 of 61 posts
Re: Show HN: Chat with your data using LangChain, Pinecone, and Airbyte
#42How are you thinking about preventing customer PII making it to OpenAI?
Re: Show HN: Chat with your data using LangChain, Pinecone, and Airbyte
#43A fantastic starting point for beginners! Personally, I believe this tutorial provides a solid foundation, but there's so much more to explore. Building something truly effective involves tackling various nuanced situations and special cases. While querying records in Pinecone can sometimes give you the right results, it can also be a bit unpredictable, depending on what and how you query. You might want to check out…
I'm curious: did you have ChatGPT lightly edit this comment before posting? A few things about the style (like the final sentence) sound similar to GPT-4 output.
Re: Show HN: Chat with your data using LangChain, Pinecone, and Airbyte
#44Re: Show HN: Chat with your data using LangChain, Pinecone, and Airbyte
#45Always so happy to see a tutorial with actual substance. So much on LLMs lately is mostly blog spam for SEO but this actually is information dense and practical. Definitely bookmarking this for tonight. Also really happy to see a bonus section on pulling in data from third party websites. I think this is where LLMs get really interesting. Not only is data much easier to query with these new models, its also orders of…
Re: Show HN: Chat with your data using LangChain, Pinecone, and Airbyte
#46So I guess after all those discussions we are still stuck with LangChain for everything to do with LLMs.
Re: Show HN: Chat with your data using LangChain, Pinecone, and Airbyte
#47So I guess after all those discussions we are still stuck with LangChain for everything to do with LLMs.
I spend all day talking to people shipping AI products and approximately zero of them actually use LangChain. LangChain doesn't make sense for a ton of reasons, but the top few are the code quality being horrid, the scope being ill defined, and the fact that most of the tasks it does are better done with a prompt that was designed for your exact use case.
Your criticism doesn't line up with anything in my experience. Nearly all of the prompts you use are your own, and you can customize any of the prompts used under the hood for chains like routing.
Re: Show HN: Chat with your data using LangChain, Pinecone, and Airbyte
#48Always so happy to see a tutorial with actual substance. So much on LLMs lately is mostly blog spam for SEO but this actually is information dense and practical. Definitely bookmarking this for tonight. Also really happy to see a bonus section on pulling in data from third party websites. I think this is where LLMs get really interesting. Not only is data much easier to query with these new models, its also orders of…
You're right, LLMs are really good at extracting and structuring data from third party sources. I've been working on a "Zapier for data extraction" for this reason: https://kadoa.com
In any case, just signed up for the waitlist. Would love to get bumped up if possible!
Re: Show HN: Chat with your data using LangChain, Pinecone, and Airbyte
#49Re: Show HN: Chat with your data using LangChain, Pinecone, and Airbyte
#50Earlier quoted context omitted.
I'm curious: did you have ChatGPT lightly edit this comment before posting? A few things about the style (like the final sentence) sound similar to GPT-4 output.
Not the person you’re asking but yeah…that looks likes ChatGPT