Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Chat with your data using LangChain, Pinecone, and Airbyte

airbyte.com

Post reply on HN
Print view View original

11–20 of 61 posts

Re: Show HN: Chat with your data using LangChain, Pinecone, and Airbyte

#11

Post by rschwabco »

swyx wrote: post #5

congrats team! what was the thinking behind choosing to support "Vector Database (powered by LangChain)" instead of directly supporting Pinecone Chroma et al directly as you do in the other destinations? when is direct integration the right approach vs when is it better to have an (possibly brittle, but faster time to market) integration of an integration?

A version supporting Pinecone directly is coming soon!

Re: Show HN: Chat with your data using LangChain, Pinecone, and Airbyte

#12

Post by hnhg »

jmorgan wrote: post #4

LangChain supports local LLMs like Llama 2 with Ollama ( https://github.com/jmorganca/ollama ) as of this morning, in both their Python and Javascript versions: https://python.langchain.com/docs/integrations/llms/ollama This can be a great option if you'd like to keep your data local versus submitting it to a cloud LLM, with the added benefit of saving costs if you're submitting many questions in a row (e.g. in batch…

Thanks. How would this differ from running Llama2 through the Huggingface-Langchain integration? I haven't tried it but it looked like the way to go until you shared this.

Re: Show HN: Chat with your data using LangChain, Pinecone, and Airbyte

#14

Post by zwaps »

hnhg wrote: post #12
jmorgan wrote: post #4

LangChain supports local LLMs like Llama 2 with Ollama ( https://github.com/jmorganca/ollama ) as of this morning, in both their Python and Javascript versions: https://python.langchain.com/docs/integrations/llms/ollama This can be a great option if you'd like to keep your data local versus submitting it to a cloud LLM, with the added benefit of saving costs if you're submitting many questions in a row (e.g. in batch…

Thanks. How would this differ from running Llama2 through the Huggingface-Langchain integration? I haven't tried it but it looked like the way to go until you shared this.

This one is for Mac

Re: Show HN: Chat with your data using LangChain, Pinecone, and Airbyte

#17

Post by _pdp_ »

A fantastic starting point for beginners! Personally, I believe this tutorial provides a solid foundation, but there's so much more to explore. Building something truly effective involves tackling various nuanced situations and special cases. While querying records in Pinecone can sometimes give you the right results, it can also be a bit unpredictable, depending on what and how you query. You might want to check out options like Weaviate, or even delve into the world of sparse indexes for an added layer of complexity. The models themselves have their own quirks too. For example, GPT3.5 Turbo tends to respond well when given clear instructions at the beginning of the context, while GPT4, although more flexible, still comes with its own set of challenges. Despite this, I'm genuinely excited about the push to highlight the potential of LLM applications (more of that, please!). Just remember, while tutorials like this are a great step, achieving seamless results might require some hands-on experience and learning along the way.
Post reply on HN