Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Retrieval in LangChain

blog.langchain.dev

Post reply on HN
Print view View original

51–60 of 71 posts

Re: Retrieval in LangChain

#51

Post by zikohh »

freezed88 wrote: post #37

Making retrieval really really good is part of the mission of LlamaIndex! Given a natural language input, find the best way to return a set of documents that is relevant to your LLM use case (question-answering, summarization, more complex queries too). - We integrate with vector db's + ChatGPT Retrieval Plugin - Submitted a Retrieval PR to langchain here: https://github.com/hwchase17/langchain/pull/2014 - would love…

I want to use llamaindex. My input would be a slack export but I don't want any data to go to openai I want it all to happen locally or within my own EC2 instance. I have seen https://github.com/jerryjliu/llama_index/blob/046183303da416... but it calls hugging face.

My plan was to use https://github.com/cocktailpeanut/dalai with the alpaca model then somehow use llamaindex to input my dataset - a slack export. But it's not too clear how to train the alpaca model.

Re: Retrieval in LangChain

#52

Post by refulgentis »

hellcow wrote: post #34
dragonwriter wrote: post #32

Earlier quoted context omitted.

If you are using GPT-4 to try to deal with the fact that technical documentation on the public internet is sparse for your topic of interest, you are likely to be disappointed, since GPT-4’s training set likely has the same problem, so you are, in effect, hoping it will fill in gaps in missing data, prompting hallucinations. It’ll be much better on subjects where there is too much information on the public internet f…

I think you're right. My hope was that it could reason through the problem using knowledge from related sources like C and an understanding below the syntax of what was actually happening. But it most certainly did not.

Depending on what you're doing, you might find few-shot techniques useful.

I used GPT 3.0 to maintain a code library in 4 languages, I'd write Dart (basically JS, so GPT knows it well), then give it a C++ equivalent of a function I had previously translated, and it could do any C++ from there.

Re: Retrieval in LangChain

#53

Post by justanotheratom »

vthallam wrote: post #14

Noob here. Is this similar to what ChatGPT Retrieval plugin does, but for other LLM's?

I would say LangChain is similar to ChatGPT itself.

- LangChain's Retriever is analogous to ChatGPT Retrieval Plugin. - In general, LangChain has tools for what ChatGPT calls Plugins. - ChatGPT uses OpenAI's GPT-4 LLM. LangChain uses ... any LLM (i.e. configurable).

Re: Retrieval in LangChain

#56

Post by ignoramous »

seu wrote: post #40
gamegoblin wrote: post #38

Earlier quoted context omitted.

1. GPT4 is learning from the same spartan docs as you, likely 2. GPT4's training data likely doesn't include significant Zig use, since large parts of its training data cut off a few years ago. I use Rust and it doesn't know about any recently added Rust features, either. This has interesting implications because it means people will gravitate towards languages/frameworks/libraries that GPT knows well, which means ev…

> This has interesting implications because it means people will gravitate towards languages/frameworks/libraries that GPT knows well, which means even less training data will be generated for the new stuff. This is a form of value lock-in. That's the kind of problem that most people are just failing to see. The usage of this models might not in itself be problematic, but the changes that it bring are often unexpecte…

It's inevitable, really. But that's like saying Washing Machine changed fashion. It might have, but the changes aren't all that abominable, either.

Re: Retrieval in LangChain

#58

Post by [deleted] »

pumanoir wrote: post #13
Spivak wrote: post #4

Really excited to see LangChain moving really fast in this space. They turn your favorite Llm into a real boy that can do real work. Some "agents" in their vernacular that I've built. * A reminder system that can take a completely free-form English description and turn it into a precise date and time and schedule it with an external scheduler. * A tool that can take math either in English or ascii like y = 2x^2 + ln(…

These examples are great, but the chess engine sounds specially interesting and can't think of how I'd do it with langchain. Do you have a git link or something written down, on how you accomplished this?

[deleted]

Re: Retrieval in LangChain

#59

Post by yadaeno »

In the back of my head im thinking about how you could make a stock portfolio analysis chatbot. I think you would want to vectorize a set of documents containing summarized historical + a few documents containing recent data. When asked to analyze a particular portfolio, the portfolio, along with the short term + long term vectors are passed into the LLM. Im not sure if this is the ideal approach though.

Re: Retrieval in LangChain

#60

Post by ryanwaggoner »

A little off-topic: are LLMs the death knell for new languages, frameworks, tools, processes, etc? I can see how an LLM is going to be such a huge productivity boost that they’ll be hard to avoid everywhere, but then new stuff won’t have any training data. Will anyone ever go through the effort of everything being 10x - 100x less effective with new tools since there’s no training data?
Post reply on HN