Live data from Hacker News

Introducing Agents in Haystack: Make LLMs resolve complex tasks

haystack.deepset.ai

11–20 of 106 posts

Re: Introducing Agents in Haystack: Make LLMs resolve complex tasks

#11
post #10

I haven't yet figured out how to get an LLM to accurately determine whether it actually knows something or is making it up. I wonder how they handle that. They may get to that at some point in the article, but the page eventually breaks for me on mobile and I can't read past the first code block.

i agree. LLMs are not built for structured reasoning or even citations.

Re: Introducing Agents in Haystack: Make LLMs resolve complex tasks

#12
post #7

From the Github project readme >Agent: (since 1.15) An Agent is a component that is powered by an LLM, such as GPT-3. It can decide on the next best course of action so as to get to the result of a query. It uses the Tools available to it to achieve this. While a pipeline has a clear start and end, an Agent is able to decide whether the query has resolved or not. It may also make use of a Pipeline as a Tool. Emphasis…

I've been tinkering with LangChain for a few days and I agree. Is there a resource that collects the agents so we can experiment? I'd love to see an aggregated list of the most impressive agents and use cases if anyone knows of any. This stuff is the future of computing no doubt.

Re: Introducing Agents in Haystack: Make LLMs resolve complex tasks

#13
Are there any projects similar to this that use other languages? I don't have anything against Python. But I would prefer using Go if there are alternatives. I experimented with LangChain and this appears to be a similar idea but they are all based on iPython notebooks and that ecosystem.

Re: Introducing Agents in Haystack: Make LLMs resolve complex tasks

#14
post #13

Are there any projects similar to this that use other languages? I don't have anything against Python. But I would prefer using Go if there are alternatives. I experimented with LangChain and this appears to be a similar idea but they are all based on iPython notebooks and that ecosystem.

Python seems the go-to language for most ML work. Are there any wrappers you could use to call these frameworks from within Golang?

Re: Introducing Agents in Haystack: Make LLMs resolve complex tasks

#15
post #3

Could someone in the know compare this with LangChain ( https://github.com/hwchase17/langchain )?

I would consider Haystack to be the more batteries-included, easier to use (but harder to customize) of the two. They have a good emphasis on local model use.

Re: Introducing Agents in Haystack: Make LLMs resolve complex tasks

#16
post #10

I haven't yet figured out how to get an LLM to accurately determine whether it actually knows something or is making it up. I wonder how they handle that. They may get to that at some point in the article, but the page eventually breaks for me on mobile and I can't read past the first code block.

i agree. LLMs are not built for structured reasoning or even citations.

Gpt-4 does a reasonable job citing things. It can’t cite every paper out there but definitely the well cited ones.

Re: Introducing Agents in Haystack: Make LLMs resolve complex tasks

#17
post #14
post #13

Are there any projects similar to this that use other languages? I don't have anything against Python. But I would prefer using Go if there are alternatives. I experimented with LangChain and this appears to be a similar idea but they are all based on iPython notebooks and that ecosystem.

Python seems the go-to language for most ML work. Are there any wrappers you could use to call these frameworks from within Golang?

That's the heartbreak in ml dev, an entire company of golang code, no way to avoid tossing in a pile of python I don't want to look at.

Re: Introducing Agents in Haystack: Make LLMs resolve complex tasks

#18

Earlier quoted context omitted.

i agree. LLMs are not built for structured reasoning or even citations.

Gpt-4 does a reasonable job citing things. It can’t cite every paper out there but definitely the well cited ones.

Does it cite papers that don't exist, or cite papers when the paper it cites doesn't actually contain the information being cited?

I would bet it does, at least some percent of the time.

Re: Introducing Agents in Haystack: Make LLMs resolve complex tasks

#19
post #10

I haven't yet figured out how to get an LLM to accurately determine whether it actually knows something or is making it up. I wonder how they handle that. They may get to that at some point in the article, but the page eventually breaks for me on mobile and I can't read past the first code block.

I have the same exact problem with people. Being inaccurate is a feature, not a bug.

Re: Introducing Agents in Haystack: Make LLMs resolve complex tasks

#20
Doesn't this remind anyone else of Bitcoin autonomous agents? https://en.bitcoin.it/wiki/Agent#:~:text=An%20agent%20is%20a....

It would be interesting if you could somehow combine a wallet plugin to give the GPT something to work to increase. That + that AutoGPT repo from a day ago + maybe Mitogen for self-replication might be a cool combo to really kick off a fun "dumb" AI on the loose

Post reply on HN