This is by far the most practical piece of writing I've seen on the subject of "agents" - it includes actionable definitions, then splits most of the value out into "workflows" and describes those in depth with example applications. There's also a cookbook with useful code examples: https://github.com/anthropics/anthropic-cookbook/tree/main/p... Blogged about this here: https://simonwillison.net/2024/Dec/20/building-…
Thanks for all the write-ups on LLMs, you're on top of the news and it makes it way easier to follow what's happening and the existing implementations by following your blog instead.
Building Effective "Agents"
91–100 of 130 posts
Re: Building Effective "Agents"
#92Earlier quoted context omitted.
That logic doesn't work for me, because many words have multiple meanings. "Agency" can also be a noun that means an organization that you hire - like a design agency. Or it can mean the CIA. I'm not saying it's not a valid definition of the term, I'm pushing back on the idea that it's THE single correct definition of the term.
May I push back on the idea that a single word may mean (completely) different things?
Re: Building Effective "Agents"
#93Earlier quoted context omitted.
> The first agent decides whether the new email should be responded to, yes or no. How would you trust that the agent is following the criteria, and how sure that the criteria is specific enough. Like someone you just meet told you they going to send you something via email, but then the agent misinterpret it due to missing context and decided to respond in a generic manner leading to misunderstanding. > assume every…
> How would you trust that the agent is following the criteria, and how sure that the criteria is specific enough? How do you know if a spam filter heuristic works only when intended? You test it. Hard. On the thousands of emails in your archive, on edge-cases you prepare manually, and on the incoming mails. If it doesn't work for some cases, write tests that test for this, adjust prompt and run the test suite. It wo…
Re: Building Effective "Agents"
#94Earlier quoted context omitted.
The article does not mention the LangChain framework. LangGraph is a different framework, have you tried it?
Yes, our previous lead dev built a lot of our infra using LangGraph. I've been slowly ripping it out since assuming ownership of this part of the codebase. I've been replacing LangGraph with simple primitives, relying on native Python constructs, etc. For example, instead of building this verbose graph of computation with LangGraph, you can just...call functions in the order you want them. Or declare them async, add…
Re: Building Effective "Agents"
#95Re: Building Effective "Agents"
#96Earlier quoted context omitted.
That logic doesn't work for me, because many words have multiple meanings. "Agency" can also be a noun that means an organization that you hire - like a design agency. Or it can mean the CIA. I'm not saying it's not a valid definition of the term, I'm pushing back on the idea that it's THE single correct definition of the term.
May I push back on the idea that a single word may mean (completely) different things?
Re: Building Effective "Agents"
#97Earlier quoted context omitted.
Defining "agent" as "thing with agency" seems legitimate to me, what with them being the same word.
That logic doesn't work for me, because many words have multiple meanings. "Agency" can also be a noun that means an organization that you hire - like a design agency. Or it can mean the CIA. I'm not saying it's not a valid definition of the term, I'm pushing back on the idea that it's THE single correct definition of the term.
Re: Building Effective "Agents"
#98Earlier quoted context omitted.
That logic doesn't work for me, because many words have multiple meanings. "Agency" can also be a noun that means an organization that you hire - like a design agency. Or it can mean the CIA. I'm not saying it's not a valid definition of the term, I'm pushing back on the idea that it's THE single correct definition of the term.
May I push back on the idea that a single word may mean (completely) different things?
Re: Building Effective "Agents"
#99Earlier quoted context omitted.
Yes, our previous lead dev built a lot of our infra using LangGraph. I've been slowly ripping it out since assuming ownership of this part of the codebase. I've been replacing LangGraph with simple primitives, relying on native Python constructs, etc. For example, instead of building this verbose graph of computation with LangGraph, you can just...call functions in the order you want them. Or declare them async, add…
So all you achieved from a spreadsheet's worth of PRs was a 1k LoC reduction?
Re: Building Effective "Agents"
#100Earlier quoted context omitted.
Thanks for all the write-ups on LLMs, you're on top of the news and it makes it way easier to follow what's happening and the existing implementations by following your blog instead.
Probably the least critical and most myth pushing content imo.
Care to elaborate?