A bit off topic, but has anyone seen any agent systems focused on improving the agents capabilities with more usage?
Multi AI agent systems using OpenAI's assistants API
51–60 of 87 posts
Re: Multi AI agent systems using OpenAI's assistants API
#52My main conversation “loop” at https://olympia.chat has tool functions connected to “helper AIs” for things such as integrating with email. It lets me minimize functions on the main loop and actually works really well.
I'm sorry but that is absolutely hilarious.
Re: Multi AI agent systems using OpenAI's assistants API
#53My main conversation “loop” at https://olympia.chat has tool functions connected to “helper AIs” for things such as integrating with email. It lets me minimize functions on the main loop and actually works really well.
Sid Kapoor, Content Specialist, forgot to include himself in Growth or Pro plans. Guess he is Basic!
Re: Multi AI agent systems using OpenAI's assistants API
#54Assistants API is promising, but earlier versions have many issues, especially with how it calculates the costs. As per OpenAI docs, you pay for data storage, a fixed price per API call, + token usage. It sounds straightforward until you start using it. Here is how it works. When you upload attachments, in my case a very large PDF, it chunks that PDF into small parts and stores them in a vector database. It seems lik…
There isn’t really any other way for this to work. The only way for the model to answer questions on your pdf is for the information to be somewhere in the prompt.
Re: Multi AI agent systems using OpenAI's assistants API
#55I'd be interested in knowing if anyone is seriously using the assistants API, it feels like such a lock in to OpenAIs platform when your can alternatively just use completions that are much more easily interchanged.
I've used it and in some cases it's taking days and weeks of development away to get to testing the market.
In some cases the lock in is what it is for now because a particular model in reality is so far ahead, or staying ahead.
It doesn't mean other options won't become available, but it does matter to relate your need to your actions.
Getting something working consistently for example might be the first goal, and then learning to implement it with multiple models might be secondary. The chances of that increase the later other models are explored in some cases.
It should be possible to tell pretty quickly if something works in a particular model that's the leader, how others compare to it and how to track the rate of change between them.
Re: Multi AI agent systems using OpenAI's assistants API
#56What's the use cases people are using Multi AI Agents to solve problems that deliver real value? Someone has something with your hands on right now?
We’ve tried. A lot. Custom frameworks and all.
There is really no way to make the ensemble behave with an acceptable level of consistency.
Where we ended up is now having a frontier model generate a whole tree of possible execution plans, and then have the user select one of those path, and then we just run whatever the user chose in a plain sequence until the next decision point that needs user approval.
Re: Multi AI agent systems using OpenAI's assistants API
#57Assistants API is promising, but earlier versions have many issues, especially with how it calculates the costs. As per OpenAI docs, you pay for data storage, a fixed price per API call, + token usage. It sounds straightforward until you start using it. Here is how it works. When you upload attachments, in my case a very large PDF, it chunks that PDF into small parts and stores them in a vector database. It seems lik…
How large is a very large PDF?
Re: Multi AI agent systems using OpenAI's assistants API
#58What's the use cases people are using Multi AI Agents to solve problems that deliver real value? Someone has something with your hands on right now?
I've encountered two viable cases: instructions are too complex, too many tools, or wildly different processing steps, in which case it semplify a lot the processing to have a few well defined steps each doing their thing, and a coordinator on top, either sequential, or intelligent, that is only focuesed on next step routing.
the other is memory for conversational retrieval. ai memory is still quite limited, especially if there needs to be a lot of token in context, and context too long impede the ability of llm of focus on the task itself, especially if the context is itself a conversation or a request, so spreading the context along a few agents, and propagating the user request among agent, and having those produce answer fragment for another llm to formulate an answer allows to not lose the conversational context without swamping the llm with noise.
the problem tho remains latency as son as you nest them latency explodes as you can only stream the last layer of llm output
Re: Multi AI agent systems using OpenAI's assistants API
#59I stay away from such frameworks because: - Writing what I want in Python/other-lingo gives me much more customizability than these frameworks offer. - No worries about the future plans of the repo and having to deal with abandonware. - No vendor lock in. Currently most repos like this focus on OpenAI's models, but I prefer to work with local models of all kinds and any abstraction above llama.cpp or llama-cpp-python…
Not using the ollama API means you have to keep track of context yourself, and run all your stuff in the same box. Hardly ideal.
Re: Multi AI agent systems using OpenAI's assistants API
#60Anyone recommend the best way to use AI to search all of my documents for a project. I've got specifications, blueprints, emails, forms, etc. Would be great to be able to ask it, 'have we completed the X process with contractor Y yet?'
Zenfetch