Live data from Hacker News

Show HN: Ratel, give agents unlimited tools and skills without context bloat

github.com

1–10 of 26 posts

Show HN: Ratel, give agents unlimited tools and skills without context bloat

#1
Hi HN! We're Giacomo and Roberto, authors of Ratel (https://github.com/ratel-ai/ratel)

We used to help SaaS companies build agents on top of their products. Whenever we wanted to expand the agents’ complexity/scope, by adding more and more tools and instructions, we always run in the same issue: context bloat, with frequent hallucinations and sky high token bills. So we started constantly engineering the agents, dynamically loading tools, splitting them into subagents, inventing our own way to support skills

And that's exactly when we started building Ratel: a library to let your agent keep its full catalog of tools and skills, but progressively disclosing only the few that actually matter for each turn. Now you can grow your agent's capabilities without breaking it or taking out a loan for it

People are already using it in production, with a user cutting their token cost up to 81% in the first month without compromising the accuracy

We support both keyword and semantic retrieval, all in-process and without any additional infra. Open source, framework-agnostic, exposes OpenTelemetry metrics, available for Typescript and Python

Benchmarks: https://benchmark.ratel.sh

Some cool things we did with this:

• One team's agent had up to 300+ tools dynamically loaded into context. Ratel cut their token cost 81% in month one. • Another team split into several subagents instead, one agent per task. It worked, until the swarm got slow and expensive. We fixed this with our skills.

We're both here all day. Tear it apart, especially if you're an AI or SWE running agents in production

Show HN: Ratel, give agents unlimited tools and skills without context bloat
github.com

Re: Show HN: Ratel, give agents unlimited tools and skills without context bloat

#5
post #2
post #20

[stub for offtopicness]

man this could save me so much money lol

Would love to hear your feedback if you can try it. We initially rolled out BM25 for tool search as it worked best for us internally. Recently rolled out also embeddings and an hybrid option that is being tested in production as we speak

Re: Show HN: Ratel, give agents unlimited tools and skills without context bloat

#8

Earlier quoted context omitted.

This looks so nice!

I see you built the core in Rust with bindings to TS/Python. y?

Yes! I should have mentioned in the original post. It was actually built in Typescript at first, but then the performance were not good enough for production use cases. With Rust the footprint was way lower, and we managed tear the latency down from 200ms to 20ms for a single search

Re: Show HN: Ratel, give agents unlimited tools and skills without context bloat

#9
post #20

[stub for offtopicness]

This is neat! It tackles a boring but real problem with agents. When you have too many tools, the model gets confused. This is a good search box for its tools instead of dumping everything into the prompt. Benchmarks is amazing!

Re: Show HN: Ratel, give agents unlimited tools and skills without context bloat

#10
post #9
post #20

[stub for offtopicness]

This is neat! It tackles a boring but real problem with agents. When you have too many tools, the model gets confused. This is a good search box for its tools instead of dumping everything into the prompt. Benchmarks is amazing!

Thank you! Let us know how it works if you try it out :) of course real world is another story, but we agree benchmarks are amazing indeed!
Post reply on HN