Live data from Hacker News

Show HN: Airbyte Agents – context for agents across multiple data sources

news.ycombinator.com

11–20 of 63 posts

Re: Show HN: Airbyte Agents – context for agents across multiple data sources

#13
post #7

Earlier quoted context omitted.

AJ here, from Airbyte. Yes, we've definitely found that some API data models are easier for models to navigate than others. The largest factors of Agent inefficiency we've identified so far are: 1. Many APIs lack robust-enough search, forcing agents to page through hundreds or thousands of paginated responses until they find the record they are looking for (our Context Store addresses this). 2. Many APIs have HUGE re…

Your point about search being a bottleneck is spot on. IMO, search APIs should return guidance to agents to help them winnow down the results faster. For example, if your query returns 1000 results, then it should tell the agent, "too many results, we recommend you filter on column X because of Y to improve your search. Here are the possible values in column X: ..."

There are a lot of APIs like this that I really wish would expose downloading a parquet file instead of trying to implement server-side filtering and reporting query features.

Re: Show HN: Airbyte Agents – context for agents across multiple data sources

#14
This is such a great direction airbyte is taking and congrats to the lunch! I think you're very well-positioned for this opportunity than most people realize, given your reputable brand and your uncanny expertise in etl. It's honestly a natural progression of airbyte as far as the current AI landscape goes. Kudos to you and the team!

(We use airbyte at my company, although we self-host it.)

Re: Show HN: Airbyte Agents – context for agents across multiple data sources

#17
Looks interesting!

If I'm reading correctly, the indexing (Context Store) is neutral/unopinionated? How does it select fields for indexing?

Have you done any testing on guided indexing, or metadata layers on top of the data? My experience so far on similar work is that getting data in front of an agent isn't enough context to get useful/reliable answers enough of the time. I.e. _what_ you index, and how you signpost for agents, becomes really important (unless your data is super clean I guess). This does look like a good foundation for that kind of tooling though!

Re: Show HN: Airbyte Agents – context for agents across multiple data sources

#19
Your billing support email forwards to a google group which rejects the email entirely. So i embedded my question inside the websites sales enquiry form and received multiple rounds of emails that couldn’t be further from human.

It’s not why we started using posthog but it definitely sealed the deal when you see how simple and reliable that experience is

Post reply on HN