Show HN: Airbyte Agents – context for agents across multiple data sources
11–20 of 63 posts
Re: Show HN: Airbyte Agents – context for agents across multiple data sources
#12Re: Show HN: Airbyte Agents – context for agents across multiple data sources
#13Earlier quoted context omitted.
AJ here, from Airbyte. Yes, we've definitely found that some API data models are easier for models to navigate than others. The largest factors of Agent inefficiency we've identified so far are: 1. Many APIs lack robust-enough search, forcing agents to page through hundreds or thousands of paginated responses until they find the record they are looking for (our Context Store addresses this). 2. Many APIs have HUGE re…
Your point about search being a bottleneck is spot on. IMO, search APIs should return guidance to agents to help them winnow down the results faster. For example, if your query returns 1000 results, then it should tell the agent, "too many results, we recommend you filter on column X because of Y to improve your search. Here are the possible values in column X: ..."
Re: Show HN: Airbyte Agents – context for agents across multiple data sources
#14(We use airbyte at my company, although we self-host it.)
Re: Show HN: Airbyte Agents – context for agents across multiple data sources
#15Re: Show HN: Airbyte Agents – context for agents across multiple data sources
#16Re: Show HN: Airbyte Agents – context for agents across multiple data sources
#17If I'm reading correctly, the indexing (Context Store) is neutral/unopinionated? How does it select fields for indexing?
Have you done any testing on guided indexing, or metadata layers on top of the data? My experience so far on similar work is that getting data in front of an agent isn't enough context to get useful/reliable answers enough of the time. I.e. _what_ you index, and how you signpost for agents, becomes really important (unless your data is super clean I guess). This does look like a good foundation for that kind of tooling though!
Re: Show HN: Airbyte Agents – context for agents across multiple data sources
#18Re: Show HN: Airbyte Agents – context for agents across multiple data sources
#19It’s not why we started using posthog but it definitely sealed the deal when you see how simple and reliable that experience is