Hey HN, I’m Etai, together with Andrew a co-founder of Secoda ( https://www.secoda.co ). Secoda is a collaborative workspace for data teams that makes it easy to share metadata, queries, charts and documentation with any employee. Companies store a growing amount of knowledge in BI tools, data warehouses, data pipelines, queries and documentation. Because these tools are not connected, it has become more difficult to…
You mention data lineage on your pricing page, but do you have any examples of what that looks like? Can you support custom lineages driven by an api?
We extract lineage in a couple of different ways. The main way is by parsing SQL queries in your data warehouse to determine which tables and dashboards are upstream/downstream. The other way we extract lineage information provided directly from dbt and BigQuery who have nice APIs for this information.
We are working releasing an API in Q4 that supports pushing information from say an Airflow DAG to Secoda to give us more lineage context. Hopefully this answers your questions.