Live data from Hacker News

Show HN: Open-source infra for building embedded data pipelines

github.com

11–20 of 21 posts

Re: Show HN: Open-source infra for building embedded data pipelines

#11
post #10

Nice work! We're really proud of how the warehouse sync feature we built at Customer.io turned out. We had to do it all from scratch though! Good luck with the next steps for Pipebird.

Thanks! People really seem to love your warehouse sync feature. We hope to help other companies offer similar products to their customers.

Re: Show HN: Open-source infra for building embedded data pipelines

#13
post #12

Hey team, Charles here, co-founder of prequel.co (YC W21). We also help companies share data with their customers. As someone who's been playing in the data sharing space, it's really exciting to see it get more attention! All the best to y'all!

Hey Charles, we're really excited to be working on tooling to make data sharing easier for companies and their customers!

The activation energy for setting up robust direct-to-customer pipelines is still too high on the provider’s end - it’s great to see this approach getting more investment recently.

All the best to Prequel as well!

Re: Show HN: Open-source infra for building embedded data pipelines

#17

besides creating more value for our b2b customer, can this help our own company in anyway.

Your company could offer this as a paid product to your customers. As an example, Stripe Data Pipelines https://stripe.com/data-pipeline is a paid product - customers are willing to pay them instead of a third-party.

We see this as a way for companies to strengthen relationships with their customers and grow revenue.

Re: Show HN: Open-source infra for building embedded data pipelines

#18

Hey, interesting work. I wonder how do you compare pipebird with data tools like Airbyte?

Thanks. Airbyte is a great third-party tool for creating custom ELT pipelines and accessing popular connectors. Our focus at Pipebird is different - we help companies work directly with their customers to share data.

To illustrate the difference, imagine ACME Inc. wants to pull its customer data from HubSpot. With Airbyte, they can use a pre-built connector that accesses data made available via the HubSpot API.

Now let's say HubSpot uses Pipebird to build native data sharing features for its customers. ACME Inc. can now deploy a secure data pipeline directly from HubSpot without involving any third-party. Since HubSpot is offering the pipelines, it can choose to expose more data than is made available via its API (Stripe has done this with their data pipeline product https://stripe.com/data-pipeline) and ACME Inc. doesn't need to worry about the pipeline breaking because it's coming directly from the source.

Re: Show HN: Open-source infra for building embedded data pipelines

#19
post #18

Hey, interesting work. I wonder how do you compare pipebird with data tools like Airbyte?

Thanks. Airbyte is a great third-party tool for creating custom ELT pipelines and accessing popular connectors. Our focus at Pipebird is different - we help companies work directly with their customers to share data. To illustrate the difference, imagine ACME Inc. wants to pull its customer data from HubSpot. With Airbyte, they can use a pre-built connector that accesses data made available via the HubSpot API. Now l…

Thanks for the explanation. Does it mean HubSpot as the data source itself will have to maintain these native data pipelines?

Re: Show HN: Open-source infra for building embedded data pipelines

#20
post #18

Earlier quoted context omitted.

Thanks. Airbyte is a great third-party tool for creating custom ELT pipelines and accessing popular connectors. Our focus at Pipebird is different - we help companies work directly with their customers to share data. To illustrate the difference, imagine ACME Inc. wants to pull its customer data from HubSpot. With Airbyte, they can use a pre-built connector that accesses data made available via the HubSpot API. Now l…

Thanks for the explanation. Does it mean HubSpot as the data source itself will have to maintain these native data pipelines?

Pipebird handles all of the actual plumbing (extraction, transfer scheduling, retries, setting up data sharing, etc).

The only thing HubSpot would have to do is set up their source and add a destination through our API.

Post reply on HN