Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Launch HN: Airbyte (YC W20) – Open-Source ELT (Fivetran/Stitch Alternative)

news.ycombinator.com

Post reply on HN
Print view View original

61–70 of 90 posts

Re: Launch HN: Airbyte (YC W20) – Open-Source ELT (Fivetran/Stitch Alternative)

#61

Post by [deleted] »

renewiltord wrote: post #30
georgewfraser wrote: post #8

The fundamental challenge of open-source ETL is that high-quality connectors require understanding and working around all kinds of corner cases in the API of each data source. It’s very hard to get open source contributors to do this kind of work; it’s a real slog. Hence at Fivetran we’ve always stuck with the commercial route.

Personally, the most infuriating thing about a tool is where I can fix the damn thing given the source code but I have to go through the support staff to the engineering team and then wait for "this is on our roadmap but not something we're currently prioritizing". Right, I know. I don't expect other people to do work for me. I just need them to let me do the work myself. The massive advantage of the OSS route isn't…

[deleted]

Re: Launch HN: Airbyte (YC W20) – Open-Source ELT (Fivetran/Stitch Alternative)

#62

Post by kiwicopple »

yclurker wrote: post #32

The Open Source Fivetran alternative. Yay, it was about time! A simple license : MIT. Clear differentiation between free & paid plans. I am liking what I am seeing so far. One of our client is in advertising industry and is syncing data from 20 different API vendors to postgres. So I am one of your potential customer. However, there is a big problem I'm noticing with "Open source alternatives" lately on HN. I had to…

hey yclurker, Supabase founder here.

I'm sorry we haven't delivered a better self-hosting experience. This is clearly something we could do better. As I mentioned in your link[1], we're targeting a release of our CLI in Q1 (last week of march).

> its a been long time since their launch

It has been 8 months since our alpha launch*, and just over 1 month since our beta. I hope that sets some context, because personally I think we (and the community) have delivered a lot in that time. I'm very proud of what our small team has been able deliver.

> The product is not self hostable

Note that Supabase is self-hostable, it's just lacking documentation, which we will rectify in Q1.

[*alpha]: https://news.ycombinator.com/item?id=23319901\*

Re: Launch HN: Airbyte (YC W20) – Open-Source ELT (Fivetran/Stitch Alternative)

#64

Post by christopheduong »

zkid18 wrote: post #63

Looks promising. Any plans for support Amplitude API?

Yes, we'll definitely be looking at having a source-amplitude in the future, the issue is already here:

https://github.com/airbytehq/airbyte/issues/1457

Re: Launch HN: Airbyte (YC W20) – Open-Source ELT (Fivetran/Stitch Alternative)

#66

Post by davidkell »

georgewfraser wrote: post #8

The fundamental challenge of open-source ETL is that high-quality connectors require understanding and working around all kinds of corner cases in the API of each data source. It’s very hard to get open source contributors to do this kind of work; it’s a real slog. Hence at Fivetran we’ve always stuck with the commercial route.

Fivetran has built all the custom OAuth flows for their 150 custom integrations and you can build it into your own (internal or external) applications, it is neat. @goergewfraser When do you plan to add the ability to configure connectors that need extra config after the initial connection, e.g. choosing reports from Google Analytics?

Re: Launch HN: Airbyte (YC W20) – Open-Source ELT (Fivetran/Stitch Alternative)

#68

Post by la6471 »

yclurker wrote: post #36
mtricot wrote: post #35

Earlier quoted context omitted.

Sorry that it doesn't work :( Murphy law on launch day I would say... Right now all our users self-host and the whole project is meant to be self-hosted for data privacy and security reasons. Do you want to join our slack ( https://slack.airbyte.io )? We can help you on the resolution!

Traceback (most recent call last): File "site-packages/urllib3/connectionpool.py", line 677, in urlopen File "site-packages/urllib3/connectionpool.py", line 392, in _make_request File "http/client.py", line 1252, in request File "http/client.py", line 1298, in _send_request File "http/client.py", line 1247, in endheaders File "http/client.py", line 1026, in _send_output File "http/client.py", line 966, in send File "…

Isn’t there a GitHub issue submission page?

Re: Launch HN: Airbyte (YC W20) – Open-Source ELT (Fivetran/Stitch Alternative)

#69

Post by jeanlaf »

davidkell wrote: post #65

Do you plan to support one-click integrations? (= Stitch Connect JS [0] / Fivetran "Connect Card" [1]) [0] https://www.stitchdata.com/docs/developers/stitch-connect/ja... [1] https://fivetran.com/docs/rest-api/connectors/connect-card

Yes, indeed, we do. This should come within the next 3 months. Here's the issue if you want to keep track of our progress on the matter: https://github.com/airbytehq/airbyte/issues/768

Re: Launch HN: Airbyte (YC W20) – Open-Source ELT (Fivetran/Stitch Alternative)

#70

Post by scottydelta »

It looks very promising and is something I wish to scale Quantale(https://quantale.io/) to, It's a project I am working on, which has very similar logic of adding data sources and make it available for data visualization. Congrats on your launch!
Post reply on HN