Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Launch HN: Elementary (YC W22) – Open-source data observability

news.ycombinator.com

Post reply on HN
Print view View original

11–20 of 41 posts

Re: Launch HN: Elementary (YC W22) – Open-source data observability

#12

Post by Maayansa »

llambda wrote: post #11

I'm disappointed to see there isn't Redshift support. What's on the roadmap to address that?

Hi, it's defiantly in our plans for the next few weeks. As I mentioned in the post we leverage dbt for the whole data monitoring layer. We wrote the package with all the cross-db best practices, but didn't test it on Redshift so there are probably some gaps. There are a few users on our community on Slack that are Redshift users and they will help us to test on production with real data. Hopefully it will not require much to make it run smoothly.

Re: Launch HN: Elementary (YC W22) – Open-source data observability

#13

Post by mateuszklimek »

Hey Maayan and Or, Nice project, at re_data we just got over a lot of your new updates and it seems a quite large part of your project is "inspired" by code from our library https://github.com/re-data/re-data. Even with parts, we are not especially proud of ;)

If you decide to copy not only ideas but a big part of internal implementation, I think you should include that information in your LICENSE.

Cheers

Re: Launch HN: Elementary (YC W22) – Open-source data observability

#15

Post by Maayansa »

mateuszklimek wrote: post #13

Hey Maayan and Or, Nice project, at re_data we just got over a lot of your new updates and it seems a quite large part of your project is "inspired" by code from our library https://github.com/re-data/re-data . Even with parts, we are not especially proud of ;) If you decide to copy not only ideas but a big part of internal implementation, I think you should include that information in your LICENSE. Cheers

No post body was provided.

Re: Launch HN: Elementary (YC W22) – Open-source data observability

#16

Post by Maayansa »

theboat wrote: post #14

For any dbt users, their reliability package has the best and most comprehensive way to upload artifacts directly to the warehouse after a dbt invocation. https://github.com/elementary-data/dbt-data-reliability

Thank you! We believe that this upload is super valuable and could unlock a lot of additional use cases. We are already working on some of these and will release in the next few weeks.

Re: Launch HN: Elementary (YC W22) – Open-source data observability

#18

Post by windsquirrel »

mateuszklimek wrote: post #13

Hey Maayan and Or, Nice project, at re_data we just got over a lot of your new updates and it seems a quite large part of your project is "inspired" by code from our library https://github.com/re-data/re-data . Even with parts, we are not especially proud of ;) If you decide to copy not only ideas but a big part of internal implementation, I think you should include that information in your LICENSE. Cheers

Is the idea here that it's inspired by re_data due to using dbt transformations underneath or because it's reposted looking nearly the same? (or both?)

Looks like much of the lineage code is also largely a wrapper around this library: https://github.com/reata/sqllineage

Would be curious to understand the project's purpose and unique contributions vs. the underlying dependencies powering it as there seems to be some ambiguity. Is this just a wrapper around dbt transformations and a lineage library in one package? Can I just use them directly?

Post reply on HN