Congrats Kevin and Guru on the launch. Happy to see this on here, I was wondering when you’d do your Launch HN. These are real problems that a lot of data teams have and I’m glad to see this making it into the wild!
Launch HN: Metaplane (YC W20) – Datadog for Data
11–20 of 71 posts
Re: Launch HN: Metaplane (YC W20) – Datadog for Data
#12I’m building our companies first data platform right now (fivetran, dbt, snowflake), so I’ll definitely check this out!! 1) Do you have Metabase on your roadmap? Lightdash? 2) I see that you alert on schema changes, which is great. Can you monitor for schema changes of a Postgres database? Reason I ask: Fivetran (and others) will try to buffer some schema changes from you to prevent data loss (drop columns, rename co…
1) An integration with Metabase Cloud is on our roadmap for Q1! We'd love to integrate with Lightdash, but they don't have a public API just yet[1].
2) Several of our customers use us to alert on schema changes in Postgres, specifically so they can get ahead of application database changes that will end up in the warehouse, so you're definitely not alone! Here's a link on how to connect postgres: https://docs.metaplane.dev/docs/postgres
That's an excellent stack and one we kept front and center when building out Metaplane, so definitely let us know if you have any feedback or suggestions here!
Re: Launch HN: Metaplane (YC W20) – Datadog for Data
#13Looks amazing, and timing on bringing the solution is great. Any chance there will be on-prem version?
Re: Launch HN: Metaplane (YC W20) – Datadog for Data
#14Hi! Out of curiosity: Why post so early? It’s only 5:48 am on the US west coast.
While it's 5:48am on the US west coast, it's 13:48pm in the UK
Re: Launch HN: Metaplane (YC W20) – Datadog for Data
#15Congrats on the launch! The Metaplane team is great.
Re: Launch HN: Metaplane (YC W20) – Datadog for Data
#16Looks amazing, and timing on bringing the solution is great. Any chance there will be on-prem version?
Great question! While right now we are focused on our cloud native application, we do plan on supporting an on-prem version for companies that require hosting themselves.
The reason our customers haven’t required this is because we’ve tried to take security seriously from day one and Metaplane doesn’t store any customer data (just the metadata). We received our SOC2 Type II report, support IP whitelisting, SSH/Reverse SSH tunnels and are always exploring other integration options like AWS’ PrivateLink.
That said, we definitely understand the need to keep even metadata on-prem, so we plan on tackling that later next year.
Re: Launch HN: Metaplane (YC W20) – Datadog for Data
#17How do you compare yourselves to Monte Carlo Data?
The main difference is how we get into the hands of data teams. To use Monte Carlo you’ll need to book a demo with their sales team to see the product, go through an implementation process, and potentially pay as much for a data monitoring tool as you do for your database.
We want every data team to have have observability as soon as they have data in a warehouse, and that means: 1) letting you implement the tool within 10 minutes, without talking to us, 2) providing a free plan and paid plans that make sense for modern data teams, and 3) focusing on being as helpful as we can with as little configuration as possible.
Monte Carlo has built a strong team and has done a great job telling the story of data observability for larger companies. Overall we want to support even the smallest data teams, who we feel are being underserved by other companies in this space.
Re: Launch HN: Metaplane (YC W20) – Datadog for Data
#18I’m building our companies first data platform right now (fivetran, dbt, snowflake), so I’ll definitely check this out!! 1) Do you have Metabase on your roadmap? Lightdash? 2) I see that you alert on schema changes, which is great. Can you monitor for schema changes of a Postgres database? Reason I ask: Fivetran (and others) will try to buffer some schema changes from you to prevent data loss (drop columns, rename co…
1) An integration with Metabase Cloud is on our roadmap for Q1! We'd love to integrate with Lightdash, but they don't have a public API just yet[1]. 2) Several of our customers use us to alert on schema changes in Postgres, specifically so they can get ahead of application database changes that will end up in the warehouse, so you're definitely not alone! Here's a link on how to connect postgres: https://docs.metapla…
All sounds great! I'll share it with my team.
My plan was to monitor the postgres database in the staging environment, so we can be alerted to schema changes before they are released into production (and hopefully stop the production deploy).
I have a goal of moving this even further upstream into the CI build for the source application itself (Ruby on Rails in this case), so that the application's test suite will fail a developer introduces a breaking schema change. Note: this is a pretty tricky problem to solve without a) the tests being way too brittle OR b) super slow end to end tests. I have some goals of introducing which is a mashup of: Spectacles [1], Pact [2], and dbt models [3].
[1] https://www.spectacles.dev [2] https://pact.io [3] https://docs.getdbt.com/docs/building-a-dbt-project/using-so...
Re: Launch HN: Metaplane (YC W20) – Datadog for Data
#19Congrats on the launch! The Metaplane team is great.
[deleted]
Re: Launch HN: Metaplane (YC W20) – Datadog for Data
#20Congrats Kevin and Guru on the launch. Happy to see this on here, I was wondering when you’d do your Launch HN. These are real problems that a lot of data teams have and I’m glad to see this making it into the wild!
Thanks Ian — our earlier conversations definitely helped shape our thinking about this space!