Congrats on the launch! The Metaplane team is great.
Thank you! appreciate your support :)
Launch HN: Metaplane (YC W20) – Datadog for Data
21–30 of 71 posts
Re: Launch HN: Metaplane (YC W20) – Datadog for Data
#22Earlier quoted context omitted.
1) An integration with Metabase Cloud is on our roadmap for Q1! We'd love to integrate with Lightdash, but they don't have a public API just yet[1]. 2) Several of our customers use us to alert on schema changes in Postgres, specifically so they can get ahead of application database changes that will end up in the warehouse, so you're definitely not alone! Here's a link on how to connect postgres: https://docs.metapla…
All sounds great! I'll share it with my team. My plan was to monitor the postgres database in the staging environment, so we can be alerted to schema changes before they are released into production (and hopefully stop the production deploy). I have a goal of moving this even further upstream into the CI build for the source application itself (Ruby on Rails in this case), so that the application's test suite will fa…
That sounds like a great plan. We're planning to build our public API and CI/CD integrations early next year, so that developers can know what the downstream impact of their changes might be, and whether it could introduce unexpected results. We may be able to slot right in there with Pact.
Mitigating the impact with monitoring is where we're at right now, but we're with you that preventing errors can be even more important.
If it's interesting to you, we're happy to open up a shared slack channel to dig into the nuance as well! Just email me (guru@metaplane.dev) with the email you'd like to be added.
Re: Launch HN: Metaplane (YC W20) – Datadog for Data
#23Earlier quoted context omitted.
All sounds great! I'll share it with my team. My plan was to monitor the postgres database in the staging environment, so we can be alerted to schema changes before they are released into production (and hopefully stop the production deploy). I have a goal of moving this even further upstream into the CI build for the source application itself (Ruby on Rails in this case), so that the application's test suite will fa…
That sounds like a great plan. We're planning to build our public API and CI/CD integrations early next year, so that developers can know what the downstream impact of their changes might be, and whether it could introduce unexpected results. We may be able to slot right in there with Pact. Mitigating the impact with monitoring is where we're at right now, but we're with you that preventing errors can be even more im…
Very cool. I'll reach out.
When Nick Schrock created dagster, he argued that many "data cleaning" tasks which people attribute to "data engineering" aren't actually "cleaning", but are architecture problems. I believe schema changes also fall into this category. I'm extremely new to data engineering, but when I think about "What are the things which will break this system?" an application engineer thinking "I'm going to rename this column and my tests pass, so this should be fine" will break things all the time. (Similar goes for dropping a column, changing a one-to-many into a many-to-many)
Re: Launch HN: Metaplane (YC W20) – Datadog for Data
#24I looked at the pricing page. It's a very big jump from $0 to $400 per month. There is no middle ground. Something like $30 per month. Any reasons?
We wanted to make Metaplane free for individuals and approachable for teams, and found that $400/mo is justified by the cost of engineering time saved and is comparable to other paid tools that a smaller data team might use (like dbt, Fivetran, Hightouch). That said, we’re still experimenting with pricing though, and I can see the argument for a tier that’s more suited for individual paid plans. We also want the free…
One note about the pricing page itself - I found the "black vs grey" links for the two tiers of "Growth" pretty confusing.
I incorrectly assumed that once I enter the Growth plan $400/mo, I get access to dbt/lineage. But those are only "checked" when you pay $800/mo version of the Growth plan.
So it really feels like you have 4 plans: Free, Growth, Business?, and Enterprise.
Re: Launch HN: Metaplane (YC W20) – Datadog for Data
#25Looks great! Congrats on the launch.
How does this differ from a data reliability platform like Datafold? https://www.datafold.com/
And can this replace what https://atlan.com/ does as well?
Re: Launch HN: Metaplane (YC W20) – Datadog for Data
#26My team has worked on a library for a similar purpose:
https://github.com/capitalone/DataProfiler
Load any document, profile and monitor the profiles for changes that would impact downstream applications.
Very common problem, you all are in a great space! Very interested and will check out!
Re: Launch HN: Metaplane (YC W20) – Datadog for Data
#27Re: Launch HN: Metaplane (YC W20) – Datadog for Data
#28To be the Datadog for anything, you need a very aggressive sales team who are willing to hold customers financially hostage in exchange for C-grade customer service. (Though their technology is certainly acceptable) Be better than Datadog.
Re: Launch HN: Metaplane (YC W20) – Datadog for Data
#29To be the Datadog for anything, you need a very aggressive sales team who are willing to hold customers financially hostage in exchange for C-grade customer service. (Though their technology is certainly acceptable) Be better than Datadog.
Also you need to ensure the price of the monitoring solution is more expensive than the resource being monitored.