"To keep reading this story, create a free account." Seriously? I know it's the Medium hustle but someone at Netflix should know better.
Firefox add-on to avoid the hassle: https://github.com/iamadamdev/bypass-paywalls-firefox
How Netflix uses Druid for realtime insights
41–50 of 60 posts
Re: How Netflix uses Druid for realtime insights
#42Earlier quoted context omitted.
Clickhouse is much more resource efficient in many cases but is less flexible and importantly extensible than Druid. Druid can easily be extended through available 3rd party extensions and you can write your own to implement custom serialisation formats, aggregations, connect to new streaming systems, read directly from whatever cold storage you have etc. In the Clickhouse model you have to work out a lot more of tha…
I think what you're getting at can be accomplished with materialized views in clickhouse now. Most queries that might be fast with inverted indices can be solved that way. Also, I don't think they use bloom filters for the index as far as I can tell from the documentation. There is certainly an option to use a bloom filter aggregator on a table for faster counts, but it's not the default. If you're referring to the f…
> I think what you're getting at can be accomplished with materialized views in clickhouse now. Most queries that might be fast with inverted indices can be solved that way.
Let's say you have data with a few dozen dimensions, and want to compute aggregations filtered by any user-supplied union or intersection of dimension values. This is a fairly common use case in analytics dashboards. How do materialized views help with that?
Re: How Netflix uses Druid for realtime insights
#43"To keep reading this story, create a free account." Seriously? I know it's the Medium hustle but someone at Netflix should know better.
I can read the whole article and am not signed in. It also shows up in incognito mode. That popup is usually asking you to create an account, but you should be able to just close it and continue. I see the whole article for sure behind no paywall and am not logged in.
Re: How Netflix uses Druid for realtime insights
#44"To keep reading this story, create a free account." Seriously? I know it's the Medium hustle but someone at Netflix should know better.
That should be fixed. Thanks for calling it out.
Re: How Netflix uses Druid for realtime insights
#45I wonder how this choice compares to using a hosted solution like Splunk (both in capabilities and cost).
Thats an interesting thought.
Re: How Netflix uses Druid for realtime insights
#46So this is behind paywall. I am sure Netflix is not marking this story to be behind paywall and Medium can not put this story behind paywall without consent from Netflix.
That should be fixed. Thanks for flagging it.
Re: How Netflix uses Druid for realtime insights
#47Wondering if any performance comparison was done with Apache Pinot?
Re: How Netflix uses Druid for realtime insights
#48I wonder if materialize.io could handle such workloads at this stage.
Materialize, today, looks to be limited to running on a single node. https://materialize.io/docs/overview/architecture Netflix's workload would likely exhaust the resources of even a vertically-scaled single node.
I can swear I saw they will be offering multi-node commercially soon. I can't find it now, apart from their cloud offering at
Re: How Netflix uses Druid for realtime insights
#49Earlier quoted context omitted.
Then log out. It’s not a paywall. Log out and you can read it. Medium is playing you.
Proper response: delete account and don't visit medium again. Even better: sites such as hn should never allow links to sites employing dark patterns.
People are interested in the content. No need for HN to start filtering because the blog service. You can avoid the site if you want.
Re: How Netflix uses Druid for realtime insights
#50Earlier quoted context omitted.
Proper response: delete account and don't visit medium again. Even better: sites such as hn should never allow links to sites employing dark patterns.
People are interested in the content. No need for HN to start filtering because the blog service. You can avoid the site if you want.
There most certainly is a pressing need for sites such as HN to start care about stuff like this.
If people start to care about being exploited the content will move to a more ethical site. Or it might influence medium.