Earlier quoted context omitted.
> . As far as I'm aware Facebook's ad platform is mostly backed by hundreds of thousands of Mysql instances. Same for YouTube itself https://www.mysql.com/customers/view/?id=750 and they use Vitess for horizontal scaling: https://vitess.io/
YouTube has since migrated to Spanner, there’s a podcast episode with one of the Vitess creators that covers the politics of the switch
Real World Recommendation System
121–130 of 156 posts
Re: Real World Recommendation System
#122Earlier quoted context omitted.
That was my thinking - anything of value is product-specific and behind closed doors. It's not my field, but something I see come up from time to time that seems weirdly over-represented in ML articles.
I work on these systems, and if anything my only complaint about the field is the propensity to solve every optimisation problem with ML. I have seen people solve textbook-grade linear, and even differentiable, optimisation problems. And the reason it happens despite the 'invisible hand' etc is because it still works, it just happens to be horrendously inefficient . I think that's the main area of inefficiency in the…
Re: Real World Recommendation System
#123Earlier quoted context omitted.
Saying the article is "pretty shallow and non-descript: is much shorter and more useful than what they posted.
It provides more information. It's shallow and non-descript because it's an ad is the argument. I don't know if I believe that here. It's a blurry line with sponsored content.
Re: Real World Recommendation System
#124Earlier quoted context omitted.
Saying the article is "pretty shallow and non-descript: is much shorter and more useful than what they posted.
Right, but then it starts a meta-conversation about why the article got posted, or even written. It doesn't have the down-the-rabbit hole trait of an individual project of passion, or the sort of authoritative voice of a conference talk or even a Netflix blog post, it doesn't really speak to specific actionable technologies so it's not the kind of onboarding a Toward Data Science post would be. And that meta conversa…
I'd disagree with this pretty strongly since there are many examples of content marketing that are also very useful pieces of content.
Re: Real World Recommendation System
#125Earlier quoted context omitted.
(Disclaimer: I'm the author of the post) Good feedback, noted. Will get the next post focused on training within the next couple of days.
Also, how is this article different or more informative compared to others that deal with the challenges of model deployment/management at scale?
2. For any single request, there are thousands of things to recommend from. As a result, a single request is not scoring a single ML model but thousands of models - one (or often more, see value modeling the post) for each candidate.
Re: Real World Recommendation System
#126Off-topic, but how did Netflix manage to get itself inserted into the FAANG acronym anyway? Their impact on the tech industry is trivial compared to all the others. Sure, if you just take out the N it's offensive, but we could have said "GAFA" or "FAAMG" would be more accurate to include Microsoft in their place.
Re: Real World Recommendation System
#127Earlier quoted context omitted.
>Do you think part of this is that Netflix has assumed zero effort from user model? Talking w/a friend who works at Netflix, it sounds like this is a warranted assumption. The way he told it, they were tearing their hair out at one point b/c users wouldn't put much into it.
What I don't understand about their response is: why not make it configurable? Admittedly this is my philosophy for almost every product I work on - "make it maximally configurable, but make the defaults maximally sane" – but I'm baffled every time I hear someone talking about this 'dilemma'. You just keep your simple interface, but allow the power users to, say, click through to a particular menu and change their se…
Re: Real World Recommendation System
#128> As a result, primary databases (e.g. MySQL, Mongo etc.) almost never work I mean it does. As far as I'm aware Facebook's ad platform is mostly backed by hundreds of thousands of Mysql instances. But more importantly this post really doesn't describe issues of scale. Sure it has the stages of recommendation, that might or might not be correct, but it doesn't describe how all of those processes are scheduled, coordin…
Re: Real World Recommendation System
#129Gentle reminder to anyone reading this that your problems are probably not FAANG problems. If you architect your system trying to solve problems you don't have, you are gonna have a bad time.
Re: Real World Recommendation System
#130Earlier quoted context omitted.
TikTok seem to be learning from what the user is actually watching and for how long and not just the user's "Like"/"Not Interested In" actions. However it still seem to learn from the "Not Interested In" action more than any other platform.
This is a pretty misinformed take when it’s publicly known that YouTube was already doing this (learn from what the user is watching and for how long) the year Bytedance was founded (2012): https://blog.youtube/news-and-events/youtube-now-why-we-focu...