Live data from Hacker News

Ask HN: Has anyone built a recommendation engine in-house?

news.ycombinator.com

11–20 of 42 posts

Re: Ask HN: Has anyone built a recommendation engine in-house?

#11

I wrote the recommendation system at Netflix (still in use after 5 years). Primary problem was company politics. Many groups were not happy that one person could write a system that was better in A/B test, had more uptime and cheaper to run. All of it (ML, production, monitoring), was custom code.

Almost all of your top-level comments mention you did this

hard to fault him in this particular case as it's directly pertinent to the original topic.

Re: Ask HN: Has anyone built a recommendation engine in-house?

#12

I wrote the recommendation system at Netflix (still in use after 5 years). Primary problem was company politics. Many groups were not happy that one person could write a system that was better in A/B test, had more uptime and cheaper to run. All of it (ML, production, monitoring), was custom code.

Almost all of your top-level comments mention you did this

This is what working in a big company is like sometimes. Imagine a person like MaxLeiter working in Netflix. You would think that all staff would be happy that their work became easier. But a minority seem to have a zero-sum mindset.

When I finish my current work I will talk about that also. Some of my older work is speech recognition. Download my thesis.

Re: Ask HN: Has anyone built a recommendation engine in-house?

#13

I wrote the recommendation system at Netflix (still in use after 5 years). Primary problem was company politics. Many groups were not happy that one person could write a system that was better in A/B test, had more uptime and cheaper to run. All of it (ML, production, monitoring), was custom code.

@sadikkapadia - Any idea why Recommendation Engine as a Service has not picked up? I realize that building a use-case specific recommendation engine is unique.

However, I am wondering is there a recommendation engine as a service, which is similar to algolia available/possible.

I see only 2 players - yusp and recombee.

I'd appreciate any thought you have on this.

Re: Ask HN: Has anyone built a recommendation engine in-house?

#15

I wrote the recommendation system at Netflix (still in use after 5 years). Primary problem was company politics. Many groups were not happy that one person could write a system that was better in A/B test, had more uptime and cheaper to run. All of it (ML, production, monitoring), was custom code.

@sadikkapadia - Any idea why Recommendation Engine as a Service has not picked up? I realize that building a use-case specific recommendation engine is unique. However, I am wondering is there a recommendation engine as a service, which is similar to algolia available/possible. I see only 2 players - yusp and recombee. I'd appreciate any thought you have on this.

> Any idea why Recommendation Engine as a Service has not picked up?

These kind of services aren't so much exposed to the public and likely don't start at <100 bucks a month, which could be why those services are not that visible. However, there are some e-commerce services going in that direction, such like AgilOne...

Re: Ask HN: Has anyone built a recommendation engine in-house?

#16

I wrote the recommendation system at Netflix (still in use after 5 years). Primary problem was company politics. Many groups were not happy that one person could write a system that was better in A/B test, had more uptime and cheaper to run. All of it (ML, production, monitoring), was custom code.

@sadikkapadia - Any idea why Recommendation Engine as a Service has not picked up? I realize that building a use-case specific recommendation engine is unique. However, I am wondering is there a recommendation engine as a service, which is similar to algolia available/possible. I see only 2 players - yusp and recombee. I'd appreciate any thought you have on this.

[deleted]

Re: Ask HN: Has anyone built a recommendation engine in-house?

#17
I've been part of two efforts, one at a very large company, one at a startup. From where I stand, your biggest issue is going to be getting a sufficient data set, and having sufficient traffic in whatever you're recommending to be able to actually test your models.

Technical aspects in how you train your models and such are fun, but way, way down the list of things that are likely to matter in the short to medium term. Like, data scientists are nice to have, but you're not really going to be able to fully utilize them until you have the capability to build, deploy, and test a model at scale. If going third party helps you do this, you probably should.

Re: Ask HN: Has anyone built a recommendation engine in-house?

#18
post #15

Earlier quoted context omitted.

@sadikkapadia - Any idea why Recommendation Engine as a Service has not picked up? I realize that building a use-case specific recommendation engine is unique. However, I am wondering is there a recommendation engine as a service, which is similar to algolia available/possible. I see only 2 players - yusp and recombee. I'd appreciate any thought you have on this.

> Any idea why Recommendation Engine as a Service has not picked up? These kind of services aren't so much exposed to the public and likely don't start at <100 bucks a month, which could be why those services are not that visible. However, there are some e-commerce services going in that direction, such like AgilOne...

It is hard to sell technology to companies when they have their own teams (often using free libraries). Embedded teams are always experts and will often discredit better technology. Often the only method of testing is A/B. These can easily be manipulated. For instance at Netflix (ignoring more blatant practices), P-hacking (run thousands of simulations and report ones that worked), and HARKing (come up with a hypothesis after the results are known) are rampant. That is part of the reason the recommender has been degrading over the years.

Re: Ask HN: Has anyone built a recommendation engine in-house?

#20
I've built a recommender system for my movie database app "Coollector Movie Database". It's based on Collaborative filtering and it took me 2 years to implement. I built it from scratch and it's unique in several ways (for example, you can view the reliability of each recommendation). The technical difficulty is to crunch fast enough a huge quantity of data. I've had to apply all the optimizations that I could think of.

https://www.coollector.com/help.html#recommendations

Post reply on HN