Live data from Hacker News

Best Practices for ML Engineering (2017)

developers.google.com

11–12 of 12 posts

Re: Best Practices for ML Engineering (2017)

#11
I want to highlight #1 and #2 especially. Machine learning is not necessarily the correct tool to use to solve a problem. You won't even understand whether it might be unless you've done at least some of the work for Rule #2. If the data you've collected and the metrics you think you can nudge with a machine learning product support it, make sure you have as complete a set of metrics as possible to measure whether your ML product is useful.

It's easy for data scientists and machine learning engineers see P/R, AUC, or whatever as the goal, especially if there isn't much support in the organization for measuring product performance. It's often not the end goal. Measurements of a model's performance in this context indicate some measure of statistical performance with respect to training and test data. Real, live measurements from "in the wild" application are the true fitness test.

Re: Best Practices for ML Engineering (2017)

#12

My favorite part is what so many people seem to forget: Rule #1: Don’t be afraid to launch a product without machine learning. Just because you can use machine learning doesn’t mean you should.

About a year ago I spoke to someone at Google who described her job as trying to convince people not to use machine learning in cases where it wasn't really appropriate. They take this seriously.
Post reply on HN