Live data from Hacker News

Ask HN: Machine learning engineers, what do you do at work?

news.ycombinator.com

161–170 of 233 posts

Re: Ask HN: Machine learning engineers, what do you do at work?

#161
post #5

pip install pytorch Environment broken Spend 4 hours fixing python environment pip install Pillow Something something incorrect cpu architecture for your Macbook Spend another 4 hours reinstalling everything from scratch after nuking every single mention of python pip install … oh time to go home!

Use standard cloud images

> Something something incorrect cpu architecture for your Macbook

Re: Ask HN: Machine learning engineers, what do you do at work?

#162

Getting my models dunked on by people who can't open MS Outlook more than 3 tries out of 5, however, have a remarkable depth and insight into their chosen domain of expertise. It's rather humbling. Collaborating with nontechnical people is oddly my favorite part of doing MLE work right now. It wasn't the case when I did basic web/db stuff. They see me as a magician. I see them as voodoo priests and priestesses. When…

What business are you in that predicting health data can make you millions?

Re: Ask HN: Machine learning engineers, what do you do at work?

#163

Getting my models dunked on by people who can't open MS Outlook more than 3 tries out of 5, however, have a remarkable depth and insight into their chosen domain of expertise. It's rather humbling. Collaborating with nontechnical people is oddly my favorite part of doing MLE work right now. It wasn't the case when I did basic web/db stuff. They see me as a magician. I see them as voodoo priests and priestesses. When…

This sounds almost exactly like my day-to-day as a solo senior data engineer — minus building and training ML models, and I don't work in healthcare. My peers are all very non-technical business directors who are very knowledgeable about their domains, and I'm like a wizard who can conjure up time savings/custom reporting/actionable insights for them.

Collaborating with them is great, and has been a great exercise in learning how to explain complex ideas to non-technical business people. Which has the side effect of helping me get better at what I do (because you need a good understanding of a topic to be able to explain it both succinctly and accurately to others). It has also taught me to appreciate the business context and reasoning that can drive decisions about how a business uses or develops data/software.

Re: Ask HN: Machine learning engineers, what do you do at work?

#164

The amount of response may be self explaining. Not my main work, but spending a lot of time gluing things together. Tweaking existing open source. Figuring out how to optimize resources, retraining models on different data sets. Trying to run poorly put together python code. Adding missing requirements files. Cleaning up data. Wondering what could in fact really be useful to solve with ML that hasn't been done years…

Where do you locate/how do you select papers?

Re: Ask HN: Machine learning engineers, what do you do at work?

#165

In a given week, I usually do the following: * 15% of my time in technical discussion meetings or 1:1's. Usually discussing ideas around a model, planning, or ML product support * 40% ML development. In the early phase of the project, I'm understanding product requirements. I discuss an ML model or algorithm that might be helpful to achieve product/business goals with my team. Then I gather existing datasets from ana…

How do you select what papers to read? How often does that research become relevant to your job?

Re: Ask HN: Machine learning engineers, what do you do at work?

#166
post #71

Getting my models dunked on by people who can't open MS Outlook more than 3 tries out of 5, however, have a remarkable depth and insight into their chosen domain of expertise. It's rather humbling. Collaborating with nontechnical people is oddly my favorite part of doing MLE work right now. It wasn't the case when I did basic web/db stuff. They see me as a magician. I see them as voodoo priests and priestesses. When…

3 hours of meetings a week, that’s incredible. Sounds like your employer understands and values your time!

They really do. This has been my longest tenure at any position by far and Engineer QoL is a massive part of it. Our CTO came up through the DBA/Data/Engineering Management ranks and the empathy is solidly there.

As we grow, I'm ever watchful for our metamorphosis into a big-dumb-company, but no symptoms yet. :)

Re: Ask HN: Machine learning engineers, what do you do at work?

#167
post #144

Getting my models dunked on by people who can't open MS Outlook more than 3 tries out of 5, however, have a remarkable depth and insight into their chosen domain of expertise. It's rather humbling. Collaborating with nontechnical people is oddly my favorite part of doing MLE work right now. It wasn't the case when I did basic web/db stuff. They see me as a magician. I see them as voodoo priests and priestesses. When…

The Dead Internet Theory says most activity on the internet is by bots [1]. The Dead Privacy Theory says approximately all private data is not private; but rather is accessible on whim by any data scientist, SWE, analyst, or db admin with access to the database. [1] https://en.wikipedia.org/wiki/Dead_Internet_theory

Damn, I've talked about this many times at my last job (startup that went from 100k patients to ~2.5M in 5 years). I love the name Dead Privacy Theory

Re: Ask HN: Machine learning engineers, what do you do at work?

#168
post #14

Earlier quoted context omitted.

As somebody whose machine learning expertise consists of the first cohort of Andrew Ng's MOOC back in 2011, I'm not too surprised. One of the big takeaways I took from that experience was the importance of getting the features right.

This was very important with classical machine learning, now with deep learning, feature engineering became useless as the model can learn the relevant features by itself. However, having a quality and diverse dataset is more important now than ever.

That depends on the type of data, and regardless, your goal is to minimizing the input data since it has a direct impact on performance overhead and duration of inference.

Re: Ask HN: Machine learning engineers, what do you do at work?

#169
post #14

Earlier quoted context omitted.

As somebody whose machine learning expertise consists of the first cohort of Andrew Ng's MOOC back in 2011, I'm not too surprised. One of the big takeaways I took from that experience was the importance of getting the features right.

This was very important with classical machine learning, now with deep learning, feature engineering became useless as the model can learn the relevant features by itself. However, having a quality and diverse dataset is more important now than ever.

no we just replaced feature engineering with architectural engineering

Re: Ask HN: Machine learning engineers, what do you do at work?

#170

Earlier quoted context omitted.

My answer is yes to both of those If other peoples work is reliant on yours then you should know how their part of the system transforms your inputs Similarly you should fully understand how all the inputs to your part of the system are generated No matter your coupling pattern, if you have more than 1 person product, knowing at least one level above and below your stack is a baseline expectation This is true with pe…

The parent comment had three examples...

2/3 is close enough in ML world
Post reply on HN