Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Michelangelo PyML: Uber’s Platform for Rapid Python ML Model

eng.uber.com

Post reply on HN
Print view View original

11–20 of 27 posts

Re: Michelangelo PyML: Uber’s Platform for Rapid Python ML Model

#11

Post by Michaelanjello »

mark_l_watson wrote: post #10

I manage a ML team and the article has several ‘borrowable’ ideas, the primary idea supporting model builders working on their local Linux device and simplifying the process of transferring locally built models to a scalable platform. If we were starting today to implement our in house system I might just use Ubber’s system as a checklist for features to implement. Not too off topic: after mostly building and trainin…

Uber's software doesn't exist in the public realm, and so there is nothing to learn from it. It is imaginary fluff. I have posted a list of the ones that do actually exist in another comment. And you should've at least got a 1080.

Re: Michelangelo PyML: Uber’s Platform for Rapid Python ML Model

#12

Post by mark_l_watson »

Michaelanjello wrote: post #11
mark_l_watson wrote: post #10

I manage a ML team and the article has several ‘borrowable’ ideas, the primary idea supporting model builders working on their local Linux device and simplifying the process of transferring locally built models to a scalable platform. If we were starting today to implement our in house system I might just use Ubber’s system as a checklist for features to implement. Not too off topic: after mostly building and trainin…

Uber's software doesn't exist in the public realm, and so there is nothing to learn from it. It is imaginary fluff. I have posted a list of the ones that do actually exist in another comment. And you should've at least got a 1080.

I wanted a portable laptop and just saw 1070s on what was available. What brand of GPU laptop do you suggest?

I got some ideas from reading the article, but yes, I agree with you that the article should have a link to a public git repo for at least some of their tooling.

EDIT: I wanted the multi-GPU Lambda Labs box, but with my lifestyle I require some mobility. I agree that the 1070 is a bit weak, but is still better than no GPU and I like The System76 laptop I bought even when I am not using the GPU.

Re: Michelangelo PyML: Uber’s Platform for Rapid Python ML Model

#13

Post by throwaway77790 »

Michaelanjello wrote: post #8
canada_dry wrote: post #2

Pretty slick, but more impressive is their well written overview of the tool. It has some interesting model def features: The model interfaces abstract away where and how the model will be deployed so that the user can focus on what they understand best: the data going in and out of the model.

Are you serious? There is no code for us, so there is no tool! The article is as good as fake news.

Not every company needs to open source their tools. Uber has contributed a substantial amount of open source tools. This product is clearly new and 99% likely ties to their stack meaning it is useless to you anyway.

Make your own tool and open source it if you are going to be so mean. I would never want to share my hard work with people who act this way.

Re: Michelangelo PyML: Uber’s Platform for Rapid Python ML Model

#14

Post by Michaelanjello »

mark_l_watson wrote: post #12
Michaelanjello wrote: post #11

Earlier quoted context omitted.

Uber's software doesn't exist in the public realm, and so there is nothing to learn from it. It is imaginary fluff. I have posted a list of the ones that do actually exist in another comment. And you should've at least got a 1080.

I wanted a portable laptop and just saw 1070s on what was available. What brand of GPU laptop do you suggest? I got some ideas from reading the article, but yes, I agree with you that the article should have a link to a public git repo for at least some of their tooling. EDIT: I wanted the multi-GPU Lambda Labs box, but with my lifestyle I require some mobility. I agree that the 1070 is a bit weak, but is still bette…

You will get a lot more ideas from other software that actually do exist. I can easily write a fake blog post with fake thoughts giving you fake ideas, but that's not what you want; you deserve ideas that work.

System76 does sell laptops with the 1080.

Re: Michelangelo PyML: Uber’s Platform for Rapid Python ML Model

#15

Post by Michaelanjello »

throwaway77790 wrote: post #13
Michaelanjello wrote: post #8

Earlier quoted context omitted.

Are you serious? There is no code for us, so there is no tool! The article is as good as fake news.

Not every company needs to open source their tools. Uber has contributed a substantial amount of open source tools. This product is clearly new and 99% likely ties to their stack meaning it is useless to you anyway. Make your own tool and open source it if you are going to be so mean. I would never want to share my hard work with people who act this way.

I am mean only to losers who deserve it.

Re: Michelangelo PyML: Uber’s Platform for Rapid Python ML Model

#16

Post by akhilcacharya »

mark_l_watson wrote: post #10

I manage a ML team and the article has several ‘borrowable’ ideas, the primary idea supporting model builders working on their local Linux device and simplifying the process of transferring locally built models to a scalable platform. If we were starting today to implement our in house system I might just use Ubber’s system as a checklist for features to implement. Not too off topic: after mostly building and trainin…

The local dev painpoint is real. I was working on a library that can intercept and transparently offload keras fit() calls from ones local machine to a faster remote machine. Unfortunately, it seems most people just use GPU workstations and don’t need the speed improvements locally.

Re: Michelangelo PyML: Uber’s Platform for Rapid Python ML Model

#17

Post by manojlds »

brylie wrote: post #3

As it stands, this article strikes me more as a recruitment device than something useful to ML practitioners outside of Uber. I'm hopeful Uber will open-source parts of the Michelangelo stack, so it will be a contribution to the broader community.

Disagree. The article validates a lot of thought we have been putting in our own company. Not everything has to be open sourced to have value.

Re: Michelangelo PyML: Uber’s Platform for Rapid Python ML Model

#18

Post by gaius »

mark_l_watson wrote: post #10

I manage a ML team and the article has several ‘borrowable’ ideas, the primary idea supporting model builders working on their local Linux device and simplifying the process of transferring locally built models to a scalable platform. If we were starting today to implement our in house system I might just use Ubber’s system as a checklist for features to implement. Not too off topic: after mostly building and trainin…

I recently bought a fast laptop for home use that has a 1070 GPU and the experience of using a local device with a GPU makes me regret many years of SSHing to remote compute

Most interesting problems in my experience are constrained by I/O bandwidth, and being able to run C/GPUs for extended periods without thermal issues. You really need something in a DC for that. I chose not to bother with a GPU laptop myself because there just seemed to be no point, for ML at least. I guess just for playing, it’s a nice luxury, but I can’t imagine relying on it for real work.

Re: Michelangelo PyML: Uber’s Platform for Rapid Python ML Model

#19

Post by zozbot123 »

gaius wrote: post #18
mark_l_watson wrote: post #10

I manage a ML team and the article has several ‘borrowable’ ideas, the primary idea supporting model builders working on their local Linux device and simplifying the process of transferring locally built models to a scalable platform. If we were starting today to implement our in house system I might just use Ubber’s system as a checklist for features to implement. Not too off topic: after mostly building and trainin…

I recently bought a fast laptop for home use that has a 1070 GPU and the experience of using a local device with a GPU makes me regret many years of SSHing to remote compute Most interesting problems in my experience are constrained by I/O bandwidth, and being able to run C/GPUs for extended periods without thermal issues. You really need something in a DC for that. I chose not to bother with a GPU laptop myself beca…

Gaming desktop PCs exist for a single reason - "being able to run C/GPUs for extended periods without thermal issues." If you were doing this for actual work, you'd obviously need to step upwards to a real workstation, which would actually be built quite similarly to a bog-standard gaming desktop save for using higher reliability components, e.g. FirePro- or Quadro-class GPU hardware. But to suggest that you need "something in a DC" to explore interesting problems seems quite wrong to me.
Post reply on HN