Live data from Hacker News

MLflow: An Open Source Machine Learning Platform

databricks.com

21–30 of 31 posts

Re: MLflow: An Open Source Machine Learning Platform

#21
post #3

What are the current open source alternatives to MLflow?

I would imagine Kubeflow ( https://github.com/kubeflow/kubeflow ) would be complimentary (e.g. run MLFlow on top of it) - they claim platform neutrality. Disclosure: I work at Google on Kubeflow.

Yes, Kubeflow is a vey promising platform for ml lifecycle management on kubernetes. The combination of kubernetes, istio and kubeflow could enable other higher layer workflow tools (mlflow, h2o etc). This space is early.

Re: MLflow: An Open Source Machine Learning Platform

#22
post #3

What are the current open source alternatives to MLflow?

ClassifyBot https://github.com/allisterb/ClassifyBot

Designed to automate and make repeatable different stages in classification pipelines. Written in .NET but agnostic about language or framework. Embeds a Python interpreter and can interface with Java or R.

Disclaimer: I am a walrus

Re: MLflow: An Open Source Machine Learning Platform

#27
post #18
post #13

Earlier quoted context omitted.

How about SageMaker, Can we include it in this list. I played with SageMaker sometime ago and it helps you build a whole pipeline to host your models, in addition to host your notebook and bridge the gap between data scientists and data engineers.

Anecdotally, we considered using the hosted versions of Jupyter and Apache Zeppelin that are part of AWS SageMaker and EMR. We couldn't figure out a simple/familiar workflow for keeping the notebooks under version control. So, we agreed to run the notebooks locally, use a familiar Git-based workflow, and interact with the AWS infrastructure through the local notebook instances.

Does Zeppelin work naturally with git? I've been struggling to get the right setup with just Jupyter

Re: MLflow: An Open Source Machine Learning Platform

#28
post #21

Earlier quoted context omitted.

I would imagine Kubeflow ( https://github.com/kubeflow/kubeflow ) would be complimentary (e.g. run MLFlow on top of it) - they claim platform neutrality. Disclosure: I work at Google on Kubeflow.

Yes, Kubeflow is a vey promising platform for ml lifecycle management on kubernetes. The combination of kubernetes, istio and kubeflow could enable other higher layer workflow tools (mlflow, h2o etc). This space is early.

the mlflow now suport ml lifecycly management?I think we can find a way to combinate kubeflow and mlflow

Re: MLflow: An Open Source Machine Learning Platform

#30
post #18

Earlier quoted context omitted.

Anecdotally, we considered using the hosted versions of Jupyter and Apache Zeppelin that are part of AWS SageMaker and EMR. We couldn't figure out a simple/familiar workflow for keeping the notebooks under version control. So, we agreed to run the notebooks locally, use a familiar Git-based workflow, and interact with the AWS infrastructure through the local notebook instances.

Does Zeppelin work naturally with git? I've been struggling to get the right setup with just Jupyter

Well, good question. The file format for Jupyter is not ideal for 'code craftsmanship', as pointed out by another comment. There are utilities to strip out some of the metadata from the Jupyter files, such as rendered output and run counters, but that is a trade-off to be decided by your team:

https://github.com/kynan/nbstripout

Post reply on HN