Live data from Hacker News

Open-source infra for data scientists

magniv.app

11–20 of 24 posts

Re: Open-source infra for data scientists

#14

It reads open source core which means it's not fully open source. So the product page isn't exactly clear to me what's being offered. Although it is possible to have a sass with a fully open source code base of course.

We will have an open-source core framework (the Python decorator part). Kind of following the DBT model. Still very early (in alpha) so will not open source until the beta development begins.

Re: Open-source infra for data scientists

#17
post #2

Hey- Jared here! I am one of the founders of Magniv. Let me know if you have any questions. We are excited to get this in the hands of beta testers in the community :)

It looks like Magniv is targeting Python in general. This is similar to ClearML. What are the differentiating points to Magniv compared to similar products?

It seems like the product also integrates with SCM systems. Are you using gitea and then containers to push code and data to execution like CodeOcean?

https://github.com/allegroai/clearml

https://codeocean.com/

Re: Open-source infra for data scientists

#19

We’ve been trying to plan out building our data team at my company— been so hard finding a data scientist to do infra too. Wonder if this would help...

Yes! Please sign up on our website, would love to chat further and see if it can help. Our goal is to decrease reliance on data engineers when building data teams

Re: Open-source infra for data scientists

#20
post #17
post #2

Hey- Jared here! I am one of the founders of Magniv. Let me know if you have any questions. We are excited to get this in the hands of beta testers in the community :)

It looks like Magniv is targeting Python in general. This is similar to ClearML. What are the differentiating points to Magniv compared to similar products? It seems like the product also integrates with SCM systems. Are you using gitea and then containers to push code and data to execution like CodeOcean? https://github.com/allegroai/clearml https://codeocean.com/

Yeah, so one of our differentiating points is that we can integrate with whatever scheduler you are already using.

On top of that a lot of the libraries that exist are focused on ML, focusing on resources/gpu etc. We are more focused on the data science side of this problem.

Similar though.

Post reply on HN