Are there more great resources like this to learn finding, cleaning and structuring data? Would greatly appreciate it if someone could point me in a direction.
End to End Machine Learning Pipeline Tutorial
11–20 of 25 posts
Re: End to End Machine Learning Pipeline Tutorial
#12Hi! This is really great page, I love reading it. Just a few tips:
The for loops in your code can be made more conscise: instead of
for i in range(len(movies_with_overviews)):
movie=movies_with_overviews[i]
for movie in movies_with_overviews:
Re: End to End Machine Learning Pipeline Tutorial
#13Are there more great resources like this to learn finding, cleaning and structuring data? Would greatly appreciate it if someone could point me in a direction.
Hi!
I couldn't find much, that's why I stressed on it in the tutorial. Scraping is a fun hobby but it's extremely useful. I strongly suggest spending time using python's selenium and beautiful soup libraries. The former is good to automate pages with javascript elements, and the latter to parse HTML!
Re: End to End Machine Learning Pipeline Tutorial
#14These are the tutorials that depict the reality of a machine learning career. Everyone broadly understands that data preparation is the key, but few realize what that involves. Half of this tutorial is just about getting and prepping data for training. Kudos!
To quote one of the greatest professor in ML Pedro Domingos - "First-timers are often surprised by how little time in a machine
learning project is spent actually doing machine learning.
But it makes sense if you consider how time-consuming it is to gather data, integrate it, clean it and pre-process it,
and how much trial and error can go into feature design.....Learning
is often the quickest part of this, but that’s because we’ve
already mastered it pretty well! Feature engineering is more
difficult because it’s domain-specific, while learners can be
largely general-purpose."
Re: End to End Machine Learning Pipeline Tutorial
#15This so so helpful. It would take me months to gather resources to learn this stuff and I wouldn't even know what I would be looking for. To the author: please share more content if your valuable time permits
Working on them already! Next one is going to be on Word Embeddings for Natural Language Processing. Basically, how do we convert words and sentences to numbers so that a computer can work with them. Applications like Text classification, sentiment analysis all of them depend on this one single fundamental backbone!
Re: End to End Machine Learning Pipeline Tutorial
#16Great write-up. Especially the fact that half of it was about finding cleaning and structuring data! You can tell someone isn't applying ML if they aren't spending most of their time getting their data organized. It's the "sharpening the axe" part of the hour Lincoln describes. For example, they never introduce you to how you can run the same algorithm on your own dataset I actually think the tensorflow tutorial on C…
Sure, would love to get in touch about my work over mail! What's your email ID Andrew?
Re: End to End Machine Learning Pipeline Tutorial
#17This looks amazing, thankyou for sharing! :)
Re: End to End Machine Learning Pipeline Tutorial
#18Very nice work. Thanks for sharing.
Re: End to End Machine Learning Pipeline Tutorial
#19Reading articles like this written by people who want to share their fabulous domain knowledge for free of charge really is the reason why I read Hacker News. Thank you, i hope i will have the time to read through it all with thought and later hopefully utilize it with my own projects.
And people like you who take time out to read and learn is exactly the reason why people like me write such articles! Absolutely thrilled that people liked it and that I will be contributing in people learning this beautiful field of science I do research in :)
Thanks for putting so much time and effort into this. This is definitely not "Yet-another-intro-to-ML".
Re: End to End Machine Learning Pipeline Tutorial
#20This is wonderful. I just became interested in this subject but had difficult finding resources that weren't simple copy/paste examples, as you mentioned, or semester-long courses. Thank you!