Show HN: Concept of a marketplace for machine learning datasets
1–10 of 46 posts
Re: Show HN: Concept of a marketplace for machine learning datasets
#2Hi everyone,
While working on some of my projects involving Machine learning algorithms and deep neural networks i have found that there is a lack of training data sets in many areas. Also many of them are scattered throughout web, some are extremely huge for an individual to process etc.So i thought of this idea of having a marketplace for data ,structured for machine learning communities. It can be a one stop place for researchers, scientists, students,data analysts etc.Looking for some valuable opinions.
Re: Show HN: Concept of a marketplace for machine learning datasets
#3Hi everyone, While working on some of my projects involving Machine learning algorithms and deep neural networks i have found that there is a lack of training data sets in many areas. Also many of them are scattered throughout web, some are extremely huge for an individual to process etc.So i thought of this idea of having a marketplace for data ,structured for machine learning communities. It can be a one stop place…
It looks like your page is down, possibly due to HN load.
Re: Show HN: Concept of a marketplace for machine learning datasets
#4[deleted]
Re: Show HN: Concept of a marketplace for machine learning datasets
#5relevant: https://www.reddit.com/r/datasets/top/
Re: Show HN: Concept of a marketplace for machine learning datasets
#6How about first "Concept of signing up for a web host with unlimited bandwidth"?
Re: Show HN: Concept of a marketplace for machine learning datasets
#7There are a few services popping up with aim to provide data repositories for analysis/ML (Kaggle, data.world, /r/datasets)
As someone who likes making analyses from random datasets, I have a few issues with these types of services:
1) There is often no indication of the distribution rights of the data, or whether the data was obtained ethically from the source (i.e. following the ToS). I made this mistake when I used an OKCupid dataset released on an Open Data Repository; turns out it was scraped with a logged-in account and the dataset was taken down by DMCA
2) There is no indication of the quality of the data, and as a result, it may take an absurd amount of time cleaning the data for accuracy. Some datasets may not be salvageable.
3) Bandwidth. Good datasets have lots of data for better models, which these sites may not be able to support. (BigQuery public datasets solve this problem however)
Re: Show HN: Concept of a marketplace for machine learning datasets
#8Hi everyone, While working on some of my projects involving Machine learning algorithms and deep neural networks i have found that there is a lack of training data sets in many areas. Also many of them are scattered throughout web, some are extremely huge for an individual to process etc.So i thought of this idea of having a marketplace for data ,structured for machine learning communities. It can be a one stop place…
Are you familiar with the UCI repository? https://archive.ics.uci.edu/ml/datasets.html
Re: Show HN: Concept of a marketplace for machine learning datasets
#9Link is now working again. It went down due to HN load.
Re: Show HN: Concept of a marketplace for machine learning datasets
#10relevant: https://www.reddit.com/r/datasets/top/
For those unfamiliar with Reddit, you can choose in a dropdown what time period to filter top posts by; here's a direct link to the all-time top dataset posts there: https://www.reddit.com/r/datasets/top/?sort=top&t=all