A collection of free datasets from Microsoft Research • Hacker News Board

Re: A collection of free datasets from Microsoft Research

#41

Post by jonhendry18 » Wed, Jul 04, 2018, 9:22 PM UTC

rspeer wrote: post #14

They don't make it easy to find out what the Microsoft Research License Agreement is, when they put it behind a login wall on a site that doesn't work with ad-block. But this appears to be a copy of it: http://www.cs.toronto.edu/~aditya/langid/msrla.txt These license terms are a trap. Nobody should ever accept them. You can't use the data for commercial purposes, which is harsh enough on its own -- it means the data…

"You can't use the data for commercial purposes, which is harsh enough on its own -- it means the data should only be interesting to people who plan to be academics permanently, or who don't plan to succeed at anything they do with it."

It'd also be useful for someone farting around with machine learning who isn't anywhere close to being at a point of shipping anything to anyone else.

What you can benefit from is what you learn while using the data. Then you start a new project using what you've learned, and using different data.

Re: A collection of free datasets from Microsoft Research

#42

Post by antoaravinth » Thu, Jul 05, 2018, 3:43 AM UTC

Well if you are looking for a huge dataset, I would suggest stack overflow.

https://archive.org/details/stackexchange

I remember I wrote a node script to download all question and dump into my Postgres instance. It was fun, Postgres with an index could able to fetch results super fast

How many answers for this question?

How many questions are unanswered?

With gin index, I could do a free text search as well.

Re: A collection of free datasets from Microsoft Research

#43

Post by lurquer » Thu, Jul 05, 2018, 5:23 AM UTC

ct520 wrote: post #15

ehsankia wrote: post #7

Earlier quoted context omitted.

Is it the one used in this paper? https://youtu.be/XOxxPcy5Gr4

Dude watching this video is how I imagine a bad acid trip to be

It's worse. I think I damaged something in my brain by watching that...

Re: A collection of free datasets from Microsoft Research

#44

Post by rspeer » Thu, Jul 05, 2018, 2:17 PM UTC

jonhendry18 wrote: post #41

rspeer wrote: post #14

They don't make it easy to find out what the Microsoft Research License Agreement is, when they put it behind a login wall on a site that doesn't work with ad-block. But this appears to be a copy of it: http://www.cs.toronto.edu/~aditya/langid/msrla.txt These license terms are a trap. Nobody should ever accept them. You can't use the data for commercial purposes, which is harsh enough on its own -- it means the data…

"You can't use the data for commercial purposes, which is harsh enough on its own -- it means the data should only be interesting to people who plan to be academics permanently, or who don't plan to succeed at anything they do with it." It'd also be useful for someone farting around with machine learning who isn't anywhere close to being at a point of shipping anything to anyone else. What you can benefit from is wha…

Why would you plan to fail? You could just use different data from the start that doesn't require you to sign an NDA.

It's not like MSR is providing a rare commodity.

Re: A collection of free datasets from Microsoft Research

#45

Post by jonhendry18 » Thu, Jul 05, 2018, 11:04 PM UTC

rspeer wrote: post #44

jonhendry18 wrote: post #41

Earlier quoted context omitted.

"You can't use the data for commercial purposes, which is harsh enough on its own -- it means the data should only be interesting to people who plan to be academics permanently, or who don't plan to succeed at anything they do with it." It'd also be useful for someone farting around with machine learning who isn't anywhere close to being at a point of shipping anything to anyone else. What you can benefit from is wha…

Why would you plan to fail? You could just use different data from the start that doesn't require you to sign an NDA. It's not like MSR is providing a rare commodity.

"Why would you plan to fail?"

Because it isn't failure if your only goal is to learn.

Re: A collection of free datasets from Microsoft Research

#46

Post by iamdave » Fri, Jul 06, 2018, 4:32 AM UTC

stevesimmons wrote: post #27

iamdave wrote: post #8

I ask this not with snark but with fond(ish) memories, but does Microsoft providing open data like this make anyone else think of that Northwinds sample database that used to come with SQL Server? Not sure if it still does or not, as I'm in a different DB engine entirely these days, but I kind of grinned with a wee bit of nostalgia checking out this site thinking of that. I cut my teeth on that data set. Edit: Son of…

The Northwinds sample database predates SQL Server. I remember using it with Microsoft Access 1.0 back in 1993...

Heh, you probably read my post and thought "darn kids" to yourself, eh?

Re: A collection of free datasets from Microsoft Research

#47

Post by nerdponx » Sat, Jul 07, 2018, 4:22 AM UTC

jonhendry18 wrote: post #41

rspeer wrote: post #14

They don't make it easy to find out what the Microsoft Research License Agreement is, when they put it behind a login wall on a site that doesn't work with ad-block. But this appears to be a copy of it: http://www.cs.toronto.edu/~aditya/langid/msrla.txt These license terms are a trap. Nobody should ever accept them. You can't use the data for commercial purposes, which is harsh enough on its own -- it means the data…

"You can't use the data for commercial purposes, which is harsh enough on its own -- it means the data should only be interesting to people who plan to be academics permanently, or who don't plan to succeed at anything they do with it." It'd also be useful for someone farting around with machine learning who isn't anywhere close to being at a point of shipping anything to anyone else. What you can benefit from is wha…

It'd also be useful for someone farting around with machine learning who isn't anywhere close to being at a point of shipping anything to anyone else.

This is the only use I can see for this data under those license terms. And even then, you are still technically granting Microsoft a super-license to do whatever they want with whatever you come up with, and probably also not allowed to upload it to Github.