Live data from Hacker News

Web Scraping to Create Open Data

blog.scrapinghub.com

21–30 of 58 posts

Re: Web Scraping to Create Open Data

#21
post #19
post #4

Earlier quoted context omitted.

That naming scheme definitely needs a long, hard rethink.

It's funny, everytime Weboob is presented somewhere, and everytime there is a post about the latest version of Weboob, the first comment is a variation of "it's sexist/boobs are unprofessional/grow up", and very very little time is spent talking about the actual thing, what it does and why its only goal is to become irrelevant. Sad thing. Here's what they have to say about it, and why there's very little chance they…

> It's funny, everytime Weboob is presented somewhere, and everytime there is a post about the latest version of Weboob, the first comment is a variation of "it's sexist/boobs are unprofessional/grow up", and very very little time is spent talking about the actual thing

Seems like a bad name then, no?

Re: Web Scraping to Create Open Data

#22

Earlier quoted context omitted.

> So scraping the data, and rearranging the underlying facts into your own arrangement/organization is almost always not copyright infringement. I'm not so sure. It would definitely be illegal in the US for me to cherry pick data out of Google Maps and add it to OpenStreetMap (and OSM has policies addressing exactly this ).

Yet companies like LexisNexis get most their data they resell this way.

Are they scraping copyrighted data? Or public records? Big difference.

Re: Web Scraping to Create Open Data

#23
post #19

Earlier quoted context omitted.

It's funny, everytime Weboob is presented somewhere, and everytime there is a post about the latest version of Weboob, the first comment is a variation of "it's sexist/boobs are unprofessional/grow up", and very very little time is spent talking about the actual thing, what it does and why its only goal is to become irrelevant. Sad thing. Here's what they have to say about it, and why there's very little chance they…

> It's funny, everytime Weboob is presented somewhere, and everytime there is a post about the latest version of Weboob, the first comment is a variation of "it's sexist/boobs are unprofessional/grow up", and very very little time is spent talking about the actual thing Seems like a bad name then, no?

Uh, exactly. Not much "sad" about it. More like bad choices on the part of the creator.

Re: Web Scraping to Create Open Data

#24

So what is the legality of this? Apart from the risk of having someone pull the plug on the way one takes the information out, when is something without a proper license able to be used?

IANAL but in the EU at least, even databases comprised of simple "facts" are protected.

It's a sad state of affairs when i'm not even allowed to scrape data generated using taxpayers' money, like the (required by EU laws) noise maps for cities, which I'd like to use to augment real estate offers, for example.

Re: Web Scraping to Create Open Data

#25
post #19
post #4

Earlier quoted context omitted.

That naming scheme definitely needs a long, hard rethink.

It's funny, everytime Weboob is presented somewhere, and everytime there is a post about the latest version of Weboob, the first comment is a variation of "it's sexist/boobs are unprofessional/grow up", and very very little time is spent talking about the actual thing, what it does and why its only goal is to become irrelevant. Sad thing. Here's what they have to say about it, and why there's very little chance they…

Don't click the link above. It may crash your browser.

------------------------------

Full text:

We often get complaints around Weboob‘s name, and the various application names.

There’s no denying they’re childish. What they are not, however, is sexist.

There is “boob” in the main name, and “boob” is a friendly name referring to (mostly female) breasts. We would, for example, avoid using “tits” or “cunt”, because they are often demeaning1. Though it is a happy accident (our earlier ideas like “woob” and “webob” were taken), we certainly like playing with that.

The idea is the same with application names; it’s all about friendly jokes (like wetboobs the weather tool, which manages to be related to weather and boobs).

If you’re offended, just ask yourself “how is it sexist?”.

As it appears, Weboob is a formidable tool to detect people that are part of the “be offended first, think later” crowd. Interestingly, the crusaders2 are to date all male, and often assert that women can’t like jokes about breasts or sex in general3. How fucked up is that?

They will always make a scene4 on how they’re never going to use Weboob because of names. Guys, here’s the thing: we don’t need you and we certainly don’t want you. I for one am glad we created an Asshole Detector, albeit by accident. We however are mostly not native English speakers. Mistakes can happen. [↩] This is not an euphemism. They act like they are fighting for a good cause, but it’s only pretend. [↩] And who the hell are they to talk in place of others? That is actual sexism. [↩] So that it is abundantly clear, this is purely about making a scene; I do not care about their opinions or how many penises they may have. All our contributors do not and do not have to like the branding. [↩]

Re: Web Scraping to Create Open Data

#26
post #19
post #4

Earlier quoted context omitted.

That naming scheme definitely needs a long, hard rethink.

It's funny, everytime Weboob is presented somewhere, and everytime there is a post about the latest version of Weboob, the first comment is a variation of "it's sexist/boobs are unprofessional/grow up", and very very little time is spent talking about the actual thing, what it does and why its only goal is to become irrelevant. Sad thing. Here's what they have to say about it, and why there's very little chance they…

Is that supposed to link me to http://no-hipsters-allowed.t28.net/ ?

Edit: it directs me properly in an incognito window.

Re: Web Scraping to Create Open Data

#27
post #19
post #4

Earlier quoted context omitted.

That naming scheme definitely needs a long, hard rethink.

It's funny, everytime Weboob is presented somewhere, and everytime there is a post about the latest version of Weboob, the first comment is a variation of "it's sexist/boobs are unprofessional/grow up", and very very little time is spent talking about the actual thing, what it does and why its only goal is to become irrelevant. Sad thing. Here's what they have to say about it, and why there's very little chance they…

Interesting — that link is either down, or it's set up to present several different troll responses depending on the http referrer.

When I click, I'm redirected to a simple image. When I request it in incognito mode, I'm redirected to a "crash safari" url.

Re: Web Scraping to Create Open Data

#28
post #19
post #4

Earlier quoted context omitted.

That naming scheme definitely needs a long, hard rethink.

It's funny, everytime Weboob is presented somewhere, and everytime there is a post about the latest version of Weboob, the first comment is a variation of "it's sexist/boobs are unprofessional/grow up", and very very little time is spent talking about the actual thing, what it does and why its only goal is to become irrelevant. Sad thing. Here's what they have to say about it, and why there's very little chance they…

If you have to write a blog post about how the sexism "crusaders" have it in for you, chances are you are the asshole.

I'm not offended by the name, I get the joke, I just think it's a stupid joke.

Re: Web Scraping to Create Open Data

#29
post #27
post #19

Earlier quoted context omitted.

It's funny, everytime Weboob is presented somewhere, and everytime there is a post about the latest version of Weboob, the first comment is a variation of "it's sexist/boobs are unprofessional/grow up", and very very little time is spent talking about the actual thing, what it does and why its only goal is to become irrelevant. Sad thing. Here's what they have to say about it, and why there's very little chance they…

Interesting — that link is either down, or it's set up to present several different troll responses depending on the http referrer. When I click, I'm redirected to a simple image. When I request it in incognito mode, I'm redirected to a "crash safari" url.

Hacker news referrer = social justice warrior hipsters it seems.

Re: Web Scraping to Create Open Data

#30
post #19

Earlier quoted context omitted.

It's funny, everytime Weboob is presented somewhere, and everytime there is a post about the latest version of Weboob, the first comment is a variation of "it's sexist/boobs are unprofessional/grow up", and very very little time is spent talking about the actual thing, what it does and why its only goal is to become irrelevant. Sad thing. Here's what they have to say about it, and why there's very little chance they…

> It's funny, everytime Weboob is presented somewhere, and everytime there is a post about the latest version of Weboob, the first comment is a variation of "it's sexist/boobs are unprofessional/grow up", and very very little time is spent talking about the actual thing Seems like a bad name then, no?

There is a legitimate argument to be made if the naming was unintentional or if people were making a big deal out of nothing.

But with Application names like 'Handjoob', 'Boobsize', and 'Flatboob', I think the naming is unavoidably distracting and inappropriate.

Post reply on HN