Live data from Hacker News

Show HN: Hacker News archive (47M+ items, 11.6GB) as Parquet, updated every 5m

huggingface.co

21–30 of 178 posts

Re: Show HN: Hacker News archive (47M+ items, 11.6GB) as Parquet, updated every 5m

#21

is the legal page a placeholder, do words have no meaning? https://www.ycombinator.com/legal/ Mods, enforce your license terms, you're playing fast and loose with the law (GDPR/CPRA)

Eh, fuck that agreement. I'm kind of old school in that I believe if you put it on the internet without an auth-wall, people should be allowed to do whatever they want with it. The AI companies seem to agree.

Then again, I'm not the guy that is going to get sued...

Re: Show HN: Hacker News archive (47M+ items, 11.6GB) as Parquet, updated every 5m

#22
post #10

Earlier quoted context omitted.

Which terms are not being enforced? (not disagreeing I just don't feel like reading a large legal document)

> By uploading any User Content you hereby grant and will grant Y Combinator and its affiliated companies The user content is supposed to be licensed only Y Combinator and (bleah) its affiliated companies (which are many, all the startups they fund, for example).

That agreement is largely about "Personal Information", not the posts and comments.

That said, there are "no scraping" and "commercial use restricted" carve-outs for the content on HN. Which honestly is bullshit.

Re: Show HN: Hacker News archive (47M+ items, 11.6GB) as Parquet, updated every 5m

#23
post #10

Earlier quoted context omitted.

Which terms are not being enforced? (not disagreeing I just don't feel like reading a large legal document)

> By uploading any User Content you hereby grant and will grant Y Combinator and its affiliated companies The user content is supposed to be licensed only Y Combinator and (bleah) its affiliated companies (which are many, all the startups they fund, for example).

Curious why it should be on HackerNews to enforce restrictions on content they only license from you?

If it's owned by you and only licensed by HN shouldn't you be the one enforcing it?

Re: Show HN: Hacker News archive (47M+ items, 11.6GB) as Parquet, updated every 5m

#24
post #10

Earlier quoted context omitted.

Which terms are not being enforced? (not disagreeing I just don't feel like reading a large legal document)

> By uploading any User Content you hereby grant and will grant Y Combinator and its affiliated companies The user content is supposed to be licensed only Y Combinator and (bleah) its affiliated companies (which are many, all the startups they fund, for example).

If you carry on the quote two more words:

> ... a nonexclusive

I.e. this section is talking to additional rights to the content you post to ALSO go to YC, not that YC is guaranteeing it (+friends) will be the only one to hold these rights or will enforce who else should hold the rights to your publicly shared content for you.

There's a more intricate conversation to be had with GDPR and public data on forums in general but that's wholly unrelated to what YC's legal page says and still unlikely to end up in an alarming result.

Re: Show HN: Hacker News archive (47M+ items, 11.6GB) as Parquet, updated every 5m

#25
post #21

is the legal page a placeholder, do words have no meaning? https://www.ycombinator.com/legal/ Mods, enforce your license terms, you're playing fast and loose with the law (GDPR/CPRA)

Eh, fuck that agreement. I'm kind of old school in that I believe if you put it on the internet without an auth-wall, people should be allowed to do whatever they want with it. The AI companies seem to agree. Then again, I'm not the guy that is going to get sued...

> I believe if you put it on the internet without an auth-wall, people should be allowed to do whatever they want with it.

I agree. It's the owners of the sites that have to follow rules, not us.

Re: Show HN: Hacker News archive (47M+ items, 11.6GB) as Parquet, updated every 5m

#29
post #21

is the legal page a placeholder, do words have no meaning? https://www.ycombinator.com/legal/ Mods, enforce your license terms, you're playing fast and loose with the law (GDPR/CPRA)

Eh, fuck that agreement. I'm kind of old school in that I believe if you put it on the internet without an auth-wall, people should be allowed to do whatever they want with it. The AI companies seem to agree. Then again, I'm not the guy that is going to get sued...

"I'm kind of old school in that I believe if you put grass on the ground without a fence, people should be allowed to do whatever they want with it. The noblemen with a thousand cows seem to agree."

And that, my friends, is how you kill the commons - by ignoring the social context surrounding its maintenance and insisting upon the most punitive ways of avoiding abuse.

Re: Show HN: Hacker News archive (47M+ items, 11.6GB) as Parquet, updated every 5m

#30
post #5

> At midnight UTC, the entire current month is refetched from the source as a single authoritative Parquet file, and today's individual 5-minute blocks are removed from the today/ directory. Wouldn't that lose deleted/moderated comments?

I guess that's the point.
Post reply on HN