Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Hacker News archive (47M+ items, 11.6GB) as Parquet, updated every 5m

huggingface.co

Post reply on HN
Print view View original

91–100 of 178 posts

Re: Show HN: Hacker News archive (47M+ items, 11.6GB) as Parquet, updated every 5m

#93

Post by trwhite »

RIMR wrote: post #91
trwhite wrote: post #90

Hello. I didn’t consent to any of my HN comments being used in this way. Please kindly remove them.

You absolutely did consent to this. https://www.ycombinator.com/legal/ See: User Content Transmitted Through the Site

I’m reading that paragraph now and fail to see anything about a relationship with huggingface or the user responsible for copying the data.

Re: Show HN: Hacker News archive (47M+ items, 11.6GB) as Parquet, updated every 5m

#94

Post by Kye »

RIMR wrote: post #91
trwhite wrote: post #90

Hello. I didn’t consent to any of my HN comments being used in this way. Please kindly remove them.

You absolutely did consent to this. https://www.ycombinator.com/legal/ See: User Content Transmitted Through the Site

This isn't presented anywhere on signup.

Re: Show HN: Hacker News archive (47M+ items, 11.6GB) as Parquet, updated every 5m

#95

Post by s0ss »

RIMR wrote: post #91
trwhite wrote: post #90

Hello. I didn’t consent to any of my HN comments being used in this way. Please kindly remove them.

You absolutely did consent to this. https://www.ycombinator.com/legal/ See: User Content Transmitted Through the Site

Only Y Combinator and its affiliated companies have license, me thinks.

Re: Show HN: Hacker News archive (47M+ items, 11.6GB) as Parquet, updated every 5m

#97

Post by cj »

RIMR wrote: post #91
trwhite wrote: post #90

Hello. I didn’t consent to any of my HN comments being used in this way. Please kindly remove them.

You absolutely did consent to this. https://www.ycombinator.com/legal/ See: User Content Transmitted Through the Site

To be incredibly pedantic to the point of being irrelevant: technically the sign up page 1) doesn't have a clickwrap "I agree" checkbox, and 2) there's no link to the TOS on the sign up page.

That makes the implicit TOS agreement legally confusing depending on jurisdiction.

(Not that it really matters, but I find these technicalities amusing)

Re: Show HN: Hacker News archive (47M+ items, 11.6GB) as Parquet, updated every 5m

#98

Post by trwhite »

RIMR wrote: post #91
trwhite wrote: post #90

Hello. I didn’t consent to any of my HN comments being used in this way. Please kindly remove them.

You absolutely did consent to this. https://www.ycombinator.com/legal/ See: User Content Transmitted Through the Site

@dang What’s Hacker News’ official stance on this?

Re: Show HN: Hacker News archive (47M+ items, 11.6GB) as Parquet, updated every 5m

#99

Post by boznz »

gkbrk wrote: post #9

My Hacker News items table in ClickHouse has 47,428,860 items, and it's 5.82 GB compressed and 18.18 GB uncompressed. What makes Parquet compression worse here, when both formats are columnar?

.. and Remove all the political shit-slop since COVID/AI and it's probably under a gig.

Re: Show HN: Hacker News archive (47M+ items, 11.6GB) as Parquet, updated every 5m

#100

Post by sockaddr »

imhoguy wrote: post #62

Yay! So much knowledge in just 11GB. Adding to my end of the World hoarding stash!

Your family is starving and your dog died of radiation poisoning from the fallout but at least your local LLM can browse this and recommend a good software stack for your automated booby traps.
Post reply on HN