Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Hacker News “Who is Hiring?” top-level comments over time

blog.joewoods.dev

Post reply on HN
Print view View original

81–90 of 126 posts

Re: Hacker News “Who is Hiring?” top-level comments over time

#81

Post by tobr »

minimaxir wrote: post #16

A reminder that all Hacker News posts and comments are available on BigQuery and can be queried for free: https://console.cloud.google.com/marketplace/details/y-combi... (the `full` table is up-to-date; ignore the others) Here's a query for a rough reproduction of what's asked in the title: WITH whoishiring_threads AS ( SELECT id FROM `bigquery-public-data.hacker_news.full` WHERE `by` = "whoishiring" AND REGEXP_CONTA…

> all Hacker News posts and comments are available on BigQuery and can be queried for free

Good thing there aren’t any laws that regulate copyright or privacy, so datasets like this can be published without asking users for consent.

Re: Hacker News “Who is Hiring?” top-level comments over time

#82

Post by skrebbel »

tobr wrote: post #81
minimaxir wrote: post #16

A reminder that all Hacker News posts and comments are available on BigQuery and can be queried for free: https://console.cloud.google.com/marketplace/details/y-combi... (the `full` table is up-to-date; ignore the others) Here's a query for a rough reproduction of what's asked in the title: WITH whoishiring_threads AS ( SELECT id FROM `bigquery-public-data.hacker_news.full` WHERE `by` = "whoishiring" AND REGEXP_CONTA…

> all Hacker News posts and comments are available on BigQuery and can be queried for free Good thing there aren’t any laws that regulate copyright or privacy, so datasets like this can be published without asking users for consent.

Anybody could crawl HN and build up the exact same dataset. You choose to publish your words for the world to consume when you submit a comment.

Re: Hacker News “Who is Hiring?” top-level comments over time

#83

Post by weird-eye-issue »

yesbabyyes wrote: post #70
danuker wrote: post #65

Earlier quoted context omitted.

> zero caching When each request is from a different person, you get essentially zero cache. Nope, server-side caching reduces back-end processing.

There are multiple strategies for caching in the server, without them IIRC the php code will be interpreted on each request, files parsed, and obviously hit the database for each request. There's fastcgi caching in nginx, php opcode in php-fpm, and WP specific cave plugins like Super Cache. At least this was the case ~10 years ago.

Also for $5/mo you can use Cloudflare APO to cache WordPress pages at the edge. Yes it will cache even the "dynamic" pages (unless you're logged in of course)

Re: Hacker News “Who is Hiring?” top-level comments over time

#88

Post by tobr »

skrebbel wrote: post #82
tobr wrote: post #81

Earlier quoted context omitted.

> all Hacker News posts and comments are available on BigQuery and can be queried for free Good thing there aren’t any laws that regulate copyright or privacy, so datasets like this can be published without asking users for consent.

Anybody could crawl HN and build up the exact same dataset. You choose to publish your words for the world to consume when you submit a comment.

It’s not less illegal because anyone could do it. I have copyright to my comments, and many of them can be considered personal data, especially if they are connected to my username. My rights are not waived because I publish something publicly.

Re: Hacker News “Who is Hiring?” top-level comments over time

#89

Post by russellendicott »

DeathArrow wrote: post #57
tjwds wrote: post #2

Thanks for hugging my site to death! It's hosted on a $5 DO droplet and I'm honored to have this problem. https://archive.ph/AVbPV

Now you can write another article about how you optimized the site to handle HN traffic. :)

I love this idea: "Cheapest way to run a static site that can handle hugs of death".

Re: Hacker News “Who is Hiring?” top-level comments over time

#90

Post by dereg »

tobr wrote: post #88
skrebbel wrote: post #82

Earlier quoted context omitted.

Anybody could crawl HN and build up the exact same dataset. You choose to publish your words for the world to consume when you submit a comment.

It’s not less illegal because anyone could do it. I have copyright to my comments, and many of them can be considered personal data, especially if they are connected to my username. My rights are not waived because I publish something publicly.

Puzzling comment. Perhaps you should read the Terms of Service.

  User Content Transmitted Through the Site: With respect to the content or other materials you upload through the Site or share with other users or recipients (collectively, “User Content”), you represent and warrant that you own all right, title and interest in and to such User Content, including, without limitation, all copyrights and rights of publicity contained therein. By uploading any User Content you hereby grant and will grant Y Combinator and its affiliated companies a nonexclusive, worldwide, royalty free, fully paid up, transferable, sublicensable, perpetual, irrevocable license to copy, display, upload, perform, distribute, store, modify and otherwise use your User Content for any Y Combinator-related purpose in any form, medium or technology now known or later developed. However, please review the Applications Privacy Policy located at https://www.ycombinator.com/apply/privacy, for more information on how we treat information included in applications submitted to us.
https://www.ycombinator.com/legal/
Post reply on HN