Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: BigQuery dataset: 22M FCC comments on net neutrality

bigquery.cloud.google.com

Post reply on HN
Print view View original

1–10 of 20 posts

Re: Show HN: BigQuery dataset: 22M FCC comments on net neutrality

#4

Post by striking »

gggggggg wrote: post #2

I dont have a google account, can anyone re-post any of this?

Here's the preview offered of the table "17108_comments", in JSON format: http://sprunge.us/CeWh

There's also a table of throwaway email addresses and a view called "frequency_and_unique_comment_by_domain".

Consider getting a throwaway Google account, BigQuery's basically unusable without one.

Re: Show HN: BigQuery dataset: 22M FCC comments on net neutrality

#5

Post by ImJasonH »

ImJasonH wrote: post #3

1,525,564 records (6.8%) seemingly generated from https://www.battleforthenet.com/ > SELECT COUNT(*) FROM [jyang:fcc_ecfs.17108_comments] WHERE comment LIKE "The FCC's Open Internet Rules (net neutrality rules) are extremely important to me.%"

Most popular comment openings:

> SELECT COUNT(*) c, SUBSTR(comment, 0, 100) pre FROM [jyang:fcc_ecfs.17108_comments] GROUP BY pre ORDER BY c DESC LIMIT 10;

Re: Show HN: BigQuery dataset: 22M FCC comments on net neutrality

#6

Post by iokevins »

ImJasonH wrote: post #5
ImJasonH wrote: post #3

1,525,564 records (6.8%) seemingly generated from https://www.battleforthenet.com/ > SELECT COUNT(*) FROM [jyang:fcc_ecfs.17108_comments] WHERE comment LIKE "The FCC's Open Internet Rules (net neutrality rules) are extremely important to me.%"

Most popular comment openings: > SELECT COUNT(*) c, SUBSTR(comment, 0, 100) pre FROM [jyang:fcc_ecfs.17108_comments] GROUP BY pre ORDER BY c DESC LIMIT 10;

1 1,523,300 The FCC's Open Internet Rules (net neutrality rules) are extremely important to me. I urge you to pr

2 1,359,677 In 2015, Chairman Tom Wheeler’s Federal Communications Commission (FCC) imposed restrictive Title II

3 1,283,663 Before leaving office, the Obama Administration rammed through a massive scheme that gave the federa

4 958,487 The current FCC regulatory scheme known as "Title II" represents an unprecedented increase in govern

5 818,815 The unprecedented regulatory power the Obama Administration imposed on the internet is smothering in

6 657,153 As a concerned taxpayer and consumer, I am writing to urge the FCC to set the internet free and remo

7 531,981 The Obama-era FCC regulations known as "Title II" enable the federal government to exert an extraord

8 452,764 I am in favor of strong net neutrality under Title II of the Telecommunications Act. Sincerely, Ma

9 450,914 The Open Internet rules (net neutrality) are extremely important to me. I don't want the ISP to have

10 380,872 I am in favor of strong net neutrality under Title II of the Telecommunications Act. Sincerely, Jo

Re: Show HN: BigQuery dataset: 22M FCC comments on net neutrality

#7

Post by alexandercrohde »

Looks like there are about 255,640-460,552 truly unique (i.e. hand-written) comments roughly (1-2%).

SELECT count(1) as cnt, substr(comment, 0,30) as abbrev_comment FROM [jyang:fcc_ecfs.17108_comments] GROUP BY abbrev_comment order by cnt DESC LIMIT 1000000

Re: Show HN: BigQuery dataset: 22M FCC comments on net neutrality

#8

Post by simcop2387 »

iokevins wrote: post #6
ImJasonH wrote: post #5

Earlier quoted context omitted.

Most popular comment openings: > SELECT COUNT(*) c, SUBSTR(comment, 0, 100) pre FROM [jyang:fcc_ecfs.17108_comments] GROUP BY pre ORDER BY c DESC LIMIT 10;

1 1,523,300 The FCC's Open Internet Rules (net neutrality rules) are extremely important to me. I urge you to pr 2 1,359,677 In 2015, Chairman Tom Wheeler’s Federal Communications Commission (FCC) imposed restrictive Title II 3 1,283,663 Before leaving office, the Obama Administration rammed through a massive scheme that gave the federa 4 958,487 The current FCC regulatory scheme known as "Title II" represents an unp…

From the looks of it, 8 and 10 are likely the same. Shrinking the preamble check by a few characters will likely make them show up better and get a better idea of the last few entries in the top 10.

Re: Show HN: BigQuery dataset: 22M FCC comments on net neutrality

#9

Post by [deleted] »

striking wrote: post #4
gggggggg wrote: post #2

I dont have a google account, can anyone re-post any of this?

Here's the preview offered of the table "17108_comments", in JSON format: http://sprunge.us/CeWh There's also a table of throwaway email addresses and a view called "frequency_and_unique_comment_by_domain". Consider getting a throwaway Google account, BigQuery's basically unusable without one.

[deleted]

Re: Show HN: BigQuery dataset: 22M FCC comments on net neutrality

#10

Post by beager »

iokevins wrote: post #6
ImJasonH wrote: post #5

Earlier quoted context omitted.

Most popular comment openings: > SELECT COUNT(*) c, SUBSTR(comment, 0, 100) pre FROM [jyang:fcc_ecfs.17108_comments] GROUP BY pre ORDER BY c DESC LIMIT 10;

1 1,523,300 The FCC's Open Internet Rules (net neutrality rules) are extremely important to me. I urge you to pr 2 1,359,677 In 2015, Chairman Tom Wheeler’s Federal Communications Commission (FCC) imposed restrictive Title II 3 1,283,663 Before leaving office, the Obama Administration rammed through a massive scheme that gave the federa 4 958,487 The current FCC regulatory scheme known as "Title II" represents an unp…

Take the substr down and I think 8 and 10 combine and may include a very large number of additional matches.
Post reply on HN