Live data from Hacker News

US Presidential Election $25k Database Bounty Review

dolthub.com

1–10 of 38 posts

Re: US Presidential Election $25k Database Bounty Review

#3

This “data bounty” thing is really cool.

I participated in this bounty, it was a blast.

The team at Dolthub is great and extremely accessible on their discord. These bounties seem like a great use case for their tech.

If you're into git and data (like I am) then these bounties are just awesome.

Re: US Presidential Election $25k Database Bounty Review

#4

This “data bounty” thing is really cool.

I participated in this bounty, it was a blast. The team at Dolthub is great and extremely accessible on their discord. These bounties seem like a great use case for their tech. If you're into git and data (like I am) then these bounties are just awesome.

So you acquired and preprocessed some data for them? How did they verify its correctness?

I agree this looks like a great enterprise.

Re: US Presidential Election $25k Database Bounty Review

#5
post #4

Earlier quoted context omitted.

I participated in this bounty, it was a blast. The team at Dolthub is great and extremely accessible on their discord. These bounties seem like a great use case for their tech. If you're into git and data (like I am) then these bounties are just awesome.

So you acquired and preprocessed some data for them? How did they verify its correctness? I agree this looks like a great enterprise.

So data was accepted via pull requests.

The maintainer will review a PR and either accept the PR or ask you to modify it to better fit their requirements or reject it.

For example one of their requirements were no 0 vote rows. So that's a pretty simple SQL query on the database and can be checked before the maintainer does a merge.

All data was required to be sourced. I got most of my data from state and county websites so those links were included with the comments in the PR.

In addition I was in communication with the team via their discord so they would ask for changes to PRs from there also.

Re: US Presidential Election $25k Database Bounty Review

#7
post #4

Earlier quoted context omitted.

So you acquired and preprocessed some data for them? How did they verify its correctness? I agree this looks like a great enterprise.

So data was accepted via pull requests. The maintainer will review a PR and either accept the PR or ask you to modify it to better fit their requirements or reject it. For example one of their requirements were no 0 vote rows. So that's a pretty simple SQL query on the database and can be checked before the maintainer does a merge. All data was required to be sourced. I got most of my data from state and county websi…

Interesting, thanks for sharing. So for the latest one where they have a bounty for assembling the largest healthcare dataset -- how do they determine who gets what portion of the bounty? It's not just winner takes all right?

This data looks cool too, I'll have a look in the Discord...

Re: US Presidential Election $25k Database Bounty Review

#8
This is interesting, but why isn't this data easily available by default? I understand that the Presidential Election is actually a separate election in each state, but why wouldn't each state's election authority make that data readily available by default? This really feels like data that should just be out there for anyone to download and analyze.

In Canada, the equivalent data is readily available from Elections Canada[0]. For Provincial elections, the story is a bit more mixed, but open by default is the general rule. Elections Alberta, for example, provides Excel files with poll-by-poll results[1] - it's not as easy to work with as Elections Canada's CSVs, but a little Python can get it into a more reasonable format.

[0] https://www.elections.ca/content.aspx?section=res&dir=rep/of...

[1] https://officialresults.elections.ab.ca/orResultsPGE.cfm?Eve...

Re: US Presidential Election $25k Database Bounty Review

#9

So is this basically a combination of Mechanical Turk and a bug bounty? Say I decided to skip work tomorrow and try to get a bounty, or at least part of one. What do I do?

Hospital data bounty is the only one they have running right now but that one is still early so there's lots left to do and plenty of data left to source.

They are launching another bounty later this week for college course data.

Re: US Presidential Election $25k Database Bounty Review

#10
post #7

Earlier quoted context omitted.

So data was accepted via pull requests. The maintainer will review a PR and either accept the PR or ask you to modify it to better fit their requirements or reject it. For example one of their requirements were no 0 vote rows. So that's a pretty simple SQL query on the database and can be checked before the maintainer does a merge. All data was required to be sourced. I got most of my data from state and county websi…

Interesting, thanks for sharing. So for the latest one where they have a bounty for assembling the largest healthcare dataset -- how do they determine who gets what portion of the bounty? It's not just winner takes all right? This data looks cool too, I'll have a look in the Discord...

It's divided based upon total additions to the final data set I believe. They have github repo for their bounty board that shows that calculation I think.

I think the final calculation is based on the percent you've added to the final dataset.

edit:

yeah here's the repo that calculates the final payment. https://github.com/dolthub/bounties

Post reply on HN