Show HN: Six Degrees of Wikipedia • Hacker News Board

Re: Show HN: Six Degrees of Wikipedia

#351

Post by jwngr » Wed, Mar 07, 2018, 1:54 AM UTC

drej wrote: post #283

jwngr wrote: post #13

Creator here. Six Degrees of Wikipedia is a side project I've been sporadically hacking on over the past few years. It was an interesting technical challenge and it's fun to play with the end result. Here's the tech stack: * Frontend: React (Create React App) * Backend: Python Flask * Database: SQLite * Web (frontend) hosting: Firebase Hosting * Server (backend) hosting: Google Compute Engine (it runs fine on a tiny…

Looks pretty cool - do you have any plans to support subsites other than enwiki?

Possibly... follow this GitHub issue[1] if you want to be notified about it.

[1] https://github.com/jwngr/sdow/issues/11

Re: Show HN: Six Degrees of Wikipedia

#352

Post by SkylerASmith » Wed, Mar 07, 2018, 4:52 PM UTC

jwngr wrote: post #350

SkylerASmith wrote: post #349

Earlier quoted context omitted.

This is an awesome tool! I'm interested in building a fact checker from a wikipedia graph, and your SDOW seems like a great place to start (I'm intending to use an algorithm inspired from researchers at Indiana University http://journals.plos.org/plosone/article?id=10.1371/journal.... ). I was wondering if your database has a non-GUI API. Is there a URL or something I can hit to get back JSON or XML as a response?

I'd prefer you not send any additional load to my server (this is just a side project I'm paying out of pocket for), but you are welcome to download the data yourself. There are instructions in the project README[1] to download the SQLite files I use in the project and I should have documented enough about the schema for you to know what queries to make. I am happy to answer questions via GitHub issues if you have th…

That makes sense; thanks for your response!

Re: Show HN: Six Degrees of Wikipedia

#353

Post by trishume » Thu, Mar 08, 2018, 5:38 AM UTC

cyphar wrote: post #292

trishume wrote: post #245

Earlier quoted context omitted.

A few years ago I made something similar ( http://ratewith.science/ ) that only uses bi-directional links, that is pages that both link to each other, and this gives much more interesting results. When two Wikipedia pages both link to each other they are usually related in some reasonable way, but unidirectional links give you things like Wikipedia -> California, which only exists because Wikipedia is headquartered i…

Maybe I made a mistake somewhere, but I'm not sure it uses bi-directional links. For a really odd search like GoldenEye -> Abbotsford [1] it uses multiple "special" Wikipedia links that I'm pretty sure wouldn't be bidirectional. [1]: http://ratewith.science/#start=Goldeneye&stop=abbotsford

Yah so what it does is try to find a path with bidirectional links, and then if it can't it tries to find a unidirectional path. You can tell which one it did by whether the numbers in the path have a pulsing glow animation, that particular path does not.

Re: Show HN: Six Degrees of Wikipedia

#354

Post by nathanken » Fri, Mar 09, 2018, 3:00 AM UTC

jwngr wrote: post #259

nathanken wrote: post #249

Earlier quoted context omitted.

Really cool. I'm interested to know how the graph is build. Did you use any third party components.

Thank you! The graph is built using vanilla d3, no library on top of it. The code for it lives all in one file, ResultsGraph.js [1]. I pieced together the code from a handful of other attempts online. I am still not 100% pleased with the performance of it with a larger number of nodes (250+), but that seems to be a common complaint with the d3 force simulation layouts. [1] https://github.com/jwngr/sdow/blob/master/we…

Thanks for your reply.