Network visualization of 50k blogs and links
graph.henryn.ca
Network visualization of 50k blogs and links
1–10 of 58 posts
Re: Network visualization of 50k blogs and links
#2I scraped my favorite blogs and made a graph from the domains that each blog links to.
You can see clusters forming of websites that talk about similar topics, like crypto, rationality, Canada, India, and even postgres!
The visualization was made entirely in webgl with some neat optimizations to render that many lines and circles.
Re: Network visualization of 50k blogs and links
#3Awesome, I've always wanted to build something like that on top of YaCy just so that I could properly select new potentially interesting sites to index. (I can't rely on the auto-index unfortunately because it has no option to pre-confirm before indexing.)
Re: Network visualization of 50k blogs and links
#4This is neat, found my blog in there. Don't think I linked to NatGeo at any point, though.
adithyabalaji.com
Re: Network visualization of 50k blogs and links
#5This is really awesome work! How did you classify so many links?
Re: Network visualization of 50k blogs and links
#6I scraped my favorite blogs and made a graph from the domains that each blog links to. You can see clusters forming of websites that talk about similar topics, like crypto, rationality, Canada, India, and even postgres! The visualization was made entirely in webgl with some neat optimizations to render that many lines and circles.
Very neat! So you wrote the graph visualization UI? I see in prior project you used cytoscape - any motivation for doing it yourself this time (vs one of the available libraries)?
Re: Network visualization of 50k blogs and links
#7This is neat, found my blog in there. Don't think I linked to NatGeo at any point, though. adithyabalaji.com
Nice! I looked through the logs and saw that you linked to it in this article: https://www.adithyabalaji.com/datascience/2021/05/17/Analyzi...
Re: Network visualization of 50k blogs and links
#8I scraped my favorite blogs and made a graph from the domains that each blog links to. You can see clusters forming of websites that talk about similar topics, like crypto, rationality, Canada, India, and even postgres! The visualization was made entirely in webgl with some neat optimizations to render that many lines and circles.
This is a really cool project! I'd love to hear more about how your built the front end.
Re: Network visualization of 50k blogs and links
#9I scraped my favorite blogs and made a graph from the domains that each blog links to. You can see clusters forming of websites that talk about similar topics, like crypto, rationality, Canada, India, and even postgres! The visualization was made entirely in webgl with some neat optimizations to render that many lines and circles.
serendipity heaven, but... how is this map of _your favorite_ blogs?
Re: Network visualization of 50k blogs and links
#10Scraped 10k blogs some time ago. Only like 20 of them had /ideas page, sad :(