Earlier quoted context omitted.
serendipity heaven, but... how is this map of _your favorite_ blogs?
I started off with my favorite blogs and recursively explored from there based on what they linked to.
ok, got it.
Network visualization of 50k blogs and links
21–30 of 58 posts
Re: Network visualization of 50k blogs and links
#22Reminds me a little of my fav sub-reddit browsing tool - https://anvaka.github.io/map-of-reddit/
One nice feature that would be helpful is the ability to preview the blog.
Re: Network visualization of 50k blogs and links
#23Cool, I'm just wondering how come some nodes don't have any lines to/from them, does that mean they came from an initial seed list?
Re: Network visualization of 50k blogs and links
#24This is really awesome work! How did you classify so many links?
To get their topics? I used a basic louvain community detection algorithm, then put all the URLs into GPT with some few-shot prompting tricks to get it to output a particular topic. There's some heuristics to break up giant communities / combine small communities in there too.
Interesting, I was curious what I would be categorized as and it's "Whistleblowing and Leaks", which I do suppose is what my content has lately been to some extent but it was funny to see that written out.
My question for you is how can I see what sites link to me, as opposed to what sites I link to?
Re: Network visualization of 50k blogs and links
#25Any chance of getting a copy of the underlying dataset?
Re: Network visualization of 50k blogs and links
#26People still upvote hairball graphs every time. Fortunately there is a cure: https://cambridge-intelligence.com/how-to-fix-hairballs/
Also edge bundling can help. See the papers by Benjamin Bach et al.
Re: Network visualization of 50k blogs and links
#27I scraped my favorite blogs and made a graph from the domains that each blog links to. You can see clusters forming of websites that talk about similar topics, like crypto, rationality, Canada, India, and even postgres! The visualization was made entirely in webgl with some neat optimizations to render that many lines and circles.
This is very cool but also not accurate, at least for jakeseliger.com. Henryn.ca lists 0 links from jakeseliger.com to nytimes.com, reason.com, and numerous others that simple search demonstrates are linked to, for example: https://jakeseliger.com/?s=nytimes.com&submit=Search
I put up many links posts, so I probably link to an abnormally large number of sites.
Re: Network visualization of 50k blogs and links
#28what's the point of this?
Re: Network visualization of 50k blogs and links
#29Reminds me of my friend's visualisation of tracks on the popular London station NTS https://www.barneyhill.com/pages/nts-tracklists/. Turns out a lot of cool artists like the same tracks... ;)
Re: Network visualization of 50k blogs and links
#30Hmmm. My site is listed, but I have _way_ more inbound and outbound links than shown.
And I have my own internal links visualization, which might be a bit over the top (GPU recommended): https://taoofmac.com/static/graph