Live data from Hacker News

A graph explorer of the Epstein emails

epstein-doc-explorer-1.onrender.com

51–60 of 172 posts

Re: A graph explorer of the Epstein emails

#51

What if we extended this idea beyond one dataset to all discrete news events and entities: people, organizations, places. Just like here you could get a timeline of key events, a graph of connected entities, links to original documents. Newsrooms might already do this internally idk. This code might work as a foundation. I love that it's RDF.

Emil Eifrem (founder of Neo4j) has a talk about them doing this with the Panama papers

Re: A graph explorer of the Epstein emails

#52

Earlier quoted context omitted.

[flagged]

Of course, deflect discussion to Trump. Does that make any of those other people look better to you? Trump gave information against Epstein in 2009 and unlike Bill and others did cut ties after learning he was poaching girls from Mar-a-Lago. I specifically made the point to look into those who were friends with Epstein even after knowing what he was doing. Nice whataboutism though. Feel free to reference source mater…

> Trump gave information against Epstein in 2009

Pre-2009 records on Trump there are nasty. One example:

> ... It was at these series of parties that I personally witnessed the Plaintiff being forced to perform various sexual acts with Donald J. Trump and Mr. Epstein. Both Mr. Trump and Mr. Epstein were advised that she was 13 years old. I personally witnessed four sexual encounters that the Plaintiff was forced to have with Mr. Trump during this period, including the fourth of these encounters where Mr. Trump forcibly raped her despite her pleas to stop.

Only difference between Clinton and Trump is that Trump is still president.

Re: A graph explorer of the Epstein emails

#53

Earlier quoted context omitted.

Trump was with Epstein in 2017, he didn't cut ties at all

That's a lie that has already been proven false since Trump's entire trip was documented. Love how we have actual evidence against people but discussions always devolve into some conspiracy related to Trump. ---- Based on the available evidence, there is no confirmed meeting between Trump and Epstein in 2017. While both men were in Palm Beach during Thanksgiving week 2017, there is no direct evidence they met. Here's…

Even if Trump cut off ties with Epstein in 2017, he should clearly be held accountable for his past actions. Here's 2 pretty damning emails:

---

Epstein to Maxwell 2011-04-02

> i want you to realize that that dog that hasn’t barked is trump... [VICTIM] spent hours at my house with him ,, he has never once been mentioned. police chief. etc. im 75% there

---

Epstein to Ruemmler 2018-08-23

> you see, i know how dirty donald is. my guess is that non lawyers ny biz people have no idea. what it means to have your fixer flip

Re: A graph explorer of the Epstein emails

#54
post #53

Earlier quoted context omitted.

That's a lie that has already been proven false since Trump's entire trip was documented. Love how we have actual evidence against people but discussions always devolve into some conspiracy related to Trump. ---- Based on the available evidence, there is no confirmed meeting between Trump and Epstein in 2017. While both men were in Palm Beach during Thanksgiving week 2017, there is no direct evidence they met. Here's…

Even if Trump cut off ties with Epstein in 2017, he should clearly be held accountable for his past actions. Here's 2 pretty damning emails: --- Epstein to Maxwell 2011-04-02 > i want you to realize that that dog that hasn’t barked is trump... [VICTIM] spent hours at my house with him ,, he has never once been mentioned. police chief. etc. im 75% there --- Epstein to Ruemmler 2018-08-23 > you see, i know how dirty do…

[flagged]

Re: A graph explorer of the Epstein emails

#56

Earlier quoted context omitted.

[flagged]

Of course, deflect discussion to Trump. Does that make any of those other people look better to you? Trump gave information against Epstein in 2009 and unlike Bill and others did cut ties after learning he was poaching girls from Mar-a-Lago. I specifically made the point to look into those who were friends with Epstein even after knowing what he was doing. Nice whataboutism though. Feel free to reference source mater…

Clinton at least has not been in office for 25 years. Trump is still in office. Surely the priority should be to get the bad people out of institutions asap...?

Re: A graph explorer of the Epstein emails

#57

Earlier quoted context omitted.

[flagged]

Of course, deflect discussion to Trump. Does that make any of those other people look better to you? Trump gave information against Epstein in 2009 and unlike Bill and others did cut ties after learning he was poaching girls from Mar-a-Lago. I specifically made the point to look into those who were friends with Epstein even after knowing what he was doing. Nice whataboutism though. Feel free to reference source mater…

Well for one those other people are not the current president of the most powerful country in the world.

But sure, lock all of them up, just don't ignore a few because they are too powerful.

Re: A graph explorer of the Epstein emails

#58
It's a bit too bad that the network visualisation relies on d3: it is really slow with big networks, and the force directed algorithm is far from the best. Have you tried using JS libraries built specifically to visualise graph networks such as Sigma.js, Vivagraph or Cytoscape?

Re: A graph explorer of the Epstein emails

#59

It's a bit too bad that the network visualisation relies on d3: it is really slow with big networks, and the force directed algorithm is far from the best. Have you tried using JS libraries built specifically to visualise graph networks such as Sigma.js, Vivagraph or Cytoscape?

Shameless plug: if OP is looking to stay on d3, he could also try slotting in my C++/WASM versions[1] of the main d3 many-body forces. Not the best, but I've found >3x speedup using these for periplus.app :)

[^1]: https://www.npmjs.com/package/d3-manybody-wasm

Re: A graph explorer of the Epstein emails

#60

Earlier quoted context omitted.

This has been attempted many times. They all fail the same way. These general data models start to become useful and interesting at around a trillion edges, give or take an order of magnitude. A mature graph model would be at least a few orders of magnitude larger, even if you aggressively curated what went into it. This is a simple consequence of the cardinality of the different kinds of entities that are included i…

I don't have any experience on graph modeling, but it seems like Neo4j should be able to support 1 trillion edges, based on this (admittedly marketing) post of theirs? https://neo4j.com/press-releases/neo4j-scales-trillion-plus-...

The graph database market has a deserved reputation for carefully crafting scaling claims that are so narrowly qualified as to be inapplicable to anything real. If you aren't deep into the tech you'll likely miss it in the press releases. It is an industry-wide problem, I'm not trying to single out Neo4j here.

Using this press release as an example, if you pay attention to the details you'll notice that this graph has an anomalously low degree. That is, the graph is very weakly connected, lots of nodes and barely any edges. Typical graph data models have much higher connectivity than this. For example, the classic Graph500 benchmark uses an average degree of 16 to measure scale-out performance.

So why did they nerf the graph connectivity? One of the most fundamental challenges in scaling graphs is optimally cutting them into shards. Unlike most data models, no matter how you cut up the graph some edges will always span multiple shards, which becomes a nasty consistency problem in scale-out systems. Scaling this becomes exponentially harder the more highly connected the graph. So basically, they defined away the problem that makes graphs difficult to scale. They used a graph so weakly connected that they could kinda sorta make it work on a thousand(!) machines even though it is not representative of most real-world graph data models.

Post reply on HN