Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

A graph explorer of the Epstein emails

epstein-doc-explorer-1.onrender.com

Post reply on HN
Print view View original

61–70 of 172 posts

Re: A graph explorer of the Epstein emails

#61

Post by phatfish »

theultdev wrote: post #39
sanktanglia wrote: post #35

Earlier quoted context omitted.

Trump was with Epstein in 2017, he didn't cut ties at all

That's a lie that has already been proven false since Trump's entire trip was documented. Love how we have actual evidence against people but discussions always devolve into some conspiracy related to Trump. ---- Based on the available evidence, there is no confirmed meeting between Trump and Epstein in 2017. While both men were in Palm Beach during Thanksgiving week 2017, there is no direct evidence they met. Here's…

Thanks ChatGPT.

Re: A graph explorer of the Epstein emails

#62

Post by michelpp »

jandrewrogers wrote: post #49
pickpuck wrote: post #23

What if we extended this idea beyond one dataset to all discrete news events and entities: people, organizations, places. Just like here you could get a timeline of key events, a graph of connected entities, links to original documents. Newsrooms might already do this internally idk. This code might work as a foundation. I love that it's RDF.

This has been attempted many times. They all fail the same way. These general data models start to become useful and interesting at around a trillion edges, give or take an order of magnitude. A mature graph model would be at least a few orders of magnitude larger, even if you aggressively curated what went into it. This is a simple consequence of the cardinality of the different kinds of entities that are included i…

There are open source projects moving toward this scale, the GraphBLAS for example uses an algebraic formulation over compressed sparse matrix representations for graphs that is designed to be portable across many architectures, including cuda. It would be nice if companies like nivida could get more behind our efforts, as our main bottleneck is development hardware access.

To plug my project, I've wrapped the SuiteSparse GraphBLAS library in a postgres extension [1] that fluidly blends algebraic graph theory with the relational model, the main flow is to use sql to structure complex queries for starting points, and then use the graphblas to flow through the graph to the endpoints, then joining back to tables to get the relevant metadata. On cheap hetzner hardware (amd epyc 64 core) we've achieved 7 billion edges per second BFS over the largest graphs in the suitesparse collection (~10B edges). With our cuda support we hope to push that kind of performance into graphs with trillions of edges.

[1] https://github.com/OneSparse/OneSparse

Re: A graph explorer of the Epstein emails

#63

Post by afavour »

pickpuck wrote: post #23

What if we extended this idea beyond one dataset to all discrete news events and entities: people, organizations, places. Just like here you could get a timeline of key events, a graph of connected entities, links to original documents. Newsrooms might already do this internally idk. This code might work as a foundation. I love that it's RDF.

The New York Times has an API that lets you query “tags” or “topics” and the articles associated with them:

https://developer.nytimes.com/docs/semantic-api-product/1/ov...

The Guardian has similar:

https://open-platform.theguardian.com/documentation/tag

Either or both could be an interesting starting point for something like that. I tried to find something for the BBC and was surprised they didn’t have anything. I would have figured public media would have been a great resource for this.

Re: A graph explorer of the Epstein emails

#64

Post by JumpCrisscross »

hiccuphippo wrote: post #57
theultdev wrote: post #31

Earlier quoted context omitted.

Of course, deflect discussion to Trump. Does that make any of those other people look better to you? Trump gave information against Epstein in 2009 and unlike Bill and others did cut ties after learning he was poaching girls from Mar-a-Lago. I specifically made the point to look into those who were friends with Epstein even after knowing what he was doing. Nice whataboutism though. Feel free to reference source mater…

Well for one those other people are not the current president of the most powerful country in the world. But sure, lock all of them up, just don't ignore a few because they are too powerful.

It’s been wild to see people subsume not defending child rapists to their partisan identity.

I’m still convinced it’s a minority of loud voices online and on social media.

Re: A graph explorer of the Epstein emails

#65

Post by ggm »

pickpuck wrote: post #23

What if we extended this idea beyond one dataset to all discrete news events and entities: people, organizations, places. Just like here you could get a timeline of key events, a graph of connected entities, links to original documents. Newsrooms might already do this internally idk. This code might work as a foundation. I love that it's RDF.

Given 6 degrees is rooted in reality, this means we can draw causal graphs from anyone (bad) to anyone (we don't like) and then invent specious reasons why it means "it's all connected, man"

That said, some networks of shorter paths than 6 are interesting. Right now, there's a 1:1 direct path from these documents to a bunch of people with an interest in confounding what evidentiary value they have in justice processes. That's more interesting to me, than what the documents say right now.

Re: A graph explorer of the Epstein emails

#68

Post by stevage »

jandrewrogers wrote: post #49
pickpuck wrote: post #23

What if we extended this idea beyond one dataset to all discrete news events and entities: people, organizations, places. Just like here you could get a timeline of key events, a graph of connected entities, links to original documents. Newsrooms might already do this internally idk. This code might work as a foundation. I love that it's RDF.

This has been attempted many times. They all fail the same way. These general data models start to become useful and interesting at around a trillion edges, give or take an order of magnitude. A mature graph model would be at least a few orders of magnitude larger, even if you aggressively curated what went into it. This is a simple consequence of the cardinality of the different kinds of entities that are included i…

>These general data models start to become useful and interesting at around a trillion edges

That is a wild claim. Perhaps for some very specific definition of "useful and interesting"? This dataset is already interesting (hard to say whether it's useful) at a much tinier scale.

Re: A graph explorer of the Epstein emails

#70

Post by octoberfranklin »

theultdev wrote: post #21

This is the best rendition I've seen so far. The Bill Clinton entity is interesting. > 2009: Bill Clinton discontinued association with Jeffrey Epstein > 2010: Jeffrey Epstein provided flights on jets to Bill Clinton > 2010-2011: Jeffrey Epstein traveled via private aircraft with Bill Clinton > 2011: Ghislaine Maxwell piloted helicopter for Bill Clinton > 2014: Bill Clinton alleged presence at sex parties > 2015: Bil…

> Wasn't very good at discontinuing the relationship it seems.

Keep in mind that those summaries are AI-generated. There's gonna be a lot of confabulating in there.

Post reply on HN