Live data from Hacker News

Probability, Mathematical Statistics, Stochastic Processes

randomservices.org

11–14 of 14 posts

Re: Probability, Mathematical Statistics, Stochastic Processes

#11

To the programmer, developer or casual visitor looking at this and wondering whether it's worth the time and effort to dig into this, it is. Most of what's covered here can be understood with undergrad calculus, and will give you a solid basis for understanding and modelling random phenomena you may encounter in your studies, work or hobby. Fun fact to get you started, Nakamoto suggested in the original Bitcoin paper…

Calculus 2,3 and Real Analysis can also be understood with undergrad calculus.

:)

Re: Probability, Mathematical Statistics, Stochastic Processes

#12

Earlier quoted context omitted.

It's definitely not a homogenous Poisson process, mainly because of the random changes to mining difficulty and propagation delays. There's a good paper here looking at block arrival times and fitting some different models - https://arxiv.org/pdf/1801.07447.pdf

Is Figure 8 an unconditional empirical CDF of inter-arrival times? Apart from the heavy right tail (which covers ~0.01% of the data), it looks pretty exponential to me. If I'm understanding what I'm seeing, it sounds like like the homogeneous Poisson assumption was pretty solid. Especially considering its purpose. Maybe it would have been more accurate to say "there's a mixture of two Poissons: the bulk and the netwo…

> Is Figure 8 an unconditional empirical CDF of inter-arrival times?

My understanding is that it's the inter-arrival times after some cleaning and resampling. If I've understood correctly, when they resampled the data, they did so uniformly between the neighbours of the points they omitted, which would actually make the data appear more like an exponential distribution.

> Especially considering its purpose. Maybe it would have been more accurate to say "there's a mixture of two Poissons: the bulk and the network disruption".

Could be. Could also follow a power law or a phase type distribution.

> But this isn't physics. We want to know how useful the approximation is, and whether there is a similarly tractable one with better predictive power.

It's worse, it's math :-) I take your point though, it all comes down to what you're trying to do. If inter-arrival times did follow an exponential distribution with parameter $\lambda$, then we'd have finite variance and I'd be pretty confident that I could build a performant predictive model. The presence of a heavy right tail makes me think otherwise.

Re: Probability, Mathematical Statistics, Stochastic Processes

#13

To the programmer, developer or casual visitor looking at this and wondering whether it's worth the time and effort to dig into this, it is. Most of what's covered here can be understood with undergrad calculus, and will give you a solid basis for understanding and modelling random phenomena you may encounter in your studies, work or hobby. Fun fact to get you started, Nakamoto suggested in the original Bitcoin paper…

I remember reading. That equation and it never made sense interms of where it actually fit in bitcoins code.

Thanks for elaborating

Re: Probability, Mathematical Statistics, Stochastic Processes

#14

Earlier quoted context omitted.

Is Figure 8 an unconditional empirical CDF of inter-arrival times? Apart from the heavy right tail (which covers ~0.01% of the data), it looks pretty exponential to me. If I'm understanding what I'm seeing, it sounds like like the homogeneous Poisson assumption was pretty solid. Especially considering its purpose. Maybe it would have been more accurate to say "there's a mixture of two Poissons: the bulk and the netwo…

> Is Figure 8 an unconditional empirical CDF of inter-arrival times? My understanding is that it's the inter-arrival times after some cleaning and resampling. If I've understood correctly, when they resampled the data, they did so uniformly between the neighbours of the points they omitted, which would actually make the data appear more like an exponential distribution. > Especially considering its purpose. Maybe it…

Its been a while, but I just read an article arguing the case that Len Sassaman was a Satoshi. It was a neat article, so I watched one of Len's Defcon talks about remailers from waaay back in the day.

In his talk, Len mentioned that most remailer security analysis assumes homogeneous Poisson email arrivals. He pointed out how bad an assumption that is for email.

I still think it was a solid assumption in the Bitcoin white paper.

https://leung-btc.medium.com/len-sassaman-and-satoshi-e483c8...

Post reply on HN