Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Polya Urn Simulation

observablehq.com

Post reply on HN
Print view View original

11–20 of 21 posts

Re: Polya Urn Simulation

#11

Post by fjfaase »

theK wrote: post #5

> After a large number of picks, what is the behavior of the proportion of red balls in the urn Isn’t the more enticing question how strong the bias towards the first picked Color is?

The rather boring answer is 2/3. Logic seems to indicate that it will be a linear distribution where the change for only balls of the first picked Color is maximum and only balls of the other Color is zero, because it is no longer possible to only pick balls of the other Color. It must be linear because it needs to be symmetric and lead to a uniform distribution if added together.

After two picks, you have three cases. If you picked two different colored balls, the distribution should be a uniform distribution again, just like the initial state. The two other distribution should mirror eachother, and thus be linear again.

Maybe that something interesting happens with three picks. Or maybe, you always end up with linear distributions with tilted slopes. In that case it is rather boring.

Re: Polya Urn Simulation

#12

Post by foobarbecue »

kgwgk wrote: post #7
foobarbecue wrote: post #3

Earlier quoted context omitted.

Me too, but only because I was expecting something interesting to happen since it was on HN!

The uniform distribution result is not interesting enough for you?

Oh, I see! Usually "this sort of thing" would have a normal distribution I guess? That IS quite interesting.

Re: Polya Urn Simulation

#13

Post by inimino »

kgwgk wrote: post #10
theK wrote: post #5

> After a large number of picks, what is the behavior of the proportion of red balls in the urn Isn’t the more enticing question how strong the bias towards the first picked Color is?

The expected terminal fraction is always equal to the current fraction. (Or is it?)

Yes, it is.

Re: Polya Urn Simulation

#14

Post by planede »

The proof seems to concentrate on the marginal distribution as n goes to infinity. But the simulation hints at something more interesting: each sample of the random process seems to converge to a value, where the value itself is U(0,1).

Is it true that a sample of the random process is convergent with probability 1?

Re: Polya Urn Simulation

#15

Post by cmoog »

theK wrote: post #6

Pretty sure the variables the author picked are not the most interesting ones. Urn models are engineered to have a rich get richer bias which is best seen by varying the initial populations. Instead of offering trial count and pick counts which are (invariates in the actual model) he could have picked initial ball count and initial white/red ratio.

Ah, good idea! I'll add those in a bit and will remark that the answer/proof are specific for the special case where r_0 = b_0 = 1.

Re: Polya Urn Simulation

#16

Post by cmoog »

bjornsing wrote: post #2

I must admit: this went against my intuition. My first guess was that you would end up with an urn full of either red or blue balls.

For me as well. And when my stochastic probability professor posed this question to the class by way of hands, it was nearly unanimous in favor of the 0/100% end behavior.

Re: Polya Urn Simulation

#17

Post by cmoog »

OscarCunningham wrote: post #8
bjornsing wrote: post #2

I must admit: this went against my intuition. My first guess was that you would end up with an urn full of either red or blue balls.

Bear in mind the default behaviour if there were just two balls and you never added any more. Then the proportion of red picks vs blue picks would tend to 1/2. So there's naturally a tendency for the proportion to concentrate in the middle. As you say, the way in which new balls are added tends to push the proportion towards the extremes. The uniform distribution is the result of these two tendencies exactly cancelli…

This is not correct as stated. It does not “tend towards extremes” as you might expect intuitively. That would be the case if half the time it approached 100% blue and half the time it approached 100% red, which is precisely not what happens.

Re: Polya Urn Simulation

#18

Post by eru »

foobarbecue wrote: post #12
kgwgk wrote: post #7

Earlier quoted context omitted.

The uniform distribution result is not interesting enough for you?

Oh, I see! Usually "this sort of thing" would have a normal distribution I guess? That IS quite interesting.

Usually 'this sort of thing' would go to the extremes: colours that are already prevalent have a bigger chance of getting more added to them.

It's interesting that they don't.

Normal distribution would be extremely weird and unexpected (and not even really possible): we know for sure that the proportion in the end has to be between 0% to 100%. Normal distributions don't have such cutoffs.

Re: Polya Urn Simulation

#19

Post by kgwgk »

eru wrote: post #18
foobarbecue wrote: post #12

Earlier quoted context omitted.

Oh, I see! Usually "this sort of thing" would have a normal distribution I guess? That IS quite interesting.

Usually 'this sort of thing' would go to the extremes: colours that are already prevalent have a bigger chance of getting more added to them. It's interesting that they don't. Normal distribution would be extremely weird and unexpected (and not even really possible): we know for sure that the proportion in the end has to be between 0% to 100%. Normal distributions don't have such cutoffs.

On a log-odds (logistic) scale, though, we get something that resembles a normal (a logistic distribution).

Re: Polya Urn Simulation

#20

Post by fjfaase »

fjfaase wrote: post #11
theK wrote: post #5

> After a large number of picks, what is the behavior of the proportion of red balls in the urn Isn’t the more enticing question how strong the bias towards the first picked Color is?

The rather boring answer is 2/3. Logic seems to indicate that it will be a linear distribution where the change for only balls of the first picked Color is maximum and only balls of the other Color is zero, because it is no longer possible to only pick balls of the other Color. It must be linear because it needs to be symmetric and lead to a uniform distribution if added together. After two picks, you have three case…

I am mistaken. After two picks, the case with two of the same Color does not result in a linear distribution. You can easily check this by modifying the code.
Post reply on HN