Viewing profile — oneraynyday

Noted, will abbreviate title :)

Ah yes, I didn't want the reader to fuss too much about the idea of a preference, since it's really just an analog of un-normalized pi(modulo the exponentiation part). It doesn't h…

Hey Joshua, thanks so much for the criticism. I do see your point towards epsilon greedy vs. regret minimization. I will add a section about that before presenting UCB1. I also wil…

Thanks for the reply! My audience is for someone who is early into their undergrad degree, doing math or computer science. Which parts do you think is not communicated clearly? I c…

Great suggestion! The blog was based on a large portion of the book. A friend of mine asked for a version of the first chapter that was digestible for an audience that is in high-s…

Yes, it is as you stated. Due to the fact that bandits are stateless, there is no state parameter in $q_ (a,s)$. From where I learned it, this could arguably be an abuse of notatio…