Viewing profile — vinn124

for a good introduction to order and complexity (including intelligence) arising from nothing, read "the origins of order" by stuart kauffman.

who cares?

> At the core RL is just updating a table of values, and then using function approximation (aka, machine learning) for more complex cases. this seems to be a common assertion about…

particularly when most microsoft investors value microsoft stock for its earnings potential, as opposed to growth/revenue potential.

> Increased accuracy per unit wallclock time is what you want. yah, especially for a framework for distributed learning!

> 3) Test that the solution works on toy examples, like MNIST, simple block worlds, simulated data, etc. youre right: mnist, imagenet, etc are toy examples that do not extend into …

> What are the use cases for adding yet another layer to the stack? in my limited experience with horovod, horovod is most useful when youre running large clusters of workers/ps. i…

> Usually you throw everything and see what sticks. most practitioners start with the simplest possible learner, then gradually, and thoughtfully, increase model complexity while p…

> Many losses which don't seem differentiable can be reformulated as such... agreed, especially with policy gradients. > If the dimensionality is small, second-order methods (or ap…

not exactly what you asked for, but if youre looking for a gentle academic introduction to the intersection of ai and games, i recommend [ AI Researchers, Video Games Are Your Frie…

the quality and preciseness of this answer is why i read hn every day.

> Why should we expect there to be any mathematical foundation to this stuff? i would be surprised that "this stuff" would be exception to the unreasonable effectiveness of mathema…

youve missed the point. the point is: anything complex can be dismissed as "just x,y,z" if you dont appreciate the massive body of work behind it. i made that point because OP obse…

> Then my next question will be how can I trust something that I don't understand. ive always found this mentality silly. do you understand aerodynamic principles? laws of electrom…

how does this solve anything? if a simple decision tree could predict the outputs of more complex deep nets, why not use the decision tree in the first place? also, what do you do …

it was the ability of steve jobs to create an organizing principle (and its corresponding organizational structure) that deserves credit for apple's success.

> It's just alternating layers of affine transformations and nonlinearity with lots of tricks and improved routing. and a computation is just 0s and 1s, with lots of if/then statem…

pytorch, not tf, seems to be winning the hearts and minds of ml researchers. then again, things change quickly.

> If you're not waymo you probably use ROS. is this true? ros works well for prototyping, but is it actually used in prod?

> I am curious to know what major innovations in search engines happened since the page rank algorithm, or were there only incremental improvements? a ton has happened! since pager…

> Note that the article has a comment by Yann LeCun (hopefully it's not an impersonator). i wouldnt be surprised if it was lecun. colah's illustrations on nonlinear transformations…

agreed

that is true: popular rl techniques (eg policy gradients) are very similar to "vanilla" supervised learning techniques and architectures, but they are unsupervised in the sense tha…