Viewing profile — siekmanj

Judging from recent improvement it doesn't appear to be a dead end technology, but I guess time will tell!

yes, for heavy lift and bulk manipulation high gear ratios are still necessary. Maybe someday cable drives will be feasible. No question that we are not at human performance yet or…

Actuators on modern humanoids use cycloids or planetary reducers, not strain waves. They are much more compliant and backdrivable because of the huge reduction in reflected inertia…

I could not disagree more with the claim about no improvement in robotic actuators. The torque density and price of actuators has fallen dramatically since Ben Katz's MIT work on m…

"RL: A Deep Reinforcement Learning Framework" seems to have been hallucinated, does not exist.

Video here: https://twitter.com/oregonstatenews/status/15747969243260108...

https://archive.ph/8X76D

True, but it's not trying to be multi-threaded, just concurrent.

Python has actually had concurrency since about 2019: https://docs.python.org/3/library/asyncio.html . Having used it a few times, it seems fairly sane, but tbf my experience with …

From some cursory googling: Afghanistan peak US troops: 102,000 (2011) Gulf war peak US troops: 700,000 (1990-1991) Iraq peak US troops: range from 168,000 - 192,000 (2007) Vietnam…

This is an amazing outcome. The license cost was a huge barrier to entry and the progress of deep RL generally.

The sim2real approach can work pretty well as long as you are very in tune with where your simulator falls short relative to the real world and take steps to circumvent those short…

Since you mentioned it--here's what Oregon State University and the Cassie group is up to these days: https://youtu.be/MPhEmC6b6XU

It's a German phrase which colloquially translated means 'Gotta go bro'

Actually, I think it is conventional neural networks which can only approximate finite state machines. RNNs are (in theory, not so much in practice) Turing complete.

Hey everyone, I am one of the authors of the paper described in this article. We used reinforcement learning and recurrent neural networks to learn a controller which can ascend an…

I was always very unimpressed with VR until I borrowed a headset to play Half Life Alyx. That game convinced me VR is the inevitable future of gaming. The rest of the industry may …

This is mostly true for supervised and unsupervised learning models, but for reinforcement learning the LSTM is king because of the convenient fact that it can be evaluated one tim…

Python doesn’t really have scope in that way. Variables declared inside an if statement can be accessed outside of the if statement.

Wow. I have been looking for a good resource on implementing self-attention/transformers on my own for the last week - can't wait to read this through.