Viewing profile — MAXPOOL

Things you are not supposed to talk about: - There is no "moat" (lasting, easy-to-defend technological edge) in AI model businesses. There are just short-term advantages. - An AI b…

If you take a birds eye view, fundamental breakthroughs don't happen that often. "Attention Is All You Need" paper also came out in 2017. It has now been 7 years without breakthrou…

There are many others that are better. 1/ The Annotated Transformer Attention is All You Need http://nlp.seas.harvard.edu/annotated-transformer/ 2/ Transformers from Scratch https:…

Without looking the answer, what is your intuition about the size of the VC-dimension of ReLU networks as a function of a number of weights and layers? Nearly-tight VC-dimension an…

That's is based on old assumption of neuron function. Firstly, Kurzweil underestimates the number connections by order of magnitude. Secondly, dentritic computation changes things.…

> deep learning architectures have been crafted to create inductive biases matching invariances and spatial dependencies of the data. Finding corresponding invariances is hard in t…

Effect of exercise for depression: systematic review and network meta-analysis of randomised controlled trials. Conclusions Exercise is an effective treatment for depression, with …

Mamba is a new model architecture based on SSM's. Mamba: Linear-Time Sequence Modeling with Selective State Spaces https://arxiv.org/abs/2312.00752 https://github.com/state-spaces/…

Jan 3, 2024 Lecture by Sergey Levine about progress on real-world deep RL. Covers these papers: A Walk in the Park: Learning to Walk in 20 Minutes With Model-Free Reinforcement Lea…

His first publication was "Potrzebie System of Weights and Measures" for Mad Magazine in June 1967 when he was 19-years old. https://silezukuk.tumblr.com/image/616657913

Two best: CHESS IS A FUN SPORT, WHEN PLAYED WITH SHOT GUNS COWS FLY LIKE CLOUDS BUT THEY ARE NEVER COMPLETELY SUCCESSFUL. These are from MegaHal that entered 1998 Loebner Prize Con…

Speculating from the name only. Q* might be name derived from Q-learning and A* search algorithm. In that case it would be informed best best-first search using reinforcement learn…

Being a universal function approximator means that a multi-layer NN can approximate any bounded continuous function to an arbitrary degree of accuracy. But it says nothing about le…

What about LLM reasoning ability? Faith and Fate: Limits of Transformers on Compositionality https://arxiv.org/abs/2305.18654 Transformers solve compositional reasoning tasks by re…