Viewing profile — thinkzilla

I'm under the impression that the majority of startups go nowhere, so the fact that they don't have this property is not itself a major statement about the field as a whole.

The Attention Is All You Need paper deserves a lot of credit, but it also builds on other ideas. Earlier versions of attention were introduced in 2014 papers from (not U.S.) univer…

Making estimates is fine, but we should be clear that they are (provably) just opinions. http://scribblethink.org/Work/kcsest.pdf https://news.ycombinator.com/item?id=13731975 http…

I generally agree with the point of the article ("Fourier transform is not magical"). However saying it is "just" curve fitting with sinusoids fails to mention that, among an infin…

The comparison to railroad infrastructure is interesting. I think the author is wrong on this point however: > Today’s tech just cannot do what will be required of it (AI shouldn’t…

I am sympathetic to the motivations and argument in the article, but the analogy with bridge building is flawed. In engineering, if your assumptions are correct and you apply the f…

While the post uses DPO to illustrate RL and RLHF, in fact DPO is an alternative to RLHF that does not use RL. See the abstract of the DPO paper https://arxiv.org/abs/2305.18290 , …