Viewing profile — joemckenna

Leading up to ChatGPT, virtually no model innovation was needed. Just some minor tweaks to activation functions and the order in which operations were completed in the feedfoward l…

Whereas vanilla scaled dot-product attention forces outputs to fall in the convex hull of V, your proposal allows them to drift into the convex hull of V+{0}. It's pretty unlikely …

I was only matching queries against parts of the YouTube auto-generated captions. In theory, this should work for queries that are guests' names because Lex states the guest name i…

Sure! https://github.com/joepatmckenna/podsearch . Thanks!

For some videos, embedding on third-party sites has been disabled. Previously filtered, but revised now. Thanks!

As a side project, I created a search engine for the Lex Fridman podcast. It uses https://huggingface.co/sentence-transformers/all-MiniLM-L6-v... to encode the YouTube auto-generat…