Viewing profile — thesephist

Reminds me a lot of Infinite Craft ( https://neal.fun/infinite-craft/ ). The generative part of language models can make for really fun "single-player" games where you're really co…

Thanks for sharing Simon! I will note that by training an adapter layer between this autoencoder's embedding space and OpenAI's, it's possible to recover a significant amount of de…

Definitely possible if supported by transformers.js. If I see enough folks wanting it I'll likely add it at some point.

This is definitely an interesting idea I've also pondered before. In my experience (just speaking from intuition) what's "easy" for LMs to predict often doesn't line up with our hu…