Viewing profile — elexhobby

For another possibility, see https://arxiv.org/abs/2305.15717 . The new models may not actually be better - the evaluation may be broken.

GPT-4 is powerful over a diverse set of tasks. They use it to build a model which is better for a narrow sub-task. Pretty sure the model is sub-optimal to GPT-4 for everything else…

Not sure if this is obvious. But its incorrect to ditch on GPT-4. The paper uses self-instruct on GPT-4 to generate the training data on which it is fine-tuned. This paper would no…

This! The best resource I've found to explain transformers, that made them clear to me. I wish all deep learning papers were written like this, using pseudocode.

FWIW I've been told similar by Costco too, so Amazon isn't unique in this respect. My guess is that it adds some friction to the process. Refunding money is a purely digital activi…

Furthermore, follow https://twitter.com/_brohrer_/status/1425770502321283073 "When you have a problem, build two solutions - a deep Bayesian transformer running on multicloud Kuber…

any twitch streams you recommend?

Wow. I wish everything was explained so clearly. I understood everything in that post except this paragraph. """ Languages like Erlang must implement tail call optimizations, since…

Quote: "The election comes down to a few swing states, such as Pennsylvania, Wisconsin, and Michigan. Crucially, right now all three of those states have Democratic governors and R…

Great post, thanks! Is there a reason why the training is started off with two separate matrices - the embedding and the context matrix? If the context matrix is anyway discarded a…