Viewing profile — atylerrice

You can also use int8 quantization which comes for free with huggingface and isn’t a huge cost to accuracy. Which cuts the memory usage almost in half again. (almost in half becaus…

This is incorrect. Thought would be interesting. Pruning usually removes some parameters from the model (setting certain ones to 0 for instance). The smaller models all have less l…

Well the batch size also helps with making training more stable. So a larger batch size computes the gradient across more examples so it ends up being more stable than only using a…

I don’t usually comment, but aws is actually rather expensive and i’ve hit this annoying quota problem as well. Been back and forth and still hasn’t been raised. I can also recomme…

Between work, university, and a side business, I have a lot of priorities in my life currently. What do you do to stay focused and make sure all of your priorities get the attentio…

I’ve seen this a lot. I think sometimes in my experience it comes down to what is work? As a developer I would classify a lot of the meetings I’ve had at past companies where it ta…

I totally agree but I’m excited for some recent initiatives to fix this. https://www.researchallofus.org/ This research project is open even to at home scientists although I think …

I built Hatchedwith.com mostly because I wanted to mess around with language models. I can’t seem to find any customers even though I got two from a fake landing page but realistic…