Viewing profile — joaogante

> Couldn’t someone say prototype the entire product on some lower-quality LLM and occasionally pass requests to GPT4 to validate behavior? It can be done -- it is the basis for ass…

vs code: https://marketplace.visualstudio.com/items?itemName=HuggingF... vim: https://github.com/huggingface/hfcc.nvim

A 3090 (or any GPU with >=20GB VRAM) can run StarCoder with int8 quantization at about 12 tokens per second, 33 with assisted generation -- which will come out for StarCoder in the…

The models are on huggingface now -- https://huggingface.co/models?other=galactica

Portuguese living in Lisbon here -- I deeply agree with the parent comment. Prior to covid, it was very common to hear stories where families were to put all their savings into new…

> Pick your 10 favorite GitHub project with more than 10k stars and see who the primary contributors are. Hugging Face transformers has >60k stars and fewer than 30 employed mainta…