Viewing profile — abcdabcd987

Related discussion on serving finetuned LLMs: https://news.ycombinator.com/item?id=38196661

Thanks for your encouragement! We are working on quantization as well. We recently submitted a paper, Atom [1], that uses 4-bit quantization, delivering 7.73x throughput compared t…

Certainly! We'd like our good designs to be picked up by frameworks and serve all users. Currently, Punica is built on top of PyTorch and HuggingFace Transformers ecosystems. There…

Thank you! We are also very excited about combining the fast fine-tuning and efficient serving. In fact, what you just said is very related to one of our very first motivations. In…

Thanks for the question. Currently Punica is on the ecosystem of PyTorch and HuggingFace Transformers. So PyTorch users can start to use Punica now. Look forward to collaboration w…

On a related note, Google also uses optical circuit switches in their datacenter network. See the paper form SIGCOMM'22 [1]. [1] Jupiter Evolving: Transforming Google’s Datacenter …

I'm using 27-inch 4K monitors with Gnome. I found it more practical to use no scaling but 1.25x text size (settings in gnome-tweaks). The problem for me with 2x scaling or fraction…

I use Automate[1] to do this. Just draw an infinite loop that does sms_received[2] and email_send[3]. [1] https://play.google.com/store/apps/details?id=com.llamalab.a... [2] https:…

> If you find a really good tutorial by programmers who are both excellent teachers and experienced in that particular field, it beats JIT learning on a personal project in one imp…

Just mentioning two related programs in my mind: Franz ( https://meetfranz.com/ ) and nativefier ( https://github.com/jiahaog/nativefier ).

Email sent to all users via Chowbus Sendgrid. Link to anonymousfiles.io. Two CSVs, restaurants and users. $ head -n 1 users_y1KGkRi.csv "email","first_name","last_name","phone_numb…

Just want to mention bitbar[1]. Write anything to stdout, it'll make it show up in the menu bar. [1] https://github.com/matryer/bitbar

Check out the HotOS'19 paper from our lab :) https://danyangzhuo.com/papers/HotOS19-Stone.pdf

I think I did almost the same thing three years ago. See: https://www.v2ex.com/t/121272 (in Chinese only, sorry. I should translate it to English when I'm free)