Viewing profile — easysnap
easysnap
HN member- Joined
- Sat, Feb 15, 2020, 5:28 AM UTC
- HN karma
- 1
- Public activity
- 1 items
- HN profile
- View on Hacker News ↗
About easysnap
No profile information was provided.
Recent public activity
-
comment
Comment #22333646
ZeRO is mainly a clever improvement that moves optimizer computation into the 2 phases of Ring-AllReduce. It greatly helps Adam and similar optimizers to reduce per-GPU memory over…