Live data from Hacker News

Unsloth creators fix universal error with gradient accumulation

Post reply on HN

Print view View original

1–3 of 3 posts

Unsloth creators fix universal error with gradient accumulation

#1

Post by ZQ-Dev8 » Wed, Oct 16, 2024, 10:30 PM UTC

Unsloth creators fix universal error with gradient accumulation
unsloth.ai

Re: Unsloth creators fix universal error with gradient accumulation

#2

Post by ZQ-Dev8 » Wed, Oct 16, 2024, 10:31 PM UTC

seems like something pytorch maintainers would want to know about and fix asap...

Re: Unsloth creators fix universal error with gradient accumulation

#3

Post by gnabgib » Wed, Oct 16, 2024, 11:24 PM UTC

Article title: Bugs in LLM Training - Gradient Accumulation Fix

Post reply on HN