Live data from Hacker News

Run Llama 3 405B on home cluster (Distributed Llama)

Post reply on HN

Print view View original

1–2 of 2 posts

Run Llama 3 405B on home cluster (Distributed Llama)

#1

Post by b4rtazz » Tue, Jul 23, 2024, 10:32 AM UTC

Run Llama 3 405B on home cluster (Distributed Llama)
github.com

Re: Run Llama 3 405B on home cluster (Distributed Llama)

#2

Post by b4rtazz » Tue, Jul 23, 2024, 10:34 AM UTC

Technically, should be enought 2 machines with 128 GB RAM or 4 machines with 64 GB RAM (Q40 weights).

Post reply on HN