Live data from Hacker News

PowerInfer-2: Fast Large Language Model Inference on a Smartphone

Post reply on HN

Print view View original

1–2 of 2 posts

PowerInfer-2: Fast Large Language Model Inference on a Smartphone

#1

Post by 27theo » Thu, Jun 13, 2024, 12:24 PM UTC

PowerInfer-2: Fast Large Language Model Inference on a Smartphone
powerinfer.ai

Re: PowerInfer-2: Fast Large Language Model Inference on a Smartphone

#2

Post by 27theo » Thu, Jun 13, 2024, 12:25 PM UTC

Arxiv Paper: https://arxiv.org/abs/2406.06282

Previous submission (paper link submitted): https://news.ycombinator.com/item?id=40646450

Post reply on HN