Viewing profile — oldcap

oldcap

HN member

No profile information was provided.

comment
Comment #41071451
Thu, Jul 25, 2024, 5:58 PM UTC
story
Amazon's Exabyte-Scale Migration from Apache Spark to Ray (Saving $120M / Year)
Thu, Jul 25, 2024, 5:58 PM UTC
comment
Comment #40249929
Fri, May 03, 2024, 5:11 PM UTC
story
Uber's Journey from Predictive to Generative AI
Fri, May 03, 2024, 5:11 PM UTC
comment
Comment #38727637
GH: bit.ly/llm-perf Blog: https://www.anyscale.com/blog/comparing-llm-performance-intr...

Thu, Dec 21, 2023, 9:59 PM UTC
story
Comment #38727636
Thu, Dec 21, 2023, 9:59 PM UTC
comment
Comment #37871271
Short link https://bit.ly/load-llm

Fri, Oct 13, 2023, 2:50 PM UTC
comment
Comment #37871242
How long does it take to download Llama2 70B? On the 4x 25 Gbps NICs that aws.p4de's have, it should take ~10s. Yet in production we've observed much higher times, which makes auto…

Fri, Oct 13, 2023, 2:48 PM UTC
story
Loading LLM (Llama-2 70B) 20x faster with Anyscale Endpoints
Fri, Oct 13, 2023, 2:48 PM UTC
comment
Comment #34510677
AWS actually has a _higher_ unit cost than Alibaba Cloud

Tue, Jan 24, 2023, 9:26 PM UTC
comment
Comment #26421270
"We believe that Ray will continue to play an increasingly important role in bringing much needed common infrastructure and standardization to the production machine learning ecosy…

Thu, Mar 11, 2021, 7:25 AM UTC