Live data from Hacker News

OpenAI is partnering with Cerebras to add 750MW of compute in 10B USD deal

openai.com

1–10 of 10 posts

Re: OpenAI is partnering with Cerebras to add 750MW of compute in 10B USD deal

#3
> By keeping computation and memory on a single wafer-scale processor, we eliminate the data-movement penalties that dominate GPU systems. The result is up to 15× faster inference, without sacrificing model size or accuracy.

https://xcancel.com/andrewdfeldman/status/201154226777402186...

Re: OpenAI is partnering with Cerebras to add 750MW of compute in 10B USD deal

#6

> real-time AI Guessing the plan might be for voice AI. That stuff needs to be real snappy.

I hope all AI will reach 300ms response times, including 200 line diffs. Querying a million rows or informing user that a codebase is wrong used to take minutes but now happen instantly.