Etched Is Making the Biggest Bet in AI
etched.com
Etched Is Making the Biggest Bet in AI
1–10 of 19 posts
Re: Etched Is Making the Biggest Bet in AI
#2[deleted]
Re: Etched Is Making the Biggest Bet in AI
#3"In five years, AI models became smarter than humans on most standardized tests."
This seems to be a novel definition of "smarter" - one could also argue that the printed answer key for a standardized test is smarter than most humans.
Re: Etched Is Making the Biggest Bet in AI
#4Wow.. I wonder how this compares to groq?
I made a request to access their developer cloud. Anyone have any idea when they start processing those requests and how many slots they might have?
Re: Etched Is Making the Biggest Bet in AI
#5> Specialized chips are inevitable
I mean, are they? Seems like the industry would prefer these things to become commodities, especially if it helps with portability and reproducibility.
Re: Etched Is Making the Biggest Bet in AI
#6How will these companies replace the software? Don't they need something similar to CUDA?
Re: Etched Is Making the Biggest Bet in AI
#7How will these companies replace the software? Don't they need something similar to CUDA?
(I work at Etched.) You need something as complex as CUDA only to support general-purpose programmability; Sohu is built for one thing and one thing only: transformers. So while we certainly need a software stack to harness the chip, it’s much easier to do so, and even easier then to adapt existing LLM serving tools (vLLM, etc.) to use this stack.
Re: Etched Is Making the Biggest Bet in AI
#8How will these companies replace the software? Don't they need something similar to CUDA?
(I work at Etched.) You need something as complex as CUDA only to support general-purpose programmability; Sohu is built for one thing and one thing only: transformers. So while we certainly need a software stack to harness the chip, it’s much easier to do so, and even easier then to adapt existing LLM serving tools (vLLM, etc.) to use this stack.
> Sohu is built for one thing and one thing only: transformers
Thanks for clarifying this. Could you clarify whether your chip supports the transformer architecture in general, or only specific models for e.g. Llama 70B? In case of the latter, would your ASIC have to be reprogrammed for each model?
Re: Etched Is Making the Biggest Bet in AI
#9Wow.. I wonder how this compares to groq? I made a request to access their developer cloud. Anyone have any idea when they start processing those requests and how many slots they might have?
Was curious about this as well, seems like the closest comparison today is to Groq, wondering how it holds up.
Re: Etched Is Making the Biggest Bet in AI
#10Earlier quoted context omitted.
(I work at Etched.) You need something as complex as CUDA only to support general-purpose programmability; Sohu is built for one thing and one thing only: transformers. So while we certainly need a software stack to harness the chip, it’s much easier to do so, and even easier then to adapt existing LLM serving tools (vLLM, etc.) to use this stack.
> Sohu is built for one thing and one thing only: transformers Thanks for clarifying this. Could you clarify whether your chip supports the transformer architecture in general, or only specific models for e.g. Llama 70B? In case of the latter, would your ASIC have to be reprogrammed for each model?
Transformers in general. There’s no reprogramming of the ASIC needed, just applying a different sequence of layers, and that’s exactly what our software stack is meant to support.