Earlier quoted context omitted.
Will be capable and fast enough for 2-3 weeks until new sota drops
If it is capable today why would a new model change this?
AMD acquires Taalas to boost inference performance by etching models in silicon
41–50 of 710 posts
Re: AMD acquires Taalas to boost inference performance by etching models in silicon
#42I feel like NAND process tech could become useful at solving some of these problems. A GPU where you can update the weights a few thousand times may be sufficient.
Re: AMD acquires Taalas to boost inference performance by etching models in silicon
#43Re: AMD acquires Taalas to boost inference performance by etching models in silicon
#44Baking models onto silicon would've been the next logical move to get a moat.
Google is already doing this and has an experimental project on top of already having TPUs and cramming their quantized flash onto individual TPUs for inference.
Re: AMD acquires Taalas to boost inference performance by etching models in silicon
#45Re: AMD acquires Taalas to boost inference performance by etching models in silicon
#46Earlier quoted context omitted.
It doesn’t believe it’s running on that chip, it’s arguing with me
It's running a very small, non-reasoning model at the moment. But more generally, almost all LLMs argue on the hardware/model they are/are on.
Re: AMD acquires Taalas to boost inference performance by etching models in silicon
#47The demo: https://chatjimmy.ai/
It also mostly passes the "schlong" test
Re: AMD acquires Taalas to boost inference performance by etching models in silicon
#48The demo: https://chatjimmy.ai/
Re: AMD acquires Taalas to boost inference performance by etching models in silicon
#49I feel like NAND process tech could become useful at solving some of these problems. A GPU where you can update the weights a few thousand times may be sufficient.
You need to be able to add|mul where the data (the weights) are stored.
Re: AMD acquires Taalas to boost inference performance by etching models in silicon
#50The demo: https://chatjimmy.ai/