Viewing profile — saturn99

I think FPGAs would be an awesome prototype but maybe too constricting in terms of resources? The extrapolation might be so far out to be just as accurate as their simulated model.…

Seems to align with Google, seems like they release a new TPU every 1.5 to 2 years. I think modern LLMs are powerful enough now that they will still be useful in a couple years eve…

Yep, pretty unique system. I imagine anything that runs LLMs better than we currently can would pique the interest of VCs.

I think the costs are from the Moonwalk model, which is a pretty good reference for estimating costs, although it might be low if you use all Google engineers to build the HW. =P