Does this mean we can compile LLMs to run on FPGAs directly?
I don't know if ternary gate arrays are a thing, but if so then yes.
True, ternary gates probably don't exist, but two gates gets you there and hardware is very fast.
The Era of 1-bit LLMs: ternary parameters for cost-effective computing
461–462 of 462 posts
Re: The Era of 1-bit LLMs: ternary parameters for cost-effective computing
#462Earlier quoted context omitted.
Why isn't John Carmack working for OpenAI? Hell, why did he waste years at Meta to work on a VR headset and NOT AI? He even announced he wants to focus on AGI but he missed out on literally all the action.
he has his own AGI startup now https://dallasinnovates.com/john-carmacks-keen-technologies-... TBH I think they won't get anywhere. Doing good game engine work... why that would translate to AGI?
That game engine was over 3 decades ago! John is one of the sharpest minds I've ever seen, if he's passionate on AGI, he surely has much deeper understanding what he's doing than the AI trendies on social media.