Viewing profile — gok

It's a fascinating design but it's been 14 years since the concept was first announced and it's never really completely worked. If it ever was possible, it's not clear the talent f…

Ok that's...just cheating. You can't take a benchmark like MMLU designed to test the performance of a single general language model and compare it to performance of a small special…

An HTML5 super jet?

consider using fp16 or bf16 for the matrix math (in SME you can use svmopa_za16_f16_m or svmopa_za16_bf16_m)

Do you use fully bidirectional attention or is it at all causal?

The oldest iBook G4 is from October 2003, not even 23 years old.

There are many marginally employable swing voters who vote Republican when they have jobs and the Democrats in charge ask for taxes, then vote Democratic when they get put out of w…

> it is possible to put 500 to 1000 TW/year of AI satellites into deep space, meaningfully ascend the Kardashev scale and harness a non-trivial percentage of the Sun’s power We cur…

Yes.