Viewing profile — OsamaJaber

Expanding free access is mostly an inference cost Serving cheaply at that scale means routing, batching, and cache hits, not a better model :D

[dead]

[dead]

[dead]

[dead]

The gap I've hit generating GPU kernels with agents code that compiles and runs fine but is slower than the baseline. Validator says pass, result is useless. Speed targets have to …

[dead]

thread: https://x.com/Akashi203/status/2074495867449434389