Viewing profile — slashdave

M4's GPU does not support 64 float. So, yeah. No hardware support, so what are you expecting? The fact that it comes close is pretty impressive.

I mean... who has control over OpenAI's web page? No self-respecting PR firm would do something like this. And Counsel must be hopping mad.

Please don't assume the entire AI industry behaves like OpenAI

Why do think they would want to be vindictive? The point is to prevent leaks, leaving lapses is exactly counter to that goal.

It's not hard if you are honest

Those that claim their opponents are in denial are most likely in denial themselves

Since when does realism become hope? (It's the other way around)

Shh! Don't upset the hype train

No, we do this kind of thing regularly. Optimizations often depend on the model that is using them. Namely, fusion techniques.

Indeed. Compilers do have to make compromises, and it is not possible from code alone to understand the tradeoffs.

This SV mentality that technology can solve all problems is rather tiring, really.

Have your agent take care of it

> We only know how to do it by means of considerable sacrifice Little sacrifice actually > Solving the issue would be doing it without sacrifice So... you are expecting magic? LLMs…

Yeah, a corner case (streaming) and good developers working very hard. The original SSE (SIMD) extensions were actually written with this use case in mind. When they first came out…

Except for some odd corner cases, it is very hard for a good engineer to beat compilers these days (they are very good now). Not to mention, tuning depends on the platform, and oft…

Show it the disassembler...

I'm... confused. Don't we use macro assemblers anymore?

Is AWS listening?

Seriously? We already know how to solve all of these issues. What we lack is collective political will.

What? No. Frontier physics is experiment driven.

It will not happen with existing LLM techniques.

> we are also seeing incredible advances in software performance Incredible? > open ai announced like 15% improvement by fixing gpu kernel issue That is... ordinary software optimi…

> The sooner people can be broken out of their denial There is irony here

Cursor achieved fast adoption by making it simple to move from Visual Studio code. Double-edged sword. It is also simple to move back to VS code and agent extensions.

Don't forget: resources