Viewing profile — reroute22

I agree in both parts. In particular, repeatability is only one part of it, another is in person physical presence, or a weaker form of it - on-screen presence, or at the absolute …

Execs was indeed more of a metaphorical description. A small subset of individuals working there. You don't need 80k people to make policy decisions, Meta is that big not because o…

While reality can be anything but. As far as I understand, there is plenty of research there in disciplines raging from social studies through psychology to game theory and economi…

Don't confuse employees with execs. It's a gigantic company with almost 80k employees. Most cultures around the world are acutely aware that the actions and opinions of their leade…

Such a fantastic paper overall, it was a pleasure to read, it's very accessible, and greatly informative. If anyone is new to the idea and is seeking a definition of AGI, reading t…

https://arxiv.org/abs/2310.02989 ("xVal: A Continuous Number Encoding for Large Language Models", Submitted on 4 Oct 2023)

It conceptually never admits ignorance and never asks for clarifications. It always produces something, to the best of its ability. It _seems_ to be a minor technical limitation (t…

Thank you for providing this. Bing Chat runs on GPT-4, however [1]. And Bing gets this wrong in all 3 of its modes (Creative, Balanced, and Precise) as of time of writing. Given th…

Just tried and it completely fell over: https://chat.openai.com/share/ea9cf93f-0632-48b9-aa47-1bbf31... Tried on Bing in "Precision" mode as well, and it fell over just the same, b…

I'm afraid I'm with your colleagues. I value being able to grasp what the code does at a glance while scrolling through. Your first snippet is entering my brain like as if without …

An easier to read research article that's narrower in subject and seemingly more relevant to the OP: https://research.nvidia.com/sites/default/files/pubs/2012-12... ("Unifying Prim…

There is a fairly informative survey on the subject: https://www.osti.gov/servlets/purl/1332070 (A Survey of Techniques for Architecting and Managing GPU Register File)

I'll leave your first question to the other comment here from frogblast, as I really battled with how to answer it well, given my limited knowledge and being an elbow deep into an …

I doubt anyone will be able to answer questions this fine grained, not now (if the implementation is architecturally exposed - leaks into the ISA - and Asahi Linux group figures so…

Not really, there is no such definition that you're referring to. Perf of a GPU can be limited by any one of the thousand little things within the micro-architectural organization …

Sorta, yeah! Also, your "128 cuda cores" of Skylake variety run at higher frequencies and work off of much bigger caches, so they are faster (in serial manner)... ...until they are…

"128 * the-number-of-cores" of threads can make progress truly in parallel (at the same time). 24,576 threads (or however many, I didn't validate the number and it depends on the o…

Okay, I went through the other video they reference ("Discover new Metal profiling tools for M3 and A17 Pro" [1]), and there is actually a whole bunch of extra very relevant (IMO) …

Thanks!

Judging by the output/GUI of their GPU profiler, "complex" there is more like "complex instructions", think f32 (floating point) ops that aren't additions and multiplications (and …

To be completely fair, base 14" MBP is only Pro in the name. That laptop has only 2 ports, supports only 1 external monitor, has a low core count CPU, and a relatively weak GPU, di…

Wow, that sounds like a very impressive level of separation of concerns. May I kindly ask for some links for further reading? If you have any handy.

Unfortunately, hardly. Ampere's (Nvidia 3000 series), Ada's (Nvidia 4000 series), and RNDA 3's (AMD 7000 series) GPUs have doubled up their FP32 units in ways that differ in implem…

I've no idea exactly how MS licenses uses of DX, but just for context Imagination Technologies just released a custom GPU design that implements DirectX Feature Level 11_0 (which c…