Viewing profile — gchadwick

I really enjoyed the book. Great for people who want to understand the real nuts and bolts and have worked examples of all of the calculations.

That's the beauty of side projects, you get to decide and you don't have to care about working with others. Really yearning for crafted code that meets every one of your perfect co…

On your side-project it's also ok to ignore best engineering practice, reinvent the wheel because you feel like it or make decisions based on what seems most interesting even if it…

Remember OpenAI decided GPT 2 was far too dangerous to unleash upon the world when they first trained it!

A nice game, though the truth table lighting round is pretty punishing! Big contrast to the circuit building part where you can take your time. Personally I'd drop the time require…

> Also we found the formal waiver analysis tools to be very effective for waiving unreachable code, in case you aren't using those. Yes we had used them just never got it slickly i…

You can see the latest nightly results here: https://opentitan.org/dashboard/index.html note there are some 100% figures. Having spent several years working on OT I can tell you th…

I worked on OpenTitan for around 5 years at lowRISC. It certainly has its ups and downs but it's generated some great stuff and I'm very glad to see hit proper volume production li…

This is an interesting piece of hardware though when they go multi-chip for larger models the speed will no doubt suffer. They'll also be severely limited on context length as it n…

> If copying user tokens was the bottle neck, batching would not achieve any speed up. Reality is more complex. As context length grows your KV cache becomes large and will begin t…

Anyone else find reading things like this slightly exhausting? I'm very much pro AI for coding there are clearly significant capabilities there but I'm still getting my head around…

Only taken a quick skim but this looks like solid material! RISC-V Vector is definitely tricky to get a handle on, especially if you just read the architecture documentation (which…

A shame this hasn't shot to number 1 on HN and stayed there. At least it's getting reasonable upvotes. This is a truly fantastic piece of hacking, going by the original meaning of …

Another example of the growing trend of buying out key parts of a company to avoid any actual acquisition? I wonder if equity holding employees get anything from the deal or indeed…

> However, Groq’s architecture relies on SRAM (Static RAM). Since SRAM is typically built in logic fabs (like TSMC) alongside the processors themselves, it theoretically shouldn't …

It's for a CS course at Stanford not a PyTorch boot camp. It seems reasonable to expect some level of academic rigour and need to learn and demonstrate understanding of the fundame…

Karpathy's contribution to teaching around deep learning is just immense. He's got a mountain of fantastic material from short articles like this, longer writing like https://karpa…

To me at least "not good after all" means their current latest hardware has issues which means it cannot replace Nvidia GPUs yet. This is a hard problem so not getting there yet do…

I'd say there's a mix of 'Chinese GPUs are not that good after all' and 'Nvidia doesn't have any magical secret sauce, and China could easily catch up' going on. Nvidia GPUs are in…

If I'm reading this right, glitching the I2C bus prevents the Secure Enclave from booting. It seems the device recovers from this itself 'Although the device recovered and remained…

I thought it was a great book, dives into all the details and lays it out step by step with some nice examples. Obviously it's a pretty basic architecture and very simplistic train…

The CTO of applications reporting to CEO of applications (who reports to the actual CEO) is kinda weird? I figure you're either the actual CTO or you're not a C-level exec and shou…