Viewing profile — aconz2

Ahh good to know about those -builder repos. It would be awesome to publish the compilers as container images, could also publish the squashfs as an artifact to a registry. And it …

Thanks, will get that fixed

Thank you! I'm also excited at the possibilities and today you can share "long links" (with all the data embedded in the URL's fragment) but in the future short links with storage …

You can run any program that is in the container you select. Right now it ignores the entrypoint from the container config (though you could manually copy that into the Cmd field).…

Yeah names are hard and it is just a working name. I'm simultaneously using containers as the distribution and runtime mechanism but also wanted them to be an implementation detail…

Inspired by Compiler Explorer and other playground/fiddle websites like jsfiddle, db-fiddle, Go playground, and Rust playground, I thought it would be cool to have a playground for…

To add on since this took me a while to understand: for a single token, self attention is permutation invariant because we take the qK (one query dot all the other keys) weighted s…

Great read and visuals. I think they typo'd the pun on basically/basisally. It got me thinking about program synthesis in the following scheme: data is embedded as vectors and prog…

surprised they didn't go straight into cloud-hypervisor, though I haven't actually tested with gpu yet but it is on my todo list. OCI layers can use zstd compression. I wonder if t…

Wow thanks for the info! This was a good overview of one system https://academic.oup.com/mt/article/25/4/14/6815410 - 5um slice thickness at 0.7um per pixel and ~1 TB/cm^3, max sam…

Bit late and I posted essentially this same comment on their site in hopes they'll see it, but this article jumped out at me because a while ago I was thinking about what it would …

Very nice writeup and I appreciate the effort put into showing the process. I got nerd sniped yesterday playing around with how to find the isle_opt.rs filepath from the core file …

Nice article, really like the survey bit. I know titles are just one tiny aspect, but they do set the tone, and in this case framing as a negative ("sad state") might put people of…

Late to the party, but I think my summary is (L is context length, C is hidden dimension, H is headsize, C = H * nh): 3.1 Optimised attention: Instead of using a learned W_V to pro…

Is there code somewhere? I don't totally understand the double position and shuffling. Interesting they use concat instead of plus for the positionals

Nice, this is really helpful to compare with minigpt in pytorch. I think I like the dimensions in the variable names. Kinda miss seeing the modules used in a module being setup in …

very cool, love the website design and the blog posts had a lot of interesting bits, like the backplate removal jig. I was kinda surprised to see an fpga in there but makes sense. …

Sounds cool. Does the DRAM exist both in the SPU (4 kelvin) area and 77 kelvin area? This paragraph is a bit confusing: > We call it a superconductor processing unit (SPU), with em…

> Recent multimodal foundation models are very widely adopted but still model different modalities separately, often using modality specific encoders or decoder Is this accurate? I…

Very interesting, do wish we could play with it since it is a show hn, maybe repost when it is open sourced/usable. Looking forward to reading about how it works. How does it know …

I have been playing around in pytorch with an a770 16GB card and hit this error. The response seems to be https://github.com/intel/intel-extension-for-pytorch/issues/... that large…

Very cool I've been waiting for this part of the writeup. A few years ago I tried to write a similar microscope pano stitcher and used SIFT features in opencv, not sure I had come …

The goal seems to be: "Virtual Fugaku provides a way to run software developed for the supercomputer, unchanged, on the AWS Cloud". Is AWS running A64FX's? Is there more info on al…