Viewing profile — cec

I'm not a big fan of the encroachment of AI into Adobe's apps, so I'm using AI to build a replacement for those apps (a small web-based photo organizer and editor, just the tiny su…

Hey! The idea isn't to replace the compiler with an LLM, the tech is not there yet. Where we see value is in using these models to guide an existing compiler. E.g. orchestrating op…

[flagged]

Is a MacOS build of YNAB 4 still available?

We use the same architecture as other LLMs, but we include no natural language in our pretraining. We figured a single-domain training corpus would make evaluation easier. We’ll be…

Hey, we’re targeting code size in this work, not runtime performance. You would use an option like -O3 to optimize for runtime and -Oz to optimize for code size. The pass pipelines…

Program synthesis is part of the loss function, which is what makes it a auxiliary learning task. We haven’t experimented with model size yet, we just used the same configuration a…

There’s a researcher at Edinburgh who is looking into this. You may want to reach out. Check the related work section in this paper

Hey Jon, we don't change semantics. We just choose optimization passes to run to match a particular input code. Agreed that code size wins could regress performance. We don't measu…

Hey, yes that's right, and good callout on GEP instructions. We admit that instruction count is a bit handwavy, but we use it as a starting point as that's what the prior works we …

Hey, author here. We use machine learning to generate a list of _optimization passes_ for the compiler to run. These optimization passes give us a 3.0% improvement over the default…

This. For now we rely on differential testing against a gold-standard implementation (e.g. unoptimized). For the action space we expose, any semantics-breaking change induced by ou…

Author here. In the sense that a trained neural net produces the same output from the same input, this is deterministic. But I don’t think that’s what you’re getting at. Where it g…

https://github.com/chriscummins/phd

I'd be careful about asking your co-workers for "dick pics".

No, HI is Brady Haran and CGP Grey, though I suspect Brady may have collaborated with Tom.

The paper says "we started a high-priority project to quickly produce a custom ASIC for inference (and bought off-the-shelf GPUs for training)."

Give texstudio a try. I find it offers exactly the kind of IDE-style features that I was missing from Emacs and other editors.

For offline writing (e.g. emacs/vim), I've found textlint[1] to work really nicely, and fits well into a LaTeX+Makefile workflow. [1] https://github.com/textlint/textlint

No. && would cause the next command to begin once the previous had successfully completed. A successful install shoudn't start the next install attempt, hence ||. On the other hand…

I'm not sure if I can agree with that reasoning. Sure, no-one is impressed with an Apple II now, but that doesn't degrade how significant it was then . By that measure, did the Wri…

I love how in all of their "meet the fleet" headshots, the birds are totally out of focus, only the grass in the background is clear

Great post, definitely giving this a try.

Off topic, but does anyone know how the author generated this web version of the paper? It looks like as though they've automatically generated it from the LaTeX source of the PDF.…

> I'm no biologist, but I don't think our brains are going around trying to do a grid search for the best hyperparameters. Is that not essentially the process of evolution through …