Live data from Hacker News

CERN uses ultra-compact AI models on FPGAs for real-time LHC data filtering

theopenreader.org

111–120 of 166 posts

Re: CERN uses ultra-compact AI models on FPGAs for real-time LHC data filtering

#111

How are FPGAs "bruned into silicon"? Would be news to me that there are ASICs being taped out at CERN

Could they.... have someone else do it for them?

CERN doesn't build everything CERN uses:

- FPAGs like this one are generally COTS.

- All the experiments use GPUs which come straight from the vendors.

- Most of the computing isn't even on site, it's distributed around the world in various computing centers. Yes they also overflow into cloud computing but various publicly funded datacenters tend to be cheaper (or effectively "free" because they were allocated to CERN experiments).

Some very specific elements (those in the detector) need to be radiation hard and need O(microsecond) latency. These custom electronics are built all over the world by contributing national labs and universities.

CERN builds a bit.

Re: CERN uses ultra-compact AI models on FPGAs for real-time LHC data filtering

#112
One of the authors (of one of the two models, not this particular paper) here. Just a clarification, these models are *not* burned into silicon. They are trained with brutal QAT but are put onto fpgas. For axol1tl, the weights are burned in the sense that the weights are hard-wired in the fabric (i.e., shift-add instead of conventional read-muk-add cycle), but not on the raw silicon so the chip can be reprogrammed. Though, for projects like smartpixel or HG-Cal readout, there are similar ones targeting silicon (google something like "smartpixel cern", "HGCAL autoencoder" and you will find them), and I thought it was one of them when viewing the title.

Some slides with more info: https://indico.cern.ch/event/1496673/contributions/6637931/a... The approval process for a full paper is quite lengthy in the collaboration, but a more comprehensive one is coming in the following months, if everything went smoothly.

Regarding the exact algorithm: there are a few versions of the models deployed. Before v4 (when this article was written), they are slides 9-10. The model was trained as a plain VAE that is essentially a small MLP. In inference time, the decoder was stripped and the mu^2 term from the KL div was used as the loss (contributions from terms containing sigma was found to be having negliable impact on signal efficiency). In v5 we added a VICREG block before that and used the reconstruction loss instead. Everything runs in =2 clock cycles at 40MHz clock. Since v5, hls4ml-da4ml flow (https://arxiv.org/abs/2512.01463, https://arxiv.org/abs/2507.04535) was used for putting the model on FPGAs.

For CICADA, the models was trained as a VAE again, but this time distilled with supervised loss on the anomaly score on a calibration dataset. Some slides: https://indico.global/event/8004/contributions/72149/attachm... (not up-to-date, but don't know if there other newer open ones). Both student and teacher was a conventional conv-dense models, can be found in slides 14-15.

Just sell some of my works for running qat (high-granularity quantization) and doing deployment (distributed arithmetic) of NNs in the context of such applications (i.e., FPGA deployment for https://arxiv.org/abs/2405.00645 https://arxiv.org/abs/2507.04535

Happy to take any questions.

Re: CERN uses ultra-compact AI models on FPGAs for real-time LHC data filtering

#113

CERN has been doing HEP experiments for decades. What did it use before the current incarnation of AI? The AI label seems to be more marketing and superficial than substantial. It’s a bit sad that a place like CERN feels the need to make it public that it is on the bandwagon.

It was ten years ago I worked on an oscilloscope for CERN with FPGA trigger. You were able to update the trigger portion of the bitstream at any time, without a reset. Typically that was a FIR filter but it could be anything.

Like anything else, once you work with a system, it gives you ten ideas where to go next...

Re: CERN uses ultra-compact AI models on FPGAs for real-time LHC data filtering

#114

Thanks for the thoughtful comments and links really appreciated the high-signal feedback. We've updated the article to better reflect the actual VAE-based AXOL1TL architecture (variational autoencoder for anomaly detection). Added the arXiv paper and Thea Aarrestad's talks to the Primary Sources.

While you are at it:

> To meet these extreme requirements, CERN has deliberately moved away from conventional GPU or TPU-based artificial intelligence architectures.

This isn't quite right either: CERN is using more GPUs than ever. The data processing has quite a few steps and physicists are more than happy to just buy COTS GPUs and CPUs when they work.

Re: CERN uses ultra-compact AI models on FPGAs for real-time LHC data filtering

#115
post #88

Earlier quoted context omitted.

At this point AI basically means "we didn't know how to solve the problem so we just threw a black box at it".

I disagree. More often than not is "We know how to solve the problem, and the solution is some linear algebra"

I disagree with both of you.

It's not about linear algebra (which is just used as a way to represent arbitrary functions), it's about data. When your problem is better specified from data than from first principles, it's time to use an ML model.

Re: CERN uses ultra-compact AI models on FPGAs for real-time LHC data filtering

#117
post #89

Earlier quoted context omitted.

Some career do-nothing-but-make-noise in my organization hired a firm to 'Do AI' on some shitty data and the outcome was basically linear regression. It turns out that you can impressive executives with linear regression if you deliver it enthusiastically enough.

Tbh, often enough, linear regression is exactly what is needed.

Yes, and we do it every day and call it 'linear regression' and don't need a data center full of expensive toys to do it

Re: CERN uses ultra-compact AI models on FPGAs for real-time LHC data filtering

#118

Intuitively, I’ve always had an impression that using an analogue circuit would be feasible for neural networks (they just matrix multiplication!). These should provide instantaneous output. Isn’t this kind of approach feasible for something so purpose-built?

https://futurism.com/scientists-create-ai-glass
Post reply on HN