"Please note that there is a closed-source kernel used for math operations that is linked via a shared object called libsparse_inference.so. We provide the libsparse_inference.so library to be linked, but are unable to provide source for it. This is the reason that a specific toolchain/compiler is required.* - README
[update: proprietary .so] They should re-implement the needed bits of libsparse_inference before releasing this thing. Otherwise it's just a distraction. Probably they should get it building with something other than Bazel, too.
The fine README says it builds and runs on Ubuntu 20.04.