Live data from Hacker News

ZML - High performance AI inference stack

github.com

11–13 of 13 posts

Re: ZML - High performance AI inference stack

#11

my dreams have come true. hardware-agnostic ml primitives in a typed, compiled language. my only question is: is zig stable enough to base such a project on?

Zig has been relatively stable for the past few years for the main Zig code. What has changed the most is the `build.zig` build system (which we aren't using).

We are also looking ahead at Zig roadmap, and trying to anticipate upcoming breaking changes, and isolate our users from that.

Re: ZML - High performance AI inference stack

#13

What would be the benefit of using ZML instead of relying on StableHLO/PJRT? Because the cost of porting models is for sure high.

ZML the zig library is mostly a wrapper of StableHLO/pjrt. But it's a high quality wrapper, and the tagged tensor syntax is really helpful to write complex ops like dot, or gather.

And ZML the framework also resolve issues with the complex dependency graph of stablehlo/pjrt.

Post reply on HN