> Not really all that different from PDF

That is not correct, PDF supports text spans natively; perhaps you're thinking of scanner software that merely uses PDF as a convenient packaging for their JPEGs?

I cannot defend DjVu as I've only had tangential contact with it, and for sure have never tried to author any such file. I was just raising awareness that there are competing standards that appear to be libre and are designed for pixel perfect output