He is technically bound by the law, but he also has the power to interpret the law as he sees fit (many such cases in Portugal for instance).
This system puts too much power in the hands of a single person and as such is ripe for abuse for personal causes… or worst, for personal gains. There’s nothing democratic about this.
It should be a jury of fellow peers to decide if someone is guilty of actually breaking a law.