Judges are Article III, and the need for them laid out explicitly in the text of the Constitution itself.
Chevron deference, and the corpus of administrative law unsubject to judicial review it spawned, most decidedly is not.
That makes judges a bit more of a fixture in the grand scheme of things than all these "agencies" running their own pseudo-courts so that Congress critters can spend their tenure voting one another pay raises, and insider trading among themselves.
>it's manifestly not on federal judges to say "oh no, you can only do that in a way that lets us judges have the dominant seat at the table."
Actually, it manifestly is on the judiciary to say that. If Congress started adding clauses to legislation to the tune of "this law is not subject to judicial review", the judiciary is fully within it's rights as outlined by the Constitution to strike down the law, as the Legislature, by definition, cannot produce a thing with force of law contradicting a limitation placed on it by the Constitution short of another Constitutional Amendment + the requisite ratifications. An unconstitutional law, is no law at all. The issue of constitutionality is purely the realm of the judiciary. No one else. You can change what the Judiciary looks like; but you can't structurally usurp it's powers under the Constitution.
There is a reason Jefferson and Madison were really nervous about how the judiciary ended up playing out in practice though.