Stuff like this troubles me. I am in defense tech working with LLMs and I am here to tell you the guards and fences are down at the chow truck while commoners are using LLMs.
I don't really understand why people bash so hard on LLMs. In some cases it is a spectacularly bad tool, I get that. But it is only a tool. Imagine if you have a judge giving out sentences based on astrology books. I don't think anyone would argue the problem would be resolved by banning astrology books from our libraries.
In your example you should probably drop the judge, but you should also make a rule saying astrology books aren't a legitimate source of sentence guidance. That's what people are annoyed about re:LLMs. People keep insisting they are a legit source in different situations.
You wouldn't ban them overall, but you do want some kind of society-level taboo against relying on them. You can't just deal with it on the level of people who get fooled into using them.