I'd want at least a parallel, after-the-fact rulings by an LLM, so we can see how bad judges are.
I really think this is one of the areas LLMs can shine. Justice could be more fair, and more speedy. Human judges can review appeals against LLM rulings.
For civil cases, both parties should be allowed to appeal an LLM ruling, for criminal cases only the defendant, or a victim should be allowed to appeal an LLM ruling (not the prosecution).
Humans are extremely unfair and biased. LLM training could be crafted carefully and using well and publicly scrutinize-able training datasets and methodologies.
If you disagree (at least in the US), you may not be aware of how dire the justice system is. There is a reason ICE randomly locking Americans up isn't stirring the pot. This stuff is normal. If a cop doesn't like you, they can lock you up randomly without any good reason for 48 hours, especially if they believe you can't afford to fight back afterwards. They can and do charge people in bad-faith (trumped up charges), and guess what? you might be lucky and get bail. But guess also what? You can't bail yourself out, if you have no one to bail you out, you're stuck until the trial date, in prison.
Imagine spending 3-5 days in jail (weekend in between) without charges. There are people that wait for trial in jail for months and years, and then they get released before even seeing a trial because of how ridiculous the charges were to begin with. This injustice is a result of humans not processing cases fast enough. Even in just 48 hours, do you have any idea how much it can destroy a person's life? It's literally death sentence for some people. You're never the same after all this. and you were innocent to begin with.
Let's say you do make it to trial, it takes years sometimes to prove your own innocence. and you may not even be granted bail, or you may not know anyone who can afford to spare a few thousand dollars to bail you out.
94%+ of federal cases don't even make it to trial, they end up in plea-bargain agreements, because if you don't agree to trumped up charges, they'll stack charges on you, so that you'll either face 90 years in prison or a year with plea-bargain. a sentence given to murderers and the worst of society, if you lose a trial, or a year if you falsely admit your guilt. losing a non-binding LLM trial could be a requirement for all plea-bargains to avoid this injustice.
Don't even get me started on how utter fecal matter like how you dress, how you comb your hair, your ethnicity, how you sound, your last name, what zip code you find yourself in, the mood of the judge, how hungry the judge is, or their glucose level, how much sleep the judge had. all these factors matter. Juries are even worse, they're a literal coin-toss practically.
I say let LLMs be the first layer of justice, let a human judge turn over their judgement, let justice be swift where possible, without making room for injustice. Allow defendants to choose to wait for a human judge instead if they want. Most I'm sure will take a chance with the LLM, and if that isn't in their favor, nothing changes because they'll now be facing a human judge like they would have otherwise. we can eve talk about sealing the details of the LLM's judgement while appeals are in progress to avoid biasing appellate judges and juries.
Or.. you know.. we could dispense with jail? If cops think someone needs to be placed under arrest, they should prove to a judge within 12 hours that the person is a danger to the community. if they're not a danger, ankle monitors should be placed on them, with no restriction on their movement so long as they remain in the jurisdiction. or house-arrest for serious charges. violating terms would mean actual jail. If you don't like LLMs, I hope you support this instead at the very least. The current system is an abomination and an utter perversion of justice.
I'd prefer caning like they do in Singapore and few other places. brutal, but swift, and you can get back to your life without the cruel bureaucracy destroying or murdering you.