AI outperforms law professors in Stanford Law study
1–10 of 384 posts
Re: AI outperforms law professors in Stanford Law study
#2He is basically an AI professor for law. This study just confirms his existence:
Stanford and its donors of course want to replace anyone but its administrators, so they cheer on such anti-intellectual nonsense.
Re: AI outperforms law professors in Stanford Law study
#3I think there will be a market for firms that aggressively market themselves as non-AI, and then as more people turn towards that human connection we'll go full circle
Re: AI outperforms law professors in Stanford Law study
#4I think there will be a market for firms that aggressively market themselves as non-AI, and then as more people turn towards that human connection we'll go full circle
If you want human connection the legal system is not where you are going to find it, period.
I don't think there will be any such market for "non ai" law. If I'm involved with the legal system I just want out as quick as possible as cheap as possible.
Re: AI outperforms law professors in Stanford Law study
#5[flagged]
Re: AI outperforms law professors in Stanford Law study
#6> In a blind evaluation of nearly 3,000 anonymized comparisons, professors rated AI responses significantly higher than answers written by other professors, with AI winning 75% of head-to-head matchups.
75% win rate seems pretty good!
Paper link: https://law.stanford.edu/wp-content/uploads/2026/06/salinas_...
Re: AI outperforms law professors in Stanford Law study
#7As a software engineer I have some intuition for what the risks are of letting agents do some tasks vs others.
I don't have a similar intuition calibrated for what could go wrong when asking AI to draft a legal document. Some things seem harmless, i.e. drafting a will, but I don't really know- our legal system is notoriously rife with footguns.
Re: AI outperforms law professors in Stanford Law study
#8> In a blind evaluation of nearly 3,000 anonymized comparisons, professors rated AI responses significantly higher than answers written by other professors, with AI winning 75% of head-to-head matchups. 75% win rate seems pretty good! Paper link: https://law.stanford.edu/wp-content/uploads/2026/06/salinas_...
I wonder to what degree the AI was just better at communicating. My experience with attorneys is that they are often some of the worst writers.
Re: AI outperforms law professors in Stanford Law study
#9[flagged]
Just so you know, I have nothing to do with Stanford, but I am flagging this as conspiratorial nonsense. So when you comment is flagged, I just want you to know that it doesn't confirm your belief, it's just that this comment harms discussion and so must be removed.
Re: AI outperforms law professors in Stanford Law study
#10> In a blind evaluation of nearly 3,000 anonymized comparisons, professors rated AI responses significantly higher than answers written by other professors, with AI winning 75% of head-to-head matchups. 75% win rate seems pretty good! Paper link: https://law.stanford.edu/wp-content/uploads/2026/06/salinas_...
I do wish they'd used some more objective criteria. Simply being preferable one of the things LLMs have trained for since the beginning, hence its sycophantic nature.