Live data from Hacker News

ESPN AI recap of Alex Morgan’s final professional match fails to mention her

awfulannouncing.com

91–100 of 169 posts

Re: ESPN AI recap of Alex Morgan’s final professional match fails to mention her

#92

Earlier quoted context omitted.

> has gone unnoticed or noticed to little fanfare To be fair, I don't think it's gone unnoticed at all

Not by people in the know, no. But I'd say 80% of "normal" people reading sports websites probably had no idea until now, and the only difference is that (gen)AI is suddenly a "feature" to be boasted about to customers to make shareholders happy. And suddenly all of these normal people are starting to have opinions on it.

Much like when food ingredients are slowly made worse over time, consumers can't necessarily put their finger on how and why somethinng is worse, but they tend to notice that it's worse.

Re: ESPN AI recap of Alex Morgan’s final professional match fails to mention her

#94
post #48

Earlier quoted context omitted.

I don't think ESPN does anything that takes significant resources. That's all handled by SportsRadar or ... there's another big provider but their name alludes me. They basically firehose you all the game information as structured data and you can use it programmatically however you'd like.

I assume this is what lets baseball games show obscure factoids like "3rd in the NL West when facing left-handed pitchers on Tuesday"?

I imagine the primary customers of the data feeds are gambling companies who let people bet on matches that are in progress.

Re: ESPN AI recap of Alex Morgan’s final professional match fails to mention her

#95

It's pretty funny to me that this is used as a hit-piece against AI generated content. Here's an open-secret for everyone: web-based sports content companies have been automatically generating content articles for at least a decade; way before LLMs became popular. It is and was mostly done for search ranking. The more seemingly applicable content, the better your SEO. This situation has probably happened several time…

What web have you been browsing in the past 5+ years? It's not only sports "content". Any kind of content is drowned into low quality SEO pages. Auto generated or not, it's as useless. LLMs just generate it cheaper.

Re: ESPN AI recap of Alex Morgan’s final professional match fails to mention her

#97
post #50

This match was broadcast by ESPN on both ESPN2 and ESPN+. In that case, they are presumably paying two knowledgeable commentators to talk about the match before, during, and after it happens, adding context and describing the important events. Are they not providing a transcript of that to the writerbot? That seems like real low-hanging fruit, especially since the commentary is already live captioned.

Sports have so much structured data, and such a high bar for describing it accurately (especially for a brand like ESPN), that there are significant risks to the hallucinations that might develop from a multi-hour transcript being fed into an LLM, especially with commentators excited about potential goals and other events that don't end up happening.

On the other hand, the rather simple task of "here's a set of goals, their times, who made them, who assisted... turn that into prose" could even be done without LLMs with a deterministic algorithm, and may very well have been in this case. Some of the grammar issues in the OP feel very pre-LLM in nature, like a combination of substitution rules gone awry.

Now, could you create a system that repeatedly interrogates the statements made by a first pass of an LLM on summarizing a long transcript, and comparing those results against structured data you know for accuracy? Would this lead to richer content and accessible error rates relative to the simpler approach? Would this be the type of thing that the best machine learning engineers in the world could probably prototype over a hackathon? The answer is very possibly yes to all three of these. But it's far from low-hanging fruit for any sizable, risk-averse organization. It's very difficult to fight against "the thing we have is imperfect, but at least it never gets the facts wrong."

Re: ESPN AI recap of Alex Morgan’s final professional match fails to mention her

#98

It's pretty funny to me that this is used as a hit-piece against AI generated content. Here's an open-secret for everyone: web-based sports content companies have been automatically generating content articles for at least a decade; way before LLMs became popular. It is and was mostly done for search ranking. The more seemingly applicable content, the better your SEO. This situation has probably happened several time…

You're missing the entire point. LLMs are super overhyped and this is the 9000th example of how garbage LLM generated "content" is. It doesn't matter that garbage was being generated before. If LLMs were only being sold as "it might be better than the spam generator you're using today" we wouldn't have the current bubble where people are losing their jobs because C-suite clowns believe the hype.

If they were overhyped people would not actually lose their jobs

Re: ESPN AI recap of Alex Morgan’s final professional match fails to mention her

#99
post #50

This match was broadcast by ESPN on both ESPN2 and ESPN+. In that case, they are presumably paying two knowledgeable commentators to talk about the match before, during, and after it happens, adding context and describing the important events. Are they not providing a transcript of that to the writerbot? That seems like real low-hanging fruit, especially since the commentary is already live captioned.

I got nerd-snipped by this. I transcribed the match using the whisper-small.en and then asked ChatGPT to create a summary using a neutral prompt:

Here is a transcript of a soccer match. In the style of an experienced professional sports reporter, please write a 200 word article about the match.

Its summary starts, "In her final professional match, Alex Morgan delivered a performance filled with emotion and resilience, though her San Diego Wave fell short in a 3-1 loss to North Carolina Courage. The game at Snapdragon Stadium in San Diego was more than just a contest; it was a tribute to one of soccer’s most iconic figures."

It did get the score wrong. Here's the rest:

1. https://chatgpt.com/share/de8c60d1-69ab-4291-99dc-d4d95af3d3...

Re: ESPN AI recap of Alex Morgan’s final professional match fails to mention her

#100
post #72
post #55

Earlier quoted context omitted.

> If "this is the last game for Alex Morgan" wasn't included as any part of the input/prompt, how on earth could the AI summary have come up with this for inclusion in the game recap? It couldn't, which is the problem. One of the big selling points of generative AI is to cut people out of the process of writing. If someone actually has to watch the game and describe what happened in the prompt, what's the point of th…

I'm sure the fact that this would be Morgan's last game was somewhere out there on the Internet, and certainly should have been part of the training data, in which case I would guess that a more nuanced prompt to the AI could have elicited a more robust output.

LLM's general knowledge is trained on data that's months old (or longer). Alex Morgan only announced her retirement a few days ago, so in order for the AI to know about it, someone would need to pick out recent, relevant articles about her and feed it to the generator.

And even then, it's unclear that the AI would be smart enough to identify "retirement" as something that should be called out in the new article without specific prompting.

Post reply on HN