Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

'Megalopolis' trailer's fake critic quotes were AI-generated

variety.com

Post reply on HN
Print view View original

31–40 of 57 posts

Re: 'Megalopolis' trailer's fake critic quotes were AI-generated

#31

Post by nerdponx »

uses wrote: post #24
next_xibalba wrote: post #11

Earlier quoted context omitted.

I suspect all involved were aware of what was going on, and outsourcing the work to a consultant provides plausible deniability/a fall guy. This is not the first time in the history of film marketing that fake reviews have been used. [1] [1] https://en.wikipedia.org/wiki/David_Manning_(fictitious_writ...

Nah, that assumes everyone was paying attention and was perfectly coordinated in a stupid pointless effort that was bound to fail. It's a lot easier to believe the official explanation. Which is that someone typed in a prompt like "what are some quotes from famous movie reviewers that were negative about francis ford coppola's films?" and just copy-pasted the output without understanding that LLMs can make things up.…

When money is at stake, never attribute to incompetence what can be attributed to greed.

Yes, maybe some dingdong did this because they were stupid, and nobody bothered to check their work. But then you have to ask yourself: Why was a dingdong assigned to this task? Why was nobody competent assigned to check their work? And then hopefully you understand what's happening.

Re: 'Megalopolis' trailer's fake critic quotes were AI-generated

#32

Post by COAGULOPATH »

nsagent wrote: post #6

Was just talking with a microbiology researcher yesterday about ChatGPT. They use it for helping to write code for analyzing their lab data and they were surprised I said it's likely to lead them astray at times, especially if they don't know the code well enough to spot the errors it might generate. Despite my PhD being in NLP, they still seemed incredulous at my assertion. I truly think the general public have not…

My experience is the opposite: laypeople are excessively pessimistic on LLM progress ("AI is so dumb. It tells you to put glue on pizza and eat rocks)", usually due to a remembered anecdote that's either years old or reflects worst-case performance (only egregiously bad AI mistakes make the news).

Frontier models are better than they were and "feel" fairly reliable, although all the AI problems of 2021-2022 conceptually do still exist.

Re: 'Megalopolis' trailer's fake critic quotes were AI-generated

#33

Post by ChrisMarshallNY »

nsagent wrote: post #6

Was just talking with a microbiology researcher yesterday about ChatGPT. They use it for helping to write code for analyzing their lab data and they were surprised I said it's likely to lead them astray at times, especially if they don't know the code well enough to spot the errors it might generate. Despite my PhD being in NLP, they still seemed incredulous at my assertion. I truly think the general public have not…

I figured that out, the first time I submitted a Swift question to ChatGPT, where I would normally have used StackOverflow.

It hallucinated an Apple API call. Not just that, but that nonexistent call was the entire fulcrum of its "solution."

Re: 'Megalopolis' trailer's fake critic quotes were AI-generated

#34

Post by muzani »

nsagent wrote: post #6

Was just talking with a microbiology researcher yesterday about ChatGPT. They use it for helping to write code for analyzing their lab data and they were surprised I said it's likely to lead them astray at times, especially if they don't know the code well enough to spot the errors it might generate. Despite my PhD being in NLP, they still seemed incredulous at my assertion. I truly think the general public have not…

I think there's a segment of society that blindly believes anything data backed. This is pretty frequent in product and marketing too. The article here shows some people who blindly trusted their marketing teams.

And while everyone here are going to laugh at those chumps who use data driven stock price indicators or LLM code generators, they'll throw a fit if you tell them that the data on calories and vaccines aren't always that accurate either.

Re: 'Megalopolis' trailer's fake critic quotes were AI-generated

#35

Post by spacecadet »

No sympathy here. Ive been using AI for all sorts of tasks, but at the same time, going back and carefully reviewing the output or testing the code and making my own revisions. I think it's useful for giving it a request and doing something else while it creates a baseline. You still need to take that baseline and know what to do with it. Otherwise, blind leading the blind?

Re: 'Megalopolis' trailer's fake critic quotes were AI-generated

#36

Post by spacecadet »

Loughla wrote: post #26
krapp wrote: post #10

Earlier quoted context omitted.

>I wonder how long until that fact becomes commonplace. When it starts killing enough people to make the news.

I'm calling it now; people will be informed of the mistakes AI makes when the first "fake news" story pops up that has inaccuracies due to ai analysis of data. Then it will be all downhill from there.

We are already there! Humans misrepresent data on purpose in the media all the time in order to create misinformation and sway opinions. If anything AI creates deniability, "Oh our so and so used gpt, woops!"...

Re: 'Megalopolis' trailer's fake critic quotes were AI-generated

#37

Post by insane_dreamer »

nsagent wrote: post #6

Was just talking with a microbiology researcher yesterday about ChatGPT. They use it for helping to write code for analyzing their lab data and they were surprised I said it's likely to lead them astray at times, especially if they don't know the code well enough to spot the errors it might generate. Despite my PhD being in NLP, they still seemed incredulous at my assertion. I truly think the general public have not…

> I truly think the general public have not been adequately warned that they cannot trust the outputs of LLMs.

to the contrary, every company now advertises using "AI" (the latest handle for LLMs) to "solve X" with maybe some small print somewhere about the side effects, much like medication advertising

Did you see Google's ad during the Olympics? No mention of hallucinations that I recall (also probably the stupidest use case for LLMs they could have thought up; pretty shocking).

Re: 'Megalopolis' trailer's fake critic quotes were AI-generated

#38

Post by aidenn0 »

nsagent wrote: post #6

Was just talking with a microbiology researcher yesterday about ChatGPT. They use it for helping to write code for analyzing their lab data and they were surprised I said it's likely to lead them astray at times, especially if they don't know the code well enough to spot the errors it might generate. Despite my PhD being in NLP, they still seemed incredulous at my assertion. I truly think the general public have not…

One use of AI is to do something that you couldn't do yourself. In many cases that means it can successfully bullshit you.

Re: 'Megalopolis' trailer's fake critic quotes were AI-generated

#39

Post by insane_dreamer »

nsagent wrote: post #6

Was just talking with a microbiology researcher yesterday about ChatGPT. They use it for helping to write code for analyzing their lab data and they were surprised I said it's likely to lead them astray at times, especially if they don't know the code well enough to spot the errors it might generate. Despite my PhD being in NLP, they still seemed incredulous at my assertion. I truly think the general public have not…

I'm hearing of pressure for LLM-generated science-related apps, such as auto-generating workflows from natural language English for "non-coder scientists". It sounds wonderful, but unless the user 1) sees the workflow being generated, and 2) has the necessary skills to discern whether that workflow will generate the desired results, and 3) has the ability to modify the workflow/pipeline manually or continue prompting the LLM until it spits out the correct workflow (see #2), then it's not only useless, but dangerous.

Re: 'Megalopolis' trailer's fake critic quotes were AI-generated

#40

Post by axus »

nox101 wrote: post #17
uses wrote: post #4

> Sources tell Variety it was not Lionsgate or Egan’s intention to fabricate quotes, but was an error in properly vetting and fact-checking the phrases provided by the consultant On the one hand, it's surprising that none of the people involved in creating, publishing, and marketing this trailer raised an eyebrow. I don't know much about film history but I raised an eyebrow. And presumably, it took MANY people to mak…

As person making the video, you just get handed some text in email that says "add these quotes" There's no "show me the proof that these are legit". It's assumed I wouldn't expect anyone to check. One person in the chain made them up. Everyone after that took them as legit. > On the other hand, things like this likely get caught during production all the time and we just never hear about them. I seriously doubt it's…

After the quotes were added, did no one watch the video for quality problems before releasing it to the public? Maybe they didn't have any power to send it back to editing.
Post reply on HN