Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Keep your AI claims in check

ftc.gov

Post reply on HN
Print view View original

101–110 of 308 posts

Re: Keep your AI claims in check

#101

Post by mc32 »

IncRnd wrote: post #13

Are you aware of the risks? You need to know about the reasonably foreseeable risks and impact of your AI product before putting it on the market. If something goes wrong – maybe it fails or yields biased results – you can’t just blame a third-party developer of the technology. And you can’t say you’re not responsible because that technology is a “black box” you can’t understand or didn’t know how to test. I'm remind…

I'll be elated if the FTC would go after advertisers and ad industry in general. There are almost no ads without exaggerated claims or ad with innuendo and insinuation of function but of course would not deliver on such.

Re: Keep your AI claims in check

#102

Post by nfgrep »

fabianhjr wrote: post #32

This message is not new. Advertisers should take another look at our earlier AI guidance, which focused on fairness and equity but also said, clearly, not to overpromise what your algorithm or AI-based tool can deliver. Whatever it can or can’t do, AI is important, and so are the claims you make about it. You don’t need a machine to predict what the FTC might do when those claims are unsupported. Really great and omi…

Not ominous, threatening, and somewhat juvenile IMO.

Re: Keep your AI claims in check

#103

Post by superfrank »

gandalfgeek wrote: post #95

Just me, or does this read like a Godfather-style warning? "Nice AI product you got over there. Would be a shame if something happened to it." But what's different about this AI product/hype cycle compared to every other cycle that tech has had? Why does the FTC feel the need to make proactive enforcement warnings about this one? What about crypto? Or going back further, the dotcom era?

Maybe they think not doing this in the past caused problems so they're trying something new?

Re: Keep your AI claims in check

#104

Post by gwright »

mc32 wrote: post #101
IncRnd wrote: post #13

Are you aware of the risks? You need to know about the reasonably foreseeable risks and impact of your AI product before putting it on the market. If something goes wrong – maybe it fails or yields biased results – you can’t just blame a third-party developer of the technology. And you can’t say you’re not responsible because that technology is a “black box” you can’t understand or didn’t know how to test. I'm remind…

I'll be elated if the FTC would go after advertisers and ad industry in general. There are almost no ads without exaggerated claims or ad with innuendo and insinuation of function but of course would not deliver on such.

Related: https://www.law.cornell.edu/wex/puffing

Re: Keep your AI claims in check

#105

Post by kyletns »

dylan604 wrote: post #4

wow, i would not have imagined a gov't agency to be agile enough to release something like this. i'm kind of impressed. here's to hoping this isn't just all bark and there's some actual teeth to his.

Lina Khan is running a new FTC and she's incredible

Re: Keep your AI claims in check

#107

Post by andrehacker »

dylan604 wrote: post #4

wow, i would not have imagined a gov't agency to be agile enough to release something like this. i'm kind of impressed. here's to hoping this isn't just all bark and there's some actual teeth to his.

Note that for the banking industry various “semi regulations” have been in place spawning a cottage industry for “Model Risk Management”. Basically you have to explain how you (attempt to) keep bias out of your training, re-test often, etc. Point is here that as a bank you don’t stop providing loans to certain demographies etc.

https://www.fdic.gov/news/financial-institution-letters/2017...

https://occ.gov/publications-and-resources/publications/comp...

Re: Keep your AI claims in check

#108

Post by abra0 »

jsemrau wrote: post #68

We are working on an AI product in a highly regulated industry (Investing). Recently we have been experimenting using the GPT3 API as a Junior Equity Analyst. On an eyeball check the results of the technology are impressive. The problem is that there is no way to validate the feedback on scale. I.e., we can't receive statistics about the feedback from the API. In contrast, for our own Entity Recognition models we can…

I'm not sure exactly what the ask here is.

>In contrast, for our own Entity Recognition models we can (and do) calculate probabilities that explain why a certain entity is shown.

>Hence, I think for API users of GPT3, OpenAI should return additional statistics why a certain result is returned the way it is to make it really useful and more importantly compliant.

For LLMs, you can get the same thing: the distribution of probabilities for the next token, for each token. But right now we cannot say why the probabilities are the way they are, same goes for your image recognition models.

Re: Keep your AI claims in check

#109

Post by dd36 »

Calvin02 wrote: post #76
dylan604 wrote: post #4

wow, i would not have imagined a gov't agency to be agile enough to release something like this. i'm kind of impressed. here's to hoping this isn't just all bark and there's some actual teeth to his.

On the contrary, FTC seems to have given up on pressing problems for the American consumers (like price gouging in broadband, generics, etc.) and is instead going after "trendy" topics that will get them and their leaders more press coverage.

The FTC wasn’t doing anything for decades. It’s doing a lot now… like it was made to do. Unchecked monopolization of so many markets has been terrible for the economy.

Re: Keep your AI claims in check

#110

Post by omarfarooq »

IncRnd wrote: post #79
jaredsohn wrote: post #29

Earlier quoted context omitted.

But if those things are considered AI then why would it matters if you market them as AI?

Why do you consider them to be AI? Random IF-THEN statements are not AI, or any program fragment would be AI. False advertisement is under the FTC's purvue. [1] When the Federal Trade Commission finds a case of fraud perpetrated on consumers, the agency files actions in federal district court for immediate and permanent orders to stop scams; prevent fraudsters from perpetrating scams in the future; freeze their asset…

So what's the FTC's definition of AI then?
Post reply on HN