Live data from Hacker News

Keep your AI claims in check

ftc.gov

61–70 of 308 posts

Re: Keep your AI claims in check

#61
post #13

Are you aware of the risks? You need to know about the reasonably foreseeable risks and impact of your AI product before putting it on the market. If something goes wrong – maybe it fails or yields biased results – you can’t just blame a third-party developer of the technology. And you can’t say you’re not responsible because that technology is a “black box” you can’t understand or didn’t know how to test. I'm remind…

Good job, FTC Hopefully it goes after some people. I once worked for a founder who was running afoul off some FTC regulations. When the team brought it to his attention, he claimed to have never heard of the FTC. When we explained what the FTC is, he started arguing with us saying it had no authority over him, and he'll make the decisions for his business. Money really does make some people crazy.

Does the money make them crazy or does the system reward the crazy?

Markets can produce some unexpected winners...

Re: Keep your AI claims in check

#62
post #13

Are you aware of the risks? You need to know about the reasonably foreseeable risks and impact of your AI product before putting it on the market. If something goes wrong – maybe it fails or yields biased results – you can’t just blame a third-party developer of the technology. And you can’t say you’re not responsible because that technology is a “black box” you can’t understand or didn’t know how to test. I'm remind…

Good job, FTC Hopefully it goes after some people. I once worked for a founder who was running afoul off some FTC regulations. When the team brought it to his attention, he claimed to have never heard of the FTC. When we explained what the FTC is, he started arguing with us saying it had no authority over him, and he'll make the decisions for his business. Money really does make some people crazy.

The FTC requires political headwinds measured in decades to do appreciably good work

Re: Keep your AI claims in check

#63
post #38
post #4

wow, i would not have imagined a gov't agency to be agile enough to release something like this. i'm kind of impressed. here's to hoping this isn't just all bark and there's some actual teeth to his.

> here's to hoping this isn't just all bark and there's some actual teeth to his. Let's see what the article says: > When you talk about AI in your advertising, the FTC may be wondering, among other things: (...) Just "wondering", no teeth.

you can be assured that's how the FTC points out the teeth

Re: Keep your AI claims in check

#65

“It’s an ambiguous term with many possible definitions.” “Does the product actually use AI at all? If you think you can get away with baseless claims…” Last I checked basic optimization techniques like simulated annealing and gradient descent - as well as a host of basic statistical tools - are standard parts of an introductory AI textbook. I’ve been on the receiving end of government agency enforcement (SEC) and it…

I know of at least one startup that claimed to use AI (including having AI in the company name), but in actuality humans did nearly all of the work. Hoped that once they got enough customers (and supposedly "proved the concept"), they could figure out how to use AI instead. I bet this is/was somewhat common.

I also see many (particularly "legacy") products say they're "AI-driven" or "powered by AI", when in actuality one minor feature uses some AI, even in the broadest sense.

Re: Keep your AI claims in check

#67

How are the companies of tomorrow supposed to innovate when they’re strangled by behaving responsibly??

it hasn't been a problem for the social platforms or other companies operating in the hovering of personal data for profit. the trick is to get too big to fail status before gov't agencies can come shut you down.

> the trick is to get too big to fail status before gov't agencies can come shut you down.

While avoiding getting bought by Elon \o/

Re: Keep your AI claims in check

#68
We are working on an AI product in a highly regulated industry (Investing). Recently we have been experimenting using the GPT3 API as a Junior Equity Analyst. On an eyeball check the results of the technology are impressive.

The problem is that there is no way to validate the feedback on scale. I.e., we can't receive statistics about the feedback from the API.

In contrast, for our own Entity Recognition models we can (and do) calculate probabilities that explain why a certain entity is shown.

Hence, I think for API users of GPT3, OpenAI should return additional statistics why a certain result is returned the way it is to make it really useful and more importantly compliant.

Re: Keep your AI claims in check

#69
post #43

Earlier quoted context omitted.

> Ignorance of your "black box" excuses not Hopefully the FTC understands linear separability. Because I often get the impression that people who want ML models to be explicable don’t, and are expecting the mathematically impossible.

If the system your building is "mathematically impossible" to explain in a way that would be expected of every other system. Maybe you shouldn't be building that system.

Mathematical explanation is not required in many areas.

Perhaps you can’t perfectly explain it but you can at least understand it statistically.

For example is not currently possible to mathematically explain people’s behaviour, but there is statistical evidence and also accountability on an individual. Eg a doctor making a decision about a scan result.

Re: Keep your AI claims in check

#70
Oh man... And this is a government agency. Such proactive and articulate. No wonder US is where it is for it's wonderful state apparatus. It certainly has its fair share of failures but this is at a whole another level.
Post reply on HN