Live data from Hacker News

Keep your AI claims in check

ftc.gov

71–80 of 308 posts

Re: Keep your AI claims in check

#71
post #68

We are working on an AI product in a highly regulated industry (Investing). Recently we have been experimenting using the GPT3 API as a Junior Equity Analyst. On an eyeball check the results of the technology are impressive. The problem is that there is no way to validate the feedback on scale. I.e., we can't receive statistics about the feedback from the API. In contrast, for our own Entity Recognition models we can…

[flagged]

Re: Keep your AI claims in check

#72
post #43

Earlier quoted context omitted.

> Ignorance of your "black box" excuses not Hopefully the FTC understands linear separability. Because I often get the impression that people who want ML models to be explicable don’t, and are expecting the mathematically impossible.

If the system your building is "mathematically impossible" to explain in a way that would be expected of every other system. Maybe you shouldn't be building that system.

Non-linear models often perform better. You’re never going to approach anything like GPT with a linear model.

Re: Keep your AI claims in check

#73

I hope people develop a better understanding of this than the bloody coin fiasco. Society can’t effectively deal with something it considers magic - even a low resolution understanding + accessible expertise will help massively (think law or medicine). Take Chat GPT. In the case of humans, language is just a way to express knowledge. In ChatGPT its the other way around - the focus is the correctness of the word chain…

I have no higher hopes that AI products will be regulated any better than cryptocurrencies. Fundamentally they both operate at breakneck speeds which regulators have proven they can only, at best, react to damage being done. Maybe they surprise us all and proactively regulate AI well, but they'd have to prove that instead of being taken at their word like this press release. Technology's speed combined with human greed is what allows it to do damage before regulation knows what's going on, and that fundamental difference isn't likely to change.

Re: Keep your AI claims in check

#74

“It’s an ambiguous term with many possible definitions.” “Does the product actually use AI at all? If you think you can get away with baseless claims…” Last I checked basic optimization techniques like simulated annealing and gradient descent - as well as a host of basic statistical tools - are standard parts of an introductory AI textbook. I’ve been on the receiving end of government agency enforcement (SEC) and it…

Exactly this.

Re: Keep your AI claims in check

#76
post #4

wow, i would not have imagined a gov't agency to be agile enough to release something like this. i'm kind of impressed. here's to hoping this isn't just all bark and there's some actual teeth to his.

On the contrary, FTC seems to have given up on pressing problems for the American consumers (like price gouging in broadband, generics, etc.) and is instead going after "trendy" topics that will get them and their leaders more press coverage.

Re: Keep your AI claims in check

#77
post #45

Earlier quoted context omitted.

I went ahead and put in this prompt to ChatGPT ( https://chat.openai.com/chat ): ==================== > Write a press release from the FTC that warns companies to be careful of promises using "AI". ==================== FOR IMMEDIATE RELEASE FTC Warns Companies to be Careful of Promises using "AI" Washington, D.C. - The Federal Trade Commission (FTC) is warning companies that use artificial intelligence (AI) to be car…

For once the URL is actually working!

I paid for the ChatGPT Plus version the other day, I wanted to use it reliably.

Re: Keep your AI claims in check

#78
Do we really need the government to tell us what AI is? Does anybody really know or is the complete final authority on the subject? If The government had told us what the internet's limits were in the 90s it's doubtful they would have been correct and they would have scared away a lot of innovation.

Re: Keep your AI claims in check

#79
post #17

Earlier quoted context omitted.

The entire post was about keeping AI claims in check. Whether you market your IF-THEN statements or rules-based expert systems as AIs is what matters.

But if those things are considered AI then why would it matters if you market them as AI?

Why do you consider them to be AI? Random IF-THEN statements are not AI, or any program fragment would be AI. False advertisement is under the FTC's purvue. [1]

  When the Federal Trade Commission finds a case of fraud
  perpetrated on consumers, the agency files actions in
  federal district court for immediate and permanent orders
  to stop scams; prevent fraudsters from perpetrating scams
  in the future; freeze their assets; and get compensation
  for victims.When consumers see or hear an advertisement,
  whether it’s on the Internet, radio or television, or
  anywhere else, federal law says that ad must be truthful,
  not misleading, and, when appropriate, backed by scientific
  evidence.
[1] https://www.ftc.gov/news-events/topics/truth-advertising

Re: Keep your AI claims in check

#80
I regenerated a ChatGPT response with the same prompt and got some totally made up quotes from the (real) FTC Chair. Just remember, it's a talking machine, not an intelligent one.

FTC Warns Companies to Be Careful of Promises Using "AI"

Washington, D.C. - The Federal Trade Commission (FTC) is warning companies to be careful of making deceptive or misleading promises regarding the use of artificial intelligence (AI) in their products or services.

As the use of AI becomes increasingly prevalent in a wide range of industries, companies may be tempted to tout their use of the technology as a selling point. However, the FTC cautions that such claims must be substantiated and truthful, and not likely to mislead consumers.

"The use of AI can bring significant benefits to consumers, but it is important that companies are transparent and truthful about the capabilities of their products and services," said FTC Chair Lina Khan. "Claims that are unsubstantiated or misleading can harm consumers and undermine trust in the marketplace."

The FTC has issued guidance to help companies understand their obligations under the law when making claims about the use of AI. Among other things, the guidance advises companies to ensure that any claims about the capabilities of their AI systems are backed up by sound science and evidence.

The FTC also warns against making claims that suggest AI can perform tasks that it cannot. For example, a company cannot claim that its AI system can accurately diagnose a medical condition if it has not been adequately tested and validated for that purpose.

Finally, the FTC cautions that companies must be transparent about how they use consumer data in their AI systems. Consumers have a right to know what data is being collected, how it is being used, and how it is being protected.

"AI has the potential to transform many aspects of our lives, but companies must use it responsibly and ethically," said Khan. "The FTC will continue to monitor the marketplace and take action against companies that deceive or mislead consumers."

The FTC's guidance on the use of AI can be found on its website at www.ftc.gov.

Contact: FTC Office of Public Affairs Phone: 202-326-2180

Post reply on HN