An Epidemic of AI Misinformation

#1

Post by hughzhang » Sat, Nov 30, 2019, 9:06 PM UTC

An Epidemic of AI Misinformation
thegradient.pub

Re: An Epidemic of AI Misinformation

#2

Post by ggm » Sat, Nov 30, 2019, 10:06 PM UTC

Very hard to critique an article you overwhelmingly agree with!

The key point I kept picking up was the extent to which a press willing to laud a discovery was reticent about owning the clinb-down.

Peer review in ML journals should be tighter maybe? If you solve a limited subset of the three body problem you can't claim to solve "the three body problem" and if you apply a well known Rubik's cube model solution you didn't learn it, you had it baked in.

Re: An Epidemic of AI Misinformation

#3

Post by minimaxir » Sat, Nov 30, 2019, 10:17 PM UTC

I dunno if the GPT-2 examples are misinformation, more like exaggeration for PR, which is admittingly a separate problem in AI. (marketing hype vs. actual falsity)

Re: An Epidemic of AI Misinformation

#4

Post by buboard » Sat, Nov 30, 2019, 10:30 PM UTC

Ugh. I dislike the author s permanent negativity, but he s right about a lot. I think it’s worth asking why people feel the need to lie about the future of AI? If they are confident about its future (and I don’t know of a fundamental reason why they would not be) then there is no reason to rush half assed results out the door and overcompensate (like gpt2). There is plenty of theoretical questions and answers to debate publicly instead. I don’t know if its the fear of some impending tech recession or fear of their own incompetence

Re: An Epidemic of AI Misinformation

#5

Post by [deleted] » Sat, Nov 30, 2019, 10:31 PM UTC

ggm wrote: post #2

Very hard to critique an article you overwhelmingly agree with! The key point I kept picking up was the extent to which a press willing to laud a discovery was reticent about owning the clinb-down. Peer review in ML journals should be tighter maybe? If you solve a limited subset of the three body problem you can't claim to solve "the three body problem" and if you apply a well known Rubik's cube model solution you di…

[deleted]

Re: An Epidemic of AI Misinformation

#6

Post by brenden2 » Sat, Nov 30, 2019, 10:35 PM UTC

minimaxir wrote: post #3

I dunno if the GPT-2 examples are misinformation , more like exaggeration for PR, which is admittingly a separate problem in AI. (marketing hype vs. actual falsity)

Hype and exaggeration is just another form of falsification.

Re: An Epidemic of AI Misinformation

#7

Post by barbecue_sauce » Sat, Nov 30, 2019, 10:35 PM UTC

minimaxir wrote: post #3

I dunno if the GPT-2 examples are misinformation , more like exaggeration for PR, which is admittingly a separate problem in AI. (marketing hype vs. actual falsity)

Exaggerated Information + Trusting & Uneducated Consumers = Misinformation

Re: An Epidemic of AI Misinformation

#8

Post by Barrin92 » Sat, Nov 30, 2019, 10:38 PM UTC

buboard wrote: post #4

Ugh. I dislike the author s permanent negativity, but he s right about a lot. I think it’s worth asking why people feel the need to lie about the future of AI? If they are confident about its future (and I don’t know of a fundamental reason why they would not be) then there is no reason to rush half assed results out the door and overcompensate (like gpt2). There is plenty of theoretical questions and answers to deba…

>Ugh. I dislike the author s permanent negativity, but he s right about a lot.

Yes, in a way it must suck to always act like the grumpy party-crasher but Gary Marcus is absolutely spot on when it comes to the facts. That interview with the economist had me shaking my head, everyone had to know within five seconds that the chance that this is uncurated is zero.

Re: An Epidemic of AI Misinformation

#9

Post by [deleted] » Sat, Nov 30, 2019, 10:42 PM UTC

buboard wrote: post #4

Ugh. I dislike the author s permanent negativity, but he s right about a lot. I think it’s worth asking why people feel the need to lie about the future of AI? If they are confident about its future (and I don’t know of a fundamental reason why they would not be) then there is no reason to rush half assed results out the door and overcompensate (like gpt2). There is plenty of theoretical questions and answers to deba…

[deleted]

Re: An Epidemic of AI Misinformation

#10

Post by buboard » Sat, Nov 30, 2019, 10:48 PM UTC

ggm wrote: post #2

Very hard to critique an article you overwhelmingly agree with! The key point I kept picking up was the extent to which a press willing to laud a discovery was reticent about owning the clinb-down. Peer review in ML journals should be tighter maybe? If you solve a limited subset of the three body problem you can't claim to solve "the three body problem" and if you apply a well known Rubik's cube model solution you di…

do most of the hyped papers have peer review even? the field moves too fast for that, press releases are issued as soon as the first draft is on arxiv.