Live data from Hacker News

How to recognize AI snake oil [pdf]

cs.princeton.edu

21–30 of 364 posts

Re: How to recognize AI snake oil [pdf]

#21

Perhaps ML could be applied here to help filter out the barrage of AI snake oil. Funding, anyone?

The key claim of the presentation:

“For predicting social outcomes, AI is not substantially better than manual scoring using just a few features”

Suggests that only a simple heuristic is needed: if the AI salesman claims their product predicts a social outcome, like a candidate’s job performance or a person’s future criminality, it is snake oil.

Re: How to recognize AI snake oil [pdf]

#22
post #8

self-censored, fanboys don't buy it

Not to indulge the troll, but Arvind Narayanan is an (associate) professor of CS at Princeton and is one of the foremost researchers in the field on topics of ML/data privacy and ethics [0]. His papers/talks/tweets regularly attract attention on HN [1]. That you're judging the talk based on which conferences the author hasn't published in says more about your ignorance of the STS field than it does about the author's…

self-censored, fanboys don't buy it

Re: How to recognize AI snake oil [pdf]

#23
post #11

Earlier quoted context omitted.

Any type of heuristic search = AI. hand-made decision tree or lookup table = AI, Naive bayes = AI, KNN = AI. Uses numpy = AI. One employee in mobile app startup has graduate thesis in ML = AI startup. Approximate string matching in SQL query = AI. Not clear what the product is going to be = AI. "Information is not knowledge. Knowledge is not wisdom. Wisdom is not truth. Truth is not beauty. Beauty is not blockchain.…

In my space (cybersecurity) I’ve heard “more than 2 joins” (in an SQL context) is ML.

So it's turning into a meaningless buzzword.

Re: How to recognize AI snake oil [pdf]

#24
post #8

self-censored, fanboys don't buy it

Not to indulge the troll, but Arvind Narayanan is an (associate) professor of CS at Princeton and is one of the foremost researchers in the field on topics of ML/data privacy and ethics [0]. His papers/talks/tweets regularly attract attention on HN [1]. That you're judging the talk based on which conferences the author hasn't published in says more about your ignorance of the STS field than it does about the author's…

It seems his main research focus is poking holes in popular tech, especially when he is the main author.

Re: How to recognize AI snake oil [pdf]

#25
post #14
post #10

My company is sourcing AI from MTurk. It's actually cheaper than running fat GPU model training instances. The network learns fast and adapts well to changes in inputs. I envision the sticker "human inside" strapped on our algorithms.

You should emphasize that this is Organic AI. It's low carbon and overall greener.

Each unit uses about 100W continuously and emits about 1kg of CO2 per day before adding impact of supporting infrastructure.

These things better be smart, because they are not low-footprint.

Re: How to recognize AI snake oil [pdf]

#26
This was a really interesting read. In relation to the discussion of the predictive accuracy of a dataset with 13,000 features, I thought it might be worthwhile to bring up the idea of the "Curse of Dimensionality" for anyone unfamiliar: https://en.wikipedia.org/wiki/Curse_of_dimensionality

The "tl;dr" is basically that more features is not necessarily a panacea and can actually cause more problems.

Re: How to recognize AI snake oil [pdf]

#27
post #10

My company is sourcing AI from MTurk. It's actually cheaper than running fat GPU model training instances. The network learns fast and adapts well to changes in inputs. I envision the sticker "human inside" strapped on our algorithms.

Even companies like Facebook, Apple and Google employee humans to do work that people believe is done by "computers" and non of the companies seem keen on informing the public that they do in fact have humans scanning through massive amounts of data. So perhaps it is in fact cheaper, or the problems they face remains to hard for current types of AI.

Given the number of people Facebook employees to censor content and the mistakes they make I would label most of Facebooks AI claims as snake oil.

Re: How to recognize AI snake oil [pdf]

#28
post #6
post #2

Can we do blockchain next?

We don’t even need AI for that. Here’s some flawless pseudo-code: fn is-snake-oil: return !(coin is BTC or coin is in stable-coin-list)

Sadly, that gives a false negative for when coin is BTC or coin is in stable-coin-list.

Re: How to recognize AI snake oil [pdf]

#30
post #5

It seems like at least half the tech people I talk to work with AI now... no matter their field.

it turns out significant amounts of what I did in the past overlaps significantly with ML now: for example, hyperparameter exploration. I created a system years ago to do exploration by fitting polynomial surfaces, finding predicted maxima, and exploring those areas. Also, many of the algorithms underlying the area I did my PhD research in (molecular dynamics) are very similar to gradient descent.
Post reply on HN