Earlier quoted context omitted.
I'm a little surprised to see this sentiment. Some of the most important advances in the field have been unsupervised tasks: - OpenAI: Dota 2 (PPO), GPT-2... - NVidia: StyleGAN, BigGAN, ProGAN...
I would argue that GAN's by definition aren't unsupervised, they just aren't supervised by humans. Additionally, OpenAI's game stuff also has similar arguments against it.
How to recognize AI snake oil [pdf]
71–80 of 364 posts
Re: How to recognize AI snake oil [pdf]
#72Earlier quoted context omitted.
You should emphasize that this is Organic AI. It's low carbon and overall greener.
Or keep calling it AI, and concede that AI stands for "actual intelligence" if someone asks you directly.
The term AI is used as if humanity now has figured out general AI or artificial general intelligence (AGI). It's quite obvious organizations and people use the term AI to fool the less tech inclined into thinking it's AGI - a real thinking machine.
Re: How to recognize AI snake oil [pdf]
#73http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.188...
Re: How to recognize AI snake oil [pdf]
#74I worked at a place that was selling ML powered science instrument output analysis. It did not work at all (fake it till you make it is normal, was told). So there was a person in the loop (machine output -> internet -> person doing it manually pretending to be machine -> internet -> report app). The joke was “organic neural net.” Theranos of the North! ML is a great and powerful pattern matcher (talking about NN not…
Re: How to recognize AI snake oil [pdf]
#75What I dislike far more than the idea of using such systems to predict social outcome is that the usage of such systems is done behind closed doors. I would be much more willing to accept such systems if the law required any system to be fully accessible online, including the current neural network, how it was trained, and training data used to train it (if the training data cannot be shared online, then the neural n…
Re: How to recognize AI snake oil [pdf]
#76Earlier quoted context omitted.
I would argue that GAN's by definition aren't unsupervised, they just aren't supervised by humans. Additionally, OpenAI's game stuff also has similar arguments against it.
The discriminator definitely is supervised but the generator is unsupervised. I.e., it has no labels on its targets.
I think I see what you're saying, but that might be a different definition of "supervised". It seems impossible for one half of the same algorithm to be supervised and the other to be unsupervised. But I like your definition (if it was renamed to something else) because you're right that the discriminator is the only thing that pays attention to the training data, whereas the generator does not.
Re: How to recognize AI snake oil [pdf]
#77Catch 22
Re: How to recognize AI snake oil [pdf]
#78Earlier quoted context omitted.
Those are certainly important advances, but they don't really apply to most business needs for AI or ML.
I work in the industry on NLP tasks. Unsupervised learning has been behind the largest developments in the last decade in the field.
From Google in 2018:
"One of the biggest challenges in natural language processing (NLP) is the shortage of training data. Because NLP is a diversified field with many distinct tasks, most task-specific datasets contain only a few thousand or a few hundred thousand human-labeled training examples. However, modern deep learning-based NLP models see benefits from much larger amounts of data, improving when trained on millions, or billions, of annotated training examples. To help close this gap in data, researchers have developed a variety of techniques for training general purpose language representation models using the enormous amount of unannotated text on the web (known as pre-training). The pre-trained model can then be fine-tuned on small-data NLP tasks like question answering and sentiment analysis, resulting in substantial accuracy improvements compared to training on these datasets from scratch."
Re: How to recognize AI snake oil [pdf]
#79I interviewed at a startup that seemed fishy. They offer a fully AI powered customer service chat as an off the shelf black box to banks. I highly suspect that they were a pseudo AI setup. LinkedIn shows that they are light on developers but very heavy on “trainers”, probably the people who actually handle the customers, mostly young graduates in unrelated fields, who may believe that their interactions will be the necessary data to build a real AI.
I doubt that AI will ever be built, it's just a glorified Mechanical Turk help-desk. I guess the banks will keep it going as long as they see near human level outputs.
Re: How to recognize AI snake oil [pdf]
#80Earlier quoted context omitted.
Or keep calling it AI, and concede that AI stands for "actual intelligence" if someone asks you directly.
AI now is like Cyber was in the 1990s it's seems to be nothing but a buzzword for many organizations to throw around. The term AI is used as if humanity now has figured out general AI or artificial general intelligence (AGI). It's quite obvious organizations and people use the term AI to fool the less tech inclined into thinking it's AGI - a real thinking machine.
I suppose their only real sin was business suits. Everything seems more credible if you say it while wearing a hoodie.