Live data from Hacker News

Predicting where AI is going in 2020

venturebeat.com

61–70 of 88 posts

Re: Predicting where AI is going in 2020

#61

Earlier quoted context omitted.

> Now we have natural neural networks in the control loop for some reason despite their unknown error bounds. Not in any automatic control loops. All control loops that do this have a human as the final piece of the pipeline, and that human is legally responsible for the outcome of the control loop. That defeats the point of automatic control. > To give another example: is there a sensor for vehicle placement relativ…

Well actually, they are allowed in the automotive world, re: Tesla. They won't necessarily lower the standard for some applications if the alternative is just regular people at the wheel.

> Well actually, they are allowed in the automotive world, re: Tesla.

This is false: Tesla's "autopilot" isn't a control-loop, much less a certified control-loop. What Tesla calls "autopilot" is actually a "driving assistant". It is not in charge of controlling the car, but it is allowed to assist the driver to control the car.

This is a subtle but very important difference, since this is the reason that Tesla tells its owners to always keep the hands on the steering wheel, and Tesla cars are required to disable their "driving assistant" in countries like Germany if the driver hands leave the steering wheel. It is also the reason that Tesla is not liable if a car with "autopilot" kills somebody, because the "autopilot" isn't technically driving the car, the driver is.

The word "autopilot" comes from the aerospace industry, where pilots are not required to keep their hand on the controls or pay attention when the "autopilot" is on, and the manufacturer is liable if the "autopilot" screws up (e.g. see Boing). Tesla's usage of the word "autopilot" to refer to driving assistants is misleading and dangerous.

A true car "autopilot" is what people call "Level 5" in the autonomous driving community. Elon Musk promised to ship 10.000 self-driving Level 5 Tesla taxis in 2019, and now mid 2020. We'll see about that.Elon Musk has been saying that Level 5 will happen next year for the last 10 years, so at least when it comes to autonomous driving, their predictions have been consistently wrong.

Most CEOs who adventure to predict when Level 5 will happen say something like "not before 2030". And Waymo's goal is to achieve """Level 5""" in a very small restricted area of Phoenix downtown for some restricted weather conditions some time between 2020-2030, but it is unclear what the road after achieving it would be for certification, and the road from there to actual, real, Level 5 is still unclear at this point.

Re: Predicting where AI is going in 2020

#62
post #9

>Human babies don’t get tagged data sets, yet they manage just fine, and it’s important for us to understand how that happens I do not really understand this. Human babies get a constant stream of labeled information from their parents. Contextualized speech is being fed to them for years. Toddlers repeat everything you say. Is this referring to something else that babies can do?

I'm curious to know what you mean by "labelled information". I'm guessing that what you are calling "labelled information" is various forms of encouragement or discouragement that could be considered positively and negatively "labelled" examples. If that is the case, linguistics research back in the '70s found that infants get almost no negative examples of, in particular, language. For example, a parent will not cor…

By now, the Chomskian approach to linguistics is not unchallenged anymore and there is some doubt on whether the "poverty of stimulus" argument holds any water (see e.g. [1]).

IMHO, modern cognitive science based approaches (such as by Tomasello and others) have a better chance of explaining how language is acquired than the hypothesising of the 70s.

I don't have time now to go into more references, but the question is far from settled.

[1] https://scottthornbury.wordpress.com/2015/06/07/p-is-for-pov...

Re: Predicting where AI is going in 2020

#64
I predict the broader ML/DL community will keep pumping out iterative papers that push the ball just a little bit forward while maintaining job security : Gatekeeping, no one thinking outside of the box, benchmark putting, just enough for the appearance of progress, and nothing broadly innovative or disruptive. The applications of ML/DL will continue to be gimmicky consumer products that have questionable valuable, questionable profit potential, add even more to disinformation/misinformation, produce more informational noise, only serve to rebuff a big corp's cloud offerings, and waste people's time. I predict tons more 'bought' articles that hype up AI technology for the typical 'household' names. I predict the same ol' echo chamber of thought and reinforcement of 'gatekept' ideology. I expect a number of more prominent articles critiquing the shortfalls of the technology. I expect a number of young minds steeped in DL/ML coming to the realization that it's not what they expected... That its a big profit/revenue story for Universities and established corporate platforms. I expect a number of them to realize ML/DL is truly not "AI" or anything close to it. That they aren't doing cutting edge research and that they are not allowed to think outside of the echo chamber of 'approved' approaches.

I predict more useless chatbots that utter unpredictable word salads. I expect more gimmicky entertainment focused uses of it. I expect more assistants being adopted for data collection. I expect more people who aren't busy or doing anything important, using assistance assistants and text-to-speech to speed up their tasks so they can waste more of their time on social media/youtube/entertainment. Samsung Neon is coming out in some days.. making use of that 'Viv' acquisition.

I expect more feverish attempts at attacking low hanging fruit jobs with overly complex solutions. I predict failures in a number of startups targeting this. I predict no pronounced progress in self-driving cars nor any particular grand use for them. I predict several hollow attempts to overlay symbolic systems over ML/DL or integration attempts of it with ML/DL from prominent AI figures. I predict pronounced failures in this effort cementing a partial end to the hype of ML/DL.

I predict we will get a pronounced development outside of run-of-the-mill corporate/academic gatekept/walled garden ML/DL that will forge a new and higher path for AI. Hinton's words from prior years will have been heeded and the results of a new approach to AI presented. A change of guard, a break from the necessity of a PhD, a break from the echo-chamber of names, and a broader and more deeply thought out vision. Disruption not of low-hanging-fruit but disruption directed at the heart of the AI/Technology industry... So that we may finally progress from this stalled out disinformation/misinformation/hype/gatekeeping/cloud/all-your data-belongs-to-us cycle.

It's 2020 after-all, time for a new age.

Re: Predicting where AI is going in 2020

#65
post #9

>Human babies don’t get tagged data sets, yet they manage just fine, and it’s important for us to understand how that happens I do not really understand this. Human babies get a constant stream of labeled information from their parents. Contextualized speech is being fed to them for years. Toddlers repeat everything you say. Is this referring to something else that babies can do?

I'm curious to know what you mean by "labelled information". I'm guessing that what you are calling "labelled information" is various forms of encouragement or discouragement that could be considered positively and negatively "labelled" examples. If that is the case, linguistics research back in the '70s found that infants get almost no negative examples of, in particular, language. For example, a parent will not cor…

> How would this lack of shared context be resolved between an adult and a baby, so that the adult could provide "multi class labels"?

The baby would do multi-modal learning - learning the associated sound (name) with an image (object).

I don't think the parent and baby lack a shared context. They are both agents in the same environment, who often interact and cooperate to achieve goals and maximise rewards. The baby understands the world much earlier than can speak, the context is there.

Re: Predicting where AI is going in 2020

#66
post #48

Earlier quoted context omitted.

I would argue most machine learning papers that use public datasets have code available and are often also reproduced independently (sometimes just because of somebody's need to port between PyTorch/TensorFlow). Reproducibility is still a big problem in reinforcement learning, however. People are definitely thinking carefully about issues of noise and quantization error. Low-precision or quantized neural networks are…

>I would argue most machine learning papers that use public datasets have code available and are often also reproduced independently lol have you ever tried? i have several github issues on published models because i couldn't recreate that have responses like "i don't remember the parameters i used and we've moved on".

i’ve only run into stuff like that trying to get RL agents to train. Maybe GANs and other “hard to train” models are bad too idk. But generally things do actually seem to be reproducible.

Re: Predicting where AI is going in 2020

#67
post #64

I predict the broader ML/DL community will keep pumping out iterative papers that push the ball just a little bit forward while maintaining job security : Gatekeeping, no one thinking outside of the box, benchmark putting, just enough for the appearance of progress, and nothing broadly innovative or disruptive. The applications of ML/DL will continue to be gimmicky consumer products that have questionable valuable, q…

Apparently there is nothing positive possible in AI, based on your predictions. Is there?

Re: Predicting where AI is going in 2020

#68
post #66

Earlier quoted context omitted.

>I would argue most machine learning papers that use public datasets have code available and are often also reproduced independently lol have you ever tried? i have several github issues on published models because i couldn't recreate that have responses like "i don't remember the parameters i used and we've moved on".

i’ve only run into stuff like that trying to get RL agents to train. Maybe GANs and other “hard to train” models are bad too idk. But generally things do actually seem to be reproducible.

>Maybe GANs and other “hard to train” models

yes GANs are definitely one of the places i've run into this but also with almost bog-standard resnets i've had issues.

Re: Predicting where AI is going in 2020

#69
Some axioms that I'm not seeing talked about much:

* Artificial general intelligence (AGI) is the last problem in computer science, so it should be at least somewhat alarming that it's being funded by internet companies, wall street and the military instead of, say, universities/nonprofits/nonmilitary branches of the government.

* Machine learning is conceptually simple enough that most software developers could work on it (my feeling is that the final formula for consciousness will fit on a napkin), but they never will, because of endlessly having to reinvent the wheel to make rent - eventually missing the boat and getting automated out of a job.

* AI and robot labor will create unemployment and underemployment chaos if we don't implement universal basic income (UBI) or at the very least, reform the tax system so that automation provides for the public good instead of the lion's share of the profit going to a handful of wealthy financiers.

* Children aren't usually exposed to financial responsibility until around the age of 15 or so, so training machine learning for financial use is likely to result in at least some degree of sociopathy, wealth inequality and further entrenchment of the status quo (what we would consider misaligned ethics).

* Humans may not react well when it's discovered that self-awareness is emotion, and that as computers approach sentience they begin to act more like humans trapped in boxes, and that all of this is happening before the world can even provide justice and equality for the "other" (women, minorities, immigrants, oppressed creeds, intersexed people, the impoverished, etc etc etc).

My prediction for 2020: nothing. But for 2025: an optimal game-winning strategy is taught in universities. By 2030: the optimal game-winning strategy is combined with experience from quantum computing to create an optimal search space strategy using exponentially fewer resources than anything today (forming the first limited AGI). By 2035: AGI is found to require some number of execution cycles to evolve, perhaps costing $1 trillion. By 2040: cost to evolve AGI drops to $10 billion and most governments and wealthy financiers own what we would consider a sentient agent. By 2045: AGI is everywhere and humanity is addicted to having any question answered by the AGI oracle so progress in human-machine merging, immortality and all other problems are predicted to be solved within 5 years. By 2050: all human problems have either been enumerated or solved and attention turns to nonhuman motives that can't be predicted (the singularity).

Re: Predicting where AI is going in 2020

#70
post #67
post #64

I predict the broader ML/DL community will keep pumping out iterative papers that push the ball just a little bit forward while maintaining job security : Gatekeeping, no one thinking outside of the box, benchmark putting, just enough for the appearance of progress, and nothing broadly innovative or disruptive. The applications of ML/DL will continue to be gimmicky consumer products that have questionable valuable, q…

Apparently there is nothing positive possible in AI, based on your predictions. Is there?

Apparently, a lot of the positives are broadly overhyped because such hype and misrepresentation keep money in people's pockets, ventures overvalued, universities with a steady pipeline of warm bodies paying 40-50k a year, and a movement sustained. Apparently, you can't do this forever.
Post reply on HN