Live data from Hacker News

Past Performance is Not Indicative of Future Results (2020)

locusmag.com

11–20 of 285 posts

Re: Past Performance is Not Indicative of Future Results (2020)

#11

This article is mostly a straw man, while still containing some valid ML criticism. I am a ML s(c|k)eptic too, in that popular conceptions of what ML is currently overpromise, often don't even understand what ML actually is, and are often just some layperson's imagination about what "artificial intelligence" might do. This article is the opposite. He's treating ML as basically a simple supervised architecture that do…

That's how I felt too. Most of the article is trying to pull us with an emotional attachment (mostly to racist things a computer will do if tasked to do important things). While that criticism is welcome, it's not specifically meaningful towards an argument against AGI. The only part that was seemed to be that statistical inference is not a path to AGI which is somehow backed up by the emotional stuff.

What deep learning seems to step into more and more is time-based statistical inference.

AGI is not:

seeing that a girl has a frown on their face.

seeing that a girl has a frown, because someone said "you look fat"

seeing that a girl has a frown because her boyfriend said you look fat

seeing that Maya has generally been upset with her boyfriend who also most recently told her she is fat.

But keep going and going and going and we might get somewhere. Do we have the computer power to keep going? I don't know.

Re: Past Performance is Not Indicative of Future Results (2020)

#14
I think he's doing a bit of bait and switch there. Knowing reliably whether arrests are genuinely racist or if winks are flirtatious is superhuman intelligence.

> But the idea that if we just get better at statistical inference, consciousness will fall out of it is wishful thinking.

I'm a mostly disinterested spectator in current AI research, and even I know that it's not all about that. Just google "AI alignment" for an example, and god only knows what's going on in private research.

Re: Past Performance is Not Indicative of Future Results (2020)

#15

Are there any approaches to artificial intelligence that do involve qualitative data or don’t rely entirely on statistical inference?

Not really adjacent to what we do today.

I view A.I. as dual to "neoliberal M.B.A. culture". Just as the business schools taught that managers should be generalists without craft knowledge applying coarse microeconomics, A.I. that we have created is the ultimate pliant worker that also knows nothing deep and works from statistics. In a bussiness ecosystem where analytics and presentations are more important than doing things, they are a perfect match. Of course, a bunches of statistician-firms chasing each other in circles is going to exhibit the folly, not wisdom, of crowds.

I think solution is to face reality that more people need to learn programming, and more domain knowledge needs to be codified old school. https://www.ma.imperial.ac.uk/~buzzard/xena/ I thus think is perhaps the best application of computing, ever.

Training A.I. to be a theorem prover tactic is a great way to make it better: if we can't do theory and empiricism at the same time, we can at least do meta-empiracism on theory building!

I think once we've codified all the domains like that and been running A.I. on the theories, we'll be better positioned to go back to the general A.I. problem, but we might also decided the "manually programmed fully automated society" is easier to understand and steer, and thus less alienation, and we won't even want general A.I.

Re: Past Performance is Not Indicative of Future Results (2020)

#16
> I am an AI skeptic. I am baffled by anyone who isn’t. I don’t see any path from continuous improvements to the (admittedly impressive) ‘machine learning’ field that leads to a general AI

- I share the skepticism towards any progress towards 'general AI' - I don't think that we're remotely close or even on the right path in any way.

- That doesn't make me a skeptic towards the current state of machine learning though. ML doesn't need to lead to general AI. It's already useful in its current forms. That's good enough. It doesn't need to solve all of humanity's problems to be a great tool.

I think it's important to make this distinction and for some reason it's left implicit or it's purposefully omitted from the article.

Re: Past Performance is Not Indicative of Future Results (2020)

#17

Are there any approaches to artificial intelligence that do involve qualitative data or don’t rely entirely on statistical inference?

Cybernetics and control theory, broadly speaking, involve the design of data feedback loops to govern simple machines or complex socio-technical systems. For instance, an organization might instrument a feedback loop to use qualitative survey data to inform decision-making. That isn't ML, but it is cybernetics. And, based on Peter Norvig's definition, it is a form of AI.

Consider that "autopilot" was invented in 1914, long before digital computers. From this perspective, Artificial Intelligence might even be seen as an ancient human practice— present whenever humans have used artifacts to govern complex systems.

Re: Past Performance is Not Indicative of Future Results (2020)

#18

Are there any approaches to artificial intelligence that do involve qualitative data or don’t rely entirely on statistical inference?

Does qualitative data actually exist? Named colors are considered qualitative, but rbg and cmyk are quantitative. Does converting from one to the other switch whether it is qualitative or quantitative?

Surely semantic meaning is qualitative, but look at word replacement in Google search. That’s entirely based on statistics, thesaurus graphs, and other ultimately quantitative data.

The neat thing about neural nets is that they are ultimately making a very, very complicated stepwise function. Brains are not neural nets, but are they doing anything other than create a very complex, entirely numerical, time and state dependent function? No matter which way you try to understand something, ultimately you are relying entirely on statistical inference.

Re: Past Performance is Not Indicative of Future Results (2020)

#19
I feel like this would have felt more relevant maybe five-ten years ago when there was more of a feeling that deep neural nets was the end all. He mentions correlation vs causation but seems to have missed that causal inference is one of the most active and interesting fields of research today.

Re: Past Performance is Not Indicative of Future Results (2020)

#20
I see no path from "observation" to "model" that does not involve an arbitrary (aesthetic? Nonrational, human-necessitating?) choice.

This would suggest that "general" AI is impossible.

ON THE OTHER HAND

There is a variety of general AI, called an "optimizer". It starts with something better than a void. Maybe that's the path we should be looking at.

Post reply on HN