Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

DeepMind’s new AI with a memory outperforms algorithms 25 times its size

singularityhub.com

Post reply on HN
Print view View original

61–70 of 141 posts

Re: DeepMind’s new AI with a memory outperforms algorithms 25 times its size

#61

Post by notahacker »

b9a2cab5 wrote: post #47
indigo945 wrote: post #45

Earlier quoted context omitted.

Obviously, but the question is, why were there no Black women in the data set, and what care can be taken to prevent racialized bias when selecting the data set in the future?

Certainly you can ask these questions but these are business process issues, not technical ones. They're unrelated to AI. My personal take is you won't see any tangible movement on this until black women (or whatever group you choose) comprise a tangible proportion of revenue generating users. Corporations operate for money and nothing else.

Of course they are related to what we call AI, because what we call AI is primarily dependent on the quality of the business processes behind data selection and testing. If there is a strong trend of business processes to create systematic errors in the results the technology generates (an AI trained in China sucking at recognising white people wouldn't be a counter example of this phenomenon, it would be the same issue) it's an underlying weakness of the technology, and the utility of the technology needs to be viewed in the context that it's likely compromised by biases in the business processes of its developers.

Black women or other groups not viewed as the mainstream target for an AI solution aren't going to form a tangible proportion of revenue generating users if the software doesn't function properly for them. And a lot of the use cases for AI analysis don't involve the unrepresented-in-corpus minority group being the consumer anyway, they involve it being used to screen them by a third party who's been sold the tool on the false premise that it's free from human bias.

Re: DeepMind’s new AI with a memory outperforms algorithms 25 times its size

#62

Post by tsimionescu »

saltyfamiliar wrote: post #46
tialaramex wrote: post #37

Earlier quoted context omitted.

Yes. It's unavoidably "quantum" in the sense that, as a physical machine in our universe it's subject to the rules, including quantum physics. However there is no apparent mechanism by which "thinking" could harness any interesting properties of quantum physics, it's just not happening at the right scale, like the way kids sand walls on the beach don't alter the world's tides.

That proportions in that analogy seem way off. Every single neuron of the human brain could be utilizing quantum mechanical effects at the same time. Not very much at all like a kid's sand castle against the world's tides. I don't think anyone really understand "thinking" and quantum mechanics well enough for the mechanisms to be apparent. I mean, squirrels convert forest detritus into general intelligence. I don't u…

Well, quantum computers are just fast but limited classical computers. So there is nothing actually very interesting to be gained by assuming that the brain could be a quantum computer isntead of a classical computer - at best, it would explain why the brain is more efficient at certain computations, but it can't explain how intelligence works.

To be clear, any quantum computation can be simulated on a classical computer, but it takes exponentially many steps. This is proven mathematically already, with the single exception that it's not proven that a better classical algorithm couldn't remote the exponential difference.

Re: DeepMind’s new AI with a memory outperforms algorithms 25 times its size

#63

Post by tsimionescu »

saltyfamiliar wrote: post #34
runnerup wrote: post #22

Earlier quoted context omitted.

I believe plenty of "quantum phenomenon" are utilized in humans' biochemistry[0]. Whether the brain "calculates" things using a method that is particularly similar to the methods used in today's quantum computers is...unlikely. It probably is "quantum" in other ways though. 0: https://www.the-scientist.com/infographics/infographic--quan...

Quantum computers don't seem very useful yet, but brains are extremely useful (and they use much less power). Maybe current generation quantum computers would be better if they used quantum mechanics more similarly to the ways our brains use it. The article you linked mentions that entanglement and qubits are being "studied in human consciousness" but I'm not sure what exactly that entails.

Ass far as we understand, out brains use quantum mechanics only as much as our processors use quantum mechanics already - the world is quantum mechanical, so our brains are as well.

However, given the scale of known brain features, the temperature of the brain, and other sources of noise, it's very very very hard to imagine how the brain could be a quantum computer.

Re: DeepMind’s new AI with a memory outperforms algorithms 25 times its size

#64

Post by charcircuit »

kkjjkgjjgg wrote: post #53

Sounds as if they stored all the correct answers in a database and call it "better". How do they even evaluate these models? Like they already have a billion preprepared correct answers in the database. How do they come up with new questions for the evaluation?

It's the equivalent of taking an a test where you can use the internet. Sure you know the information needed to answer the question exists, but it can be difficult to extract the answer and word it into at English sentence.

Re: DeepMind’s new AI with a memory outperforms algorithms 25 times its size

#65

Post by tsimionescu »

Blikkentrekker wrote: post #48
indigo945 wrote: post #45

Earlier quoted context omitted.

Obviously, but the question is, why were there no Black women in the data set, and what care can be taken to prevent racialized bias when selecting the data set in the future?

I would assume these data sets are not manually selected but imported from some mechanism. Other issues which are sure to arise is that the a.i. will have trouble with people who aren't smiling, and that the data set probably contains people who look better than average, and almost certainly excludes people who suffer from injuries or deformities in appropriate proportions. Perhaps an interesting project is simply th…

World proportional is not good enough for this type of task. If we are to rely on AI for things like identifying people in pictures in a trial, we would need equal representation in the data set, so the AI doesn't have any kind of systematic bias. Otherwise, the AI's bias will compound errors in the real world. So you would need as many pictures of Australian aborigenees in the data set as Han Chinese people if you wanted to be sure there isn't a risk that a random person would be confused for someone of the over or under represented groups.

Re: DeepMind’s new AI with a memory outperforms algorithms 25 times its size

#66

Post by tsimionescu »

b9a2cab5 wrote: post #38
Blikkentrekker wrote: post #28

> Gebru, a widely respected leader in AI ethics research, is known for coauthoring a groundbreaking paper that showed facial recognition to be less accurate at identifying women and people of color, which means its use can end up discriminating against them. Surely this is a function of location? I understand the U.S.-English term “person o color” to be convoluted language for “not white”. One simple thing I notice i…

The meaning in woke terminology is more subtle than just "not white". For example Asians would likely be excluded in this case, and Middle Easterners and other minorities. "People of color" in this case means blacks and dark skinned Latinos. The idea that AI itself can be biased (as opposed to the dataset) also has some significant problems. The lead of Facebook AI Research got canceled on Twitter because he pointed…

The AI is the final product of applying a learning algorithm on a training set.

Claiming that "the AI is not biased, the training set is" is like saying "this running program isn't buggy, it's just the source code that is buggy".

Re: DeepMind’s new AI with a memory outperforms algorithms 25 times its size

#69

Post by stavros »

neom wrote: post #32
torbTurret wrote: post #13

Earlier quoted context omitted.

What’s your argument?

I hope I didn't come off like I think know anything about this field, because I don't. A friend who use to work for openai (Jack Clark) and I spend some time once discussing over beers some stuff around general purpose AI, and I proposed that I believe quantum is a dark horse on the road to general purpose AI, and he disagreed.

Sounds like a fun debate to me.

Re: DeepMind’s new AI with a memory outperforms algorithms 25 times its size

#70

Post by muzani »

AJRF wrote: post #51

I've not kept track of where large transformers like this have gotten to, GPT3 and the like - has GPT3 made any real difference to the world? Are people using it? Has it vastly improved any software?

I don't know about world changing but it's saved me hundreds of hours. I use it to help read academic papers, put formatting on things like markdown and subtitles, and creative writing. A lot of the things that take it 15 seconds to do take me 2 minute and drain me mentally for about 15 mins.

If anything, it's being used in force for social media marketing, where you're trying to say "buy this thing" in different ways every day.

Post reply on HN