Live data from Hacker News

Decentralized Artificial Intelligence

chaos-engineering.dev

21–30 of 47 posts

Re: Decentralized Artificial Intelligence

#21
post #18

Earlier quoted context omitted.

A way for the humanities to get some of the CS STEM funding by writing sci-fi. Edit: The number of AI safety sessions I’ve joined where the speakers have no real AI experience talking about potentially bad futures, based on zero CS experience and little ‘evidence’ beyond existing sci-fi books and anecdotes, have left me very jaded on the subject as a ‘discipline’. I believe it comes down to three groups: AI researche…

Yes, there is a lot of bunk AI safety discussions. But there are legitimate concerns as well. AI is close to human level. Logically they become dangerous, specially if given autonomy and bad goals. Many of the accredited researchers recognize this. There is some level that you can discuss AI safety without AI expertise (specially as of a few years ago where everything as so uncertain), but I think currently you need…

The thing I always get caught up on, when making comparisons between computers and humans wrt autonomy, is that the computer reaches the output state from the input by a clock cranking the CPU forward, ie it's a function that runs when the environment around it forces it to run. To put it in the LLM context, between words and after a Stop token, the "intelligence" is dead - frozen - suspended until the next function call.

How can a machine, then, possess anything like self-directed behavoir, when it never has a sense of self-preservation? Basically this is my axiom, that sense of self requires fear/awareness of mortality and the good sense to avoid those things that end you.

Perhaps you could concoct a machine that runs in an infinite loop with no off switch, I guess my question for you is, in what way can a machine have autonomy?

And my distinction between living and dead might be, a living system acts out of self preservation, consuming or modifying its environment to survive/thrive, while a dead system is simply acted upon by the environment its embedded in, like a crystal growing due to molecular force and temperature gradient - or an adding machine being cranked by a higher being.

Re: Decentralized Artificial Intelligence

#22
post #14

Do you want Terminator? Because this is how you get Terminator. A blockchain-based distributed giant AI could go rogue and it would be very difficult to stop it.

Wouldn't it be reliant on the nodes of the blockchain continuing to run it?

And if the crypto-economy is doing well enough that node-runners are economically incentivized to continue running, then is the rogue AI even that harmful?

Re: Decentralized Artificial Intelligence

#23

> a cryptographically secure, decentralized ledger is the only solution to making AI safer. This article manages to say that a consensus algorithm is the answer to problems with AI without using the word "consensus" a single time. Probably because it doesn't even consider that's what blockchains are. The article talks about using "proof of gradient" to do inference instead of crunching hashes. But this is nonsense, b…

It’s standard for white papers to write equation and theories that takes effort to prove wrong and it usually is(get the lazy guys to invest), even just by skimming the few parts that the analogy to finding the right hashes is to calculate gradients does not make any sense, I just stop there.

Re: Decentralized Artificial Intelligence

#26

> a cryptographically secure, decentralized ledger is the only solution to making AI safer. This article manages to say that a consensus algorithm is the answer to problems with AI without using the word "consensus" a single time. Probably because it doesn't even consider that's what blockchains are. The article talks about using "proof of gradient" to do inference instead of crunching hashes. But this is nonsense, b…

You can run the same gradient step on multiple nodes and only credit them when they agree.

Re: Decentralized Artificial Intelligence

#27
post #17
post #8

Earlier quoted context omitted.

This was my reaction too. How do you “prove” my gradient is valid? Well perhaps one way is you could have another LLM take a look at the data you are submitting and have it predict p(useful|not useful) , and create an incentive for users to generate authentic data

Ian (Goodfellow), is that you ?

Every time there is a discriminator, someone suspects Ian.

Re: Decentralized Artificial Intelligence

#29
Very important topic, but this is a bad article whose authors have their heads too far into cryptocurrency which IMHO is a mostly failed approach to decentralization.

The decentralized AI that is working is just sharing models. Splitting the inference across the net for cooperative execution is possible.

The thing that really needs to be solved is distributed training. We need to be able to train base models in a manner more like Folding@Home so we’re not captive to organizations with big expensive GPU farms to make any innovation.

Re: Decentralized Artificial Intelligence

#30
post #26

> a cryptographically secure, decentralized ledger is the only solution to making AI safer. This article manages to say that a consensus algorithm is the answer to problems with AI without using the word "consensus" a single time. Probably because it doesn't even consider that's what blockchains are. The article talks about using "proof of gradient" to do inference instead of crunching hashes. But this is nonsense, b…

You can run the same gradient step on multiple nodes and only credit them when they agree.

That's pointless work because there's no incentive to do the "mining" (because nobody "wins" ). If you implement a system to choose a "winner" then you didn't need the computations in the first place because you've invented proof of stake.
Post reply on HN