Decentralized Artificial Intelligence
chaos-engineering.dev
Decentralized Artificial Intelligence
1–10 of 47 posts
Re: Decentralized Artificial Intelligence
#2This seems half-baked and there are numerous faulty assumptions in this article.
For example, Bitcoin miners cannot computer gradients. Their ASICs can only calculate double-sha256.
Additionally, the premise of sending gradients of models trained on private data while retaining privacy seems problematic. While you likely can't reverse it to calculate the batch's contents, it is leaky.
Further, gradient calculations are not a good proof of work. A good proof of work is difficult to calculate and easy to verify (i.e. an extremely low hash value).
The core premise, using blockchains to store terabytes of models and datasets, doesn't make any sense whatsoever.
The problems highlighted in this article however are valid, and it would be great to see something like IPFS for datasets and models.
Re: Decentralized Artificial Intelligence
#3This seems half-baked and there are numerous faulty assumptions in this article. For example, Bitcoin miners cannot computer gradients. Their ASICs can only calculate double-sha256. Additionally, the premise of sending gradients of models trained on private data while retaining privacy seems problematic. While you likely can't reverse it to calculate the batch's contents, it is leaky. Further, gradient calculations a…
The saying "blockchains are a solution in search of a problem" gets funnier every day.
Re: Decentralized Artificial Intelligence
#4Chaos engineering may sound cool and cyberpunky but it'd not what we need right now for AI safety. Unless you guys want to have your kids tortured by moloch
Re: Decentralized Artificial Intelligence
#5This seems half-baked and there are numerous faulty assumptions in this article. For example, Bitcoin miners cannot computer gradients. Their ASICs can only calculate double-sha256. Additionally, the premise of sending gradients of models trained on private data while retaining privacy seems problematic. While you likely can't reverse it to calculate the batch's contents, it is leaky. Further, gradient calculations a…
> A good proof of work is difficult to calculate and easy to verify (i.e. an extremely low hash value).
That's a specific Proof-of-Work system known as Hashcash [1]. There are many others, such as Cuckoo Cycle, in which the solution is a fixed-length cycle in a random bipartite graph [2].
[1] https://en.wikipedia.org/wiki/Hashcash
[2] http://cryptorials.io/beyond-hashcash-proof-work-theres-mini...
Re: Decentralized Artificial Intelligence
#6One can cryptographically prove the correct inference of a small AI model now with https://github.com/zkonduit/ezkl (our open-source package).
Re: Decentralized Artificial Intelligence
#7Chaos engineering may sound cool and cyberpunky but it'd not what we need right now for AI safety. Unless you guys want to have your kids tortured by moloch
AI safety is a joke.
Re: Decentralized Artificial Intelligence
#8This seems half-baked and there are numerous faulty assumptions in this article. For example, Bitcoin miners cannot computer gradients. Their ASICs can only calculate double-sha256. Additionally, the premise of sending gradients of models trained on private data while retaining privacy seems problematic. While you likely can't reverse it to calculate the batch's contents, it is leaky. Further, gradient calculations a…
This was my reaction too. How do you “prove” my gradient is valid?
Well perhaps one way is you could have another LLM take a look at the data you are submitting and have it predict p(useful|not useful) , and create an incentive for users to generate authentic data
Re: Decentralized Artificial Intelligence
#9This seems half-baked and there are numerous faulty assumptions in this article. For example, Bitcoin miners cannot computer gradients. Their ASICs can only calculate double-sha256. Additionally, the premise of sending gradients of models trained on private data while retaining privacy seems problematic. While you likely can't reverse it to calculate the batch's contents, it is leaky. Further, gradient calculations a…
This was my reaction too. How do you “prove” my gradient is valid? Well perhaps one way is you could have another LLM take a look at the data you are submitting and have it predict p(useful|not useful) , and create an incentive for users to generate authentic data
Indeed very half-baked.
This must be quite an insult to the inventor of fully decentralised AI. In 2012 Prof. Jelasity invented gradient mining with SGD, https://arxiv.org/pdf/1109.1396 Works reasonably well, you probably also need a ledger like Trustchain for accountability and Sybil protection. Consensus is too costly. This problem is unsolved and actively worked on academia for decades.
Re: Decentralized Artificial Intelligence
#10Chaos engineering may sound cool and cyberpunky but it'd not what we need right now for AI safety. Unless you guys want to have your kids tortured by moloch
AI safety is a joke.
A way for the humanities to get some of the CS STEM funding by writing sci-fi.
Edit: The number of AI safety sessions I’ve joined where the speakers have no real AI experience talking about potentially bad futures, based on zero CS experience and little ‘evidence’ beyond existing sci-fi books and anecdotes, have left me very jaded on the subject as a ‘discipline’.
I believe it comes down to three groups:
AI researchers/organisations wanting to make their work sound very important/scary
Humanities researchers wanting STEM funding
AI organisations trying to bring in legislation to slow down competition