Hyperdimensional Computing
github.com
Hyperdimensional Computing
1–10 of 34 posts
Re: Hyperdimensional Computing
#2Whoa. Hyperdimensional what? Parsing through this felt a bit like being dumped into a pit of different puzzle sets mixed together. And I was lost in the terminology. It’s all very nebulous but I guess that’s the point.
Re: Hyperdimensional Computing
#3Whoa. Hyperdimensional what? Parsing through this felt a bit like being dumped into a pit of different puzzle sets mixed together. And I was lost in the terminology. It’s all very nebulous but I guess that’s the point.
I'm having trouble too... it sounds like they mean "1- and 2-dimensional vectors which are large" and not, say, billion-dimensional tensors. But if I'm reading that wrong I'd love to hear what's actually interesting here.
Re: Hyperdimensional Computing
#4This reads like someone got really carried away with the buzzwords. Hyperdimensional hypervectors?
Re: Hyperdimensional Computing
#5Whoa. Hyperdimensional what? Parsing through this felt a bit like being dumped into a pit of different puzzle sets mixed together. And I was lost in the terminology. It’s all very nebulous but I guess that’s the point.
I had the same impression. I had a peek at some of the papers and did a quick search on the topic, but everything is so covered in hype it's difficult to get a grasp what's actually going on.
My quick impression is that it's something similar to "embeddings", where some features (e.g. words) are mapped to some high-dimensional vector space and computations are done in that space. What those computations are seem to vary quite a bit from paper to paper.
Re: Hyperdimensional Computing
#6Whoa. Hyperdimensional what? Parsing through this felt a bit like being dumped into a pit of different puzzle sets mixed together. And I was lost in the terminology. It’s all very nebulous but I guess that’s the point.
Just the other day we had spatial computing; this sounds like when you get to the "but first we have to talk about parallel universes" bit of that.
Re: Hyperdimensional Computing
#7Vector Symbolic Architecture (VSA) is the European name.
Base is Pentti Kanerva's 1988 book, "Sparse Distributed Memory". Now referred to as "HDC" or "HD". Search Pentti Kanerva now Staff Scientist at UC Berkeley Redwood Center for Theoretical Neuroscience or Mohsen Imani, now UC Irvine former at UC San Diego.
Introductory article - "Hyperdimensional computing and its role in AI" by,Givi Odikadze:
https://medium.com/dataseries/hyperdimensional-computing-and...
Re: Hyperdimensional Computing
#8Bizarro the one on-topic comment here is "Dead." I came across this in reviewing echo state networks which this appears to be a distant relative of. The code samples made it useful.
Re: Hyperdimensional Computing
#9Bizarro the one on-topic comment here is "Dead." I came across this in reviewing echo state networks which this appears to be a distant relative of. The code samples made it useful.
This referred to IcePowder's comment, I revived it since the information given in it seems to be accurate as far as I can tell.
You can do this yourself by the way: click the time of the post (".. minutes ago" / ".. days ago") to view the comment on its own and click the link to "Vouch" in the top line, where also the name and the time since commenting is shown.
Re: Hyperdimensional Computing
#10My first thought was that this was related to multilinear algebra (algebra of tensors and higher-order vector spaces) which has lead to many interesting and suggestive advances in machine learning, but apparently it's not. What a truly opaque collection of nomenclature they've chosen...
After glancing through a couple papers I can't entirely shake the feeling that the entire thing might be a social experiment to see how much jargon and fantastical sound words can be mashed together before people notice it's nonsense (even though I realise it's not).