Hyperdimensional Computing • Hacker News Board

Re: Hyperdimensional Computing

#31

Post by kortex » Sun, Nov 29, 2020, 2:13 AM UTC

A few thoughts:

- holy jargon, Batman! From what I've gleaned, "holographic" refers to Tony Plate's Holographic Reduced Representations

- "hypervector" is just a swanky term for very-high-dimensionality vectors, a la "hypersonic", "hypervisor", hyper-encabulator, etc.

- this reminds me an awful lot of thought vectors. The first abstract linked mentions HRRs alongside semantic vectors, so both are types of hypervectors I think?

- this also reminds me of Numenta/Nupic/sparse distributed represntations. I think SDR's are also hypervectors?

Re: Hyperdimensional Computing

#32

Post by IcePowder » Sun, Nov 29, 2020, 5:10 AM UTC

The following Patent Application by Intel is an interesting use case for Hyperdimensional Computing in a Localizing Key Value Store. It's also behind the recent move to enriched metadata in RDBMS systems (VLDB Endowment):

https://patents.google.com/patent/US20190227739A1/en?oq=US20...

Re: Hyperdimensional Computing

#33

Post by byecomputer » Sun, Nov 29, 2020, 6:55 AM UTC

kortex wrote: post #31

A few thoughts: - holy jargon, Batman! From what I've gleaned, "holographic" refers to Tony Plate's Holographic Reduced Representations - "hypervector" is just a swanky term for very-high-dimensionality vectors, a la "hypersonic", "hypervisor", hyper-encabulator, etc. - this reminds me an awful lot of thought vectors. The first abstract linked mentions HRRs alongside semantic vectors, so both are types of hypervector…

>"hypervector" is just a swanky term for very-high-dimensionality vectors, a la "hypersonic", "hypervisor", hyper-encabulator, etc.

Or a la hypercube. Hyper- is an established prefix for describing n-dimensional objects

Re: Hyperdimensional Computing

#34

Post by two_almonds » Sun, Nov 29, 2020, 5:45 PM UTC

scottlocklin wrote: post #19

two_almonds wrote: post #14

Earlier quoted context omitted.

Have you come across any other interesting resources? I've recently been delving into topics surrounding echo state networks for my thesis, so I'd appreciate any pointers.

Some of the Italians at University of Pisa seemed to want to understand the echo state property better. Gallicchio and Filippo Maria Bianchi (I assume his student) wrote a couple of interesting papers I haven't totally absorbed yet, probing the critical ridge in various ways. That said, it's pretty marginal stuff. ESNs are weird. Cool weird anyway. If I were looking at it in a serious way rather than reading the funn…

Thanks!