A hyper-fast local vector database for use with LLM Agents • Hacker News Board

Re: A hyper-fast local vector database for use with LLM Agents

#11

Post by celestialcheese » Mon, Apr 17, 2023, 3:25 AM UTC

Damn this is good - well played.

For those who aren't neck deep in LLM hype - ChromaDB raised $18m at a $75m valuation a couple weeks ago with what's essentially just a thin wrapper around duckdb with a parquet import/export for persistence.

Re: A hyper-fast local vector database for use with LLM Agents

#12

Post by merpnderp » Mon, Apr 17, 2023, 3:28 AM UTC

I couldn't believe they were raising $35 million rounds with a brand new embedding database that was open source. Then I poked through the dozens of lines of code and realized they had implemented the same DB I had.

LOL, much funny.

Re: A hyper-fast local vector database for use with LLM Agents

#13

Post by alfor » Mon, Apr 17, 2023, 3:32 AM UTC

It’s a joke, but is it a functional one?

I found it crazy to run auto-GPT with an external DB over the internet, how can this be ever fast and efficient? (unless the dataset is humongous)

Re: A hyper-fast local vector database for use with LLM Agents

#14

Post by [deleted] » Mon, Apr 17, 2023, 3:40 AM UTC

jazzido wrote: post #10

`def derridaean_similarity` Instant classic.

[deleted]

Re: A hyper-fast local vector database for use with LLM Agents

#15

Post by yawnxyz » Mon, Apr 17, 2023, 3:55 AM UTC

aside from making fun of Chroma, this seems to 100% work though? What would be the pros/cons of actually using this instead?

Re: A hyper-fast local vector database for use with LLM Agents

#16

Post by ShamelessC » Mon, Apr 17, 2023, 4:08 AM UTC

Damn - did this get flagged? Went from top-of-HN to missing from the front page _pretty_ quick.

Re: A hyper-fast local vector database for use with LLM Agents

#17

Post by arthurcolle » Mon, Apr 17, 2023, 4:09 AM UTC

https://raw.githubusercontent.com/jdagdelen/hyperDB/main/_st...

Y-axis on this chart is actually hilarious

Re: A hyper-fast local vector database for use with LLM Agents

#18

Post by jdaggers » Mon, Apr 17, 2023, 4:53 AM UTC

ShamelessC wrote: post #16

Damn - did this get flagged? Went from top-of-HN to missing from the front page _pretty_ quick.

Yeah, this was a little strange. I'm the author of the repo linked here.

I got alerted to it hitting #1 on HN and was able to see it there for only a little bit before it immediately got tanked to # 60. I'm a little bummed, but c'est la vie.

Re: A hyper-fast local vector database for use with LLM Agents

#19

Post by ShamelessC » Mon, Apr 17, 2023, 5:18 AM UTC

jdaggers wrote: post #18

ShamelessC wrote: post #16

Damn - did this get flagged? Went from top-of-HN to missing from the front page _pretty_ quick.

Yeah, this was a little strange. I'm the author of the repo linked here. I got alerted to it hitting #1 on HN and was able to see it there for only a little bit before it immediately got tanked to # 60. I'm a little bummed, but c'est la vie.

Certainly suspicious - almost like VC's can't take a joke ;) I'm sure there's an innocent explanation though.

Great satire in any case! Strikes the perfect balance between highly plausible and glaringly obvious.

Re: A hyper-fast local vector database for use with LLM Agents

#20

Post by kristianp » Mon, Apr 17, 2023, 6:04 AM UTC

egeozcan wrote: post #7

https://github.com/jdagdelen/hyperDB/blob/main/hyperdb/galax... This was a great laugh. Also, after the benchmark, it says: > Benchmark Credit: Benim Kıçım "Benim Kıçım" means "my ass" in Turkish.

References "[Submitted on 31 Mar 2023] Programmed but Arbitrary Control Minimization of Amplitude and phase for speckle Nulling (PACMAN)" https://arxiv.org/abs/2303.18231

No idea if that's a joke paper.