Viewing profile — sidnb13

I don't think vector databases are intended to be secure, encrypted forms of data storage in the first place.

+1, immensely satisfying read for any aviation nut

Cool to see that this worked well for someone. Super hard to force the key insight in a problem to magically appear given more time sunk into it. Big weakness of mine honestly, and…

Wow, sorry to hear that. Came across his blog in 2021 and was instantly hooked. RIP

Very cool. I used to dream of this stuff when I was younger. Reminds me of Atlantik Solar: https://www.atlantiksolar.ethz.ch/ . Hasn't been updated in a while, but focused more on …

Ah that would make sense. Similar to vLLM which does dynamic packing.

I would assume the datacenter and infra needed would also contribute a sizeable chunk to the costs when you consider upkeep to run it 24/7

> I also believe that within say 1-3 years there will be a different type of training approach that does not require such large datasets or manual human feedback. I guess if we ign…

Yep, batching is a feature I really wish the OpenAI API had. That and the ability to intelligently cache frequently used prompts. Much easier to achieve this with a hosted OS model…

maybe worth looking into: https://news.ycombinator.com/item?id=36750083

Maybe worth looking into: https://news.ycombinator.com/item?id=36750083