Viewing profile — kai-dev

What the title says. I am trying to figure out how much people expect to spend when training their own LLM on their own data from scratch. I’m also wondering if there are technique…

Builder in the LLM space. Arxiv + google + papers with code is how I do it. As another user pointed out, focus on solving your problem. By doing this, you'll search and then natura…

I posted previously about this, but I recently build a model that seems to be outperforming most other architectures I've seen. Wondering how to test it's full context window witho…

So, my friend and I built a custom model that is performing 2-3X as good as a comparable decoder only model (~same params, exact same input data etc.) and it's doing this on CodeXG…

Super interesting how simulation theory aligns so deeply with Vedic (and with the right lens western) theology

Device R&D jobs seem like the way to go. Will likely be a lot of matlab, labview, c, c++ etc. I know a couple people who have had careers in robotics and I myself have done some wo…

George hotz. The dude just builds stuff to see if he can. Very excited for the future of tiny grad.

No but shouldn’t be too hard to do. String together something like Lang chain with an instance of chroma running in a docker container. Just need a rest api for that, and then fork…

Hello, it’s my first time posting here. I figured this would be a good place to discuss my current concerns about modern infrastructure management abstractions. I am hoping to have…