Viewing profile — kennethwolters

First commit was 2 weeks ago. A clean-room rewrite of only the most essential APIs of litellm. Was annoyed that DSPy was about 250 MB big. Mostly due to litellm being bloated and n…

Wrote a piece arguing that AI 1.0 is feudal because GPU scarcity concentrated power in a few cloud providers, but the coming GPU glut will invert this dynamic and make open weights…

LLM-driven narrative game. Main technical issue is how go do compaction. I’ve devised a memory hierarchy that compacts the story to a constant amount of tokens per layer. Arc -> Sc…

for me it feels like: Everything is stateful by default/convenience. Building robust systems is in part about confining statefulness to as few parts as possible. To contain statefu…

LLMs are pretty slow. Started a blog post series sharing what I've learned in search of faster LLMs.

Wrote an essay on what LLMs reaching their technological limits could mean to "AI Engineering".

not an attempt at rebutting or so, just adding my thoughts: It doesn't matter if the product is great because of those values if there is a lack product (bc politics and bureaucrac…

Why don't you think that calling the app "Llama-OCR" is good enough?

can someone tell me what the difference is to the webclient? Seems like a webview to me. No local caching/store.

Yeah that's a problem. I agree.

You are responsible for curating your "For You" tab by following/liking-posts-of/replying-to-posts-of/muting/blocking/unfollowing the right accounts. Once I accepted that my "For Y…

It is very good at "non-human subjects in photos with shallow focus". Really curious to see what other low-hanging fruits people are finding.

It is very impressive :)

txtai is not (just) a vector store, it's a full-fledged RAG system. Apples and oranges if you ask me.

Don't have anything to add to the others. Just sharing a way of thinking for deciding between RAG and fine-tuning: (A) RAG is for changing content (B) fine-tuning is for changing b…

I am a big fan of local-first design principles. For most enthusiasts, it's the performance benefits. However, for me, it's the potential it has for privacy in web clients. If you …

tuition-free for how long? current class? Forever?

fair point!

Thank you, I will have a look :) This YT channel is gem I found: https://www.youtube.com/@SailingTipsCa Doesn't post a lot, not very high production quality but very high quality i…

I am fascinated by off-shore sailing, competitive and otherwise. How racers manage to do the vendee globe (solo, from france around-the-world back to france) in just 80 days with j…

Don't forget Kary Mullis as another famous scientist thinking HIV does not cause AIDS. I personally don't know what to make of Mullis' and Duesberg's claims. But I found an interes…