Viewing profile — kacperlukawski

Although it's in a different area, I wanted to mention https://calmcode.io/ as an excellent example of a calm learning platform. There is a whole movement around enshittification, …

I read "The Frontend Treadmill" (https://polotek.net/posts/the-frontend-treadmill/) and it makes me think a lot. I used to be a backend developer, and most of my experience is ther…

Is there a free trial available? Even 24 hours should be enough to say if I like it, but currently I have to pay from the day one. Or did I miss it?

I'm always a bit worried if an extension gets permission to do anything it wants with all my files, including deleting them. Is there a way to restrict it and allow it to modify on…

The problem is to scale that properly. If you have millions of documents, that won't scale that well. You are not going to prompt the LLM millions of times, aren't you? Embedding m…

Interesting! Does it work based on speech or transcriptions?

Why is that an issue? Training the tokenizer seems much more straightforward than training the model as it is based on the statistics of the input data. I guess it may take a while…

Are there any specific reasons for using BPE, not Unigram, in LLMs? I've been trying to understand the impact of the tokenization algorithm, and Unigram was reported to be a better…

Yeah, it seems like it got published too early.

I'm unsure if there is any comparison of LanceDB and Qdrant available out there, but there shouldn't be any issues with Python 3.12 and qdrant-client compatibility. Windows is also…

If you will be the only app user, then the Python SDK's local mode might be suitable. However, in the long run, when you decide to publish the app, you rather have to switch to an …

Qdrant here! We're already working on that :D

How would you host sentence-transformers model for free? You need it to vectorize each query so that has to be hosted somewhere. Is there any way to do it for free?

If you need semantic search locally then it's fine, but serving an embedding model might be still challenging. And if you want to expose it, your laptop might be not enough.

This is also an interesting piece of how to do it completely for free: https://news.ycombinator.com/item?id=36693239

It's a bit easier in Python if you use tools like https://www.serverless.com/ . I'm not sure if Rust has something similar yet.