Viewing profile — tbocek

Just today, I tried to run docker compose on a remote host via podman-docker on Fedora (Asahi). I ran into all sorts of buildx issues, and the easiest fix for me was to remove podm…

That's a valid concern. I took a more constrained approach for web searches for exactly this reason. Instead of giving the LLM full browser control, I built a Firefox extension tha…

Thx, I cannot change my previous message, the QH is set to private, as me and my students are working on it. It will be made public next month. The qh:// protocol, we have just sta…

UDP-based protocols are well suited for P2P, since hole punching is straightforward if you have predictable port mapping, you cannot disallow it. In that spirit, we are currently e…

I built PrevelteKit to solve the architecture trade-offs I ran into with modern web apps. SPAs have clean separation between frontend and backend, but users see a white loading pag…

This is probably due to this: https://github.com/ggml-org/llama.cpp/issues/12637 . This GitHub issue is about interleaved sliding window attention (iSWA) not available in llama.cpp…

Here is mine, I have a docker compose file locally, and this deploy.sh script deploy to my remote machine. That also means that my remote machine is building the image. And I have …

Just did a test with https://huggingface.co/bartowski/DeepSeek-R1-Distill-Qwen-32... , with the question "what happened at Tiananmen Square?", and here are parts of the thinking pr…

There is a difference between chat and code completion. While with chat, you can use localhost with llama.cpp, but code completion you cannot do that: https://github.com/zed-indust…

I had the same issue, so I implemented the following workaround: https://github.com/tbocek/dvorak . This remaps on Linux CTRL-I back to CTRL-C when using a Dvorak keyboard layout.

[dead]