Viewing profile — ttsiodras

Just chiming in - the claims above are real, I have very similar numbers in a cluster of 2x GX10 I have access to. Instructions to reproduce, and benchmarks here: https://forums.de…

I hear you on the insane amount of time vllm takes to launch (atlas is a move in the right direction in that regard). But mostly I wanted to raise awareness to readers of your arti…

Interesting article. IMHO, the author could have done two things better: - vllm instead of llama.cpp. With NVIDIA HW, there is huge difference in multi-user loads and caching with …

Thanks, Mark - for both setups! It's very nice seeing it put to use in actual Spectrum machines - love it :-)

Oh wow! I never expected to see this in a real Speccy until I fix the one I have back home (I'm an expat). Thank you so much! :-)

Thank you!

I have no words. Just try it! And for expats like me in NL, I guess this begs for getting hooked into local llama.cpp/AIs for automatic translation :-)

I have been using xterm's default dabbrev-expand to do the same via "Alt-/" ( https://github.com/ttsiodras/dotfiles/blob/master/.Xresource... ) - which works regardless of what she…

As soon as I met Forth, I felt I had to hack my own ( https://github.com/ttsiodras/MiniForth/ ) - and did so over a single week, two years ago. I targeted the Blue Pill and the ori…

This is why I come to HN - brilliant ideas that I should have thought of before, but didn't! I just changed my server, and uninstalled the - now truly useless - fail2ban. I use SSH…

signal-to-noise ratio: off the charts. Many thanks, OP.

> dkozel and your kind, whoever you are, wherever you are, and whatever you are doing right now, you are legend. Both of you are :-) Heart=warmed. Happy holidays to both of you!

Thanks for sharing! The slides are here: http://vger.kernel.org/~acme/prez/linux-plumbers-2022/

I was not aware of gsocket - thank you, very useful!