Viewing profile — elsombrero

from my understanding, you can run the inference server (llama.cpp/vllm/whatever) and the agent/harness in different contexts, event different machines. The risky part is in the ag…

not good enough for coding anything more than simple scripts. generally, the less parameters, the less knowledge they have.

A custom provider for kubernetes cluster autoscaler for homelabs that lets you turn on and off the nodes without reprovisioning them. https://github.com/homecluster-dev/homelab-aut…

https://github.com/mostlygeek/llama-swap it's a transparent proxy that automatically launches your selected model with your preferred inference server so that you don't need to man…

well, I tried it and it works for me. llm output is hard to properly evaluate without actually using it. I read a lot of good comments on r/localllama, with most people suggesting …

On my 2x 3090s I am running glm4.5 air q1 and it runs at ~300pp and 20/30 tk/s works pretty well with roo code on vscode, rarely misses tool calls and produces decent quality code.…

you could apply a binary search for each slider and improve the number of tries by moving the slider by half of the shortest distance to the edge

https://thebestmotherfucking.website/

In the installation page they just say to download the prebuilt binaries for your system, no need to compile it your self

I have a OnePlus 8t since last october and have not found any issue on the battery side. On the contrary I'm quite pleased with battery management since i can charge it in 30 minut…

Sure, negotiating your salary is an important skill, but I don't see the value of this article over just the title. And then there's this > Here’s what you do: > > Read this book. …