Viewing profile — mongrelion

letting the market set prices ensures that the chips go to the critical markets and uses. Can you please elaborate what you mean by "critical market"? Edit: formatting

llama.cpp moves too quickly to be added as a stable package. Instead, you can get it directly from AUR: https://aur.archlinux.org/packages?O=0&K=llama.cpp There are packages for Vu…

I have been so far happy with the value that Copilot brought but for the past few weeks I have felt the chokehold on the number of requests. I have had the chance to test the main …

It's clear to me that the maintainer is referring to "shushtain" and those type of people > when they take that tone with you. This makes it sound as if you took it personally?

Having a bad day does not entitle you to take it out on others

You should totally post this on the original thread just for adjustment :-)

I am definitely looking forward to TurboQuant. Makes me feel like my current setup is an investment that could pay over time. Imagine being able to run models like MiniMax M2.5 loc…

Not the answer that you are looking for, but I am a fellow AMD GPU owner, so I want to share my experience. I have a 9070 XT, which has 16GB of VRAM. My understanding from reading …

What is this 10€ per month subscription that you are talking about?

I don't understand why I'm getting downvoted. I am legitimately curious about the parameters that the person used for running the model locally to get the results they got because …

At what temperature did you run it and what was your context limit?

Apparently there is a whole science behind running models. I have seen the instructions that unsloth publishes for their quants and depending on the model they'll tweak things like…

What front-end framework did you use? I find the UI so visually appealing

Which quantization are you running and what context size? 32tok/s for that model on that card sounds pretty good to me!

It might be that the system prompt sent by codex is not optimal for that model. Try with open code and see if your results improve

By anyone do you mean a well-established business or any entity willing to serve you?

> [...] _but not necessarily use the right format._ This has also been my experience. But isn't the harness sending the instructions on how to invoke a tool? Maybe it is missing th…

Through my Kagi subscription I get access to quite a few models [1] but I tend to rely on Qwen3 (fast) for quick questions and Qwen3 (reasoning) when I want a more structured appro…

Great idea of inferbench (similar to geekbench, etc.) but as of the time of writing, it's got only 83 submissions, which is underwhelming.

> [...] it's much easier to fine-tune a "general" model into performing some very specific custom task (like classifying text, or translation, etc) Is this fine-tunning process sim…

> But are we really at the point yet where people are running local models without knowing what they are running them on..? I can only speak for myself: it can be daunting for a be…

Apparently there are a few more similar communities like the one from the post https://tildeverse.org/members/

Pi ships with powerful defaults but skips features like sub-agents and plan mode Does anyone have an idea as to why this would be a feature? don't you want to have a discussion wit…

I agree with you, especially with this: They paid for the access the same as any other. If anything, this makes them more legit than Anthropic because they are paying for the conte…

The article touches a bit on how Sega basically lost. There is literally a whole documentary about this: Console Wars, where they go deep into how Sega lost the battle: https://en.…