Viewing profile — yjtpesesu2

[dead]

so, magic?

How does this differ from anything llama.cpp offers, regarding offloading layers? The repo consistently refers to "DDR4". Is there a reason DDR5 won't work with this?

Oh, that's just the infra for the infra. Then use something like graphllm from matteo, and of course llama.cpp from greg, tailor you model selection to your hardware.

Long time lurker, many accounts, one at a time, no abuse. Hi. Yesterday's recount about layer duplication and adjustment for popular open weight models on huggingface, led to this …

Death approaches. Slow burn until. When Death arrives, what you are doing now will be obviously irrelevant.

Any clue why you might be a favored/favoured high value user?