llama.cpp • Hacker News Board

Re: llama.cpp

#191

Post by dlcarrier » Sat, Aug 15, 2026, 12:36 AM UTC

cptskippy wrote: post #72

dlcarrier wrote: post #5

I tried to run in on my Arc A770, but all of the binary releases I could find were compiled without OpenVINO support enabled. I tried compiling it myself, but after two days of the compiler running it failed.

Does the A770 use the Xe driver? If so then it might work with the scripts that I've been using to build llama.cpp with SYCL support for the Arc Pro B70. https://github.com/cptskippy/battlemage-llm-gateway It's designed so that you can re-run the scripts to pull the latest updates. When Muse Glimmer was released the other day I just ran the 02 script to build the latest version of llama.cpp with support for it.

Thanks for the link. I'm running an Arch-based system, by the way, so I won't be able to directly use the scripts, which are expecting Debian's package manager, but I'll look at what they're doing and see if I can get something working.

Re: llama.cpp

#192

Post by chaps » Sat, Aug 15, 2026, 4:49 PM UTC

anonym29 wrote: post #184

chaps wrote: post #151

Earlier quoted context omitted.

Yes, and that's exactly why the curl|sh exists; you don't need to know the weird esoterica of a 26 year old piece of software. Accessibility matters.

>you don't need to know the weird esoterica of a 26 year old piece of software You really don't need to know much at all in order to compile llama.cpp. You can literally ask any half decent AI agent to do it for you or give you a step by step guide, and troubleshoot any error you get.

Have you not met anyone who would disown you as a person for suggesting that?

Re: llama.cpp

#193

Post by anonym29 » Sun, Aug 16, 2026, 11:00 AM UTC

chaps wrote: post #192

anonym29 wrote: post #184

Earlier quoted context omitted.

>you don't need to know the weird esoterica of a 26 year old piece of software You really don't need to know much at all in order to compile llama.cpp. You can literally ask any half decent AI agent to do it for you or give you a step by step guide, and troubleshoot any error you get.

Have you not met anyone who would disown you as a person for suggesting that?

Of course not. That's as absurd, nonsensical, and dogmatic of a position to hold as disowning someone for being gay, or disowning someone for being the wrong religion or race. I tend not to associate with extremists and zealots, regardless of their preferred cause.

Just about everyone I associate with personally is polite, kind, and friendly, and everyone I work with professionally is too serious of a technologist to dismiss the most transformative technology of our lifetimes to date.

I know some people who'd oppose datacenters going up in their neighborhood or town, but nothing as bizarre or irrational as disowning someone else for merely using AI.