Go apps can directly integrate llama.cpp for HW accelerated local inference
github.com