Live data from Hacker News

Directly run and investigate Llama models locally

github.com

1–2 of 2 posts

Re: Directly run and investigate Llama models locally

#2
There are other popular ways to invoke these models, such as Ollama and Hugging-Face's general API package: transformers, but those hide the interesting details behind an API. I want to peel back the layers, poke, prod, understand and gain insight into these models and help you do the same.