I thought of building it myself after seeing the 10 tokens/second that Llama 3 can achieve on an iPhone. However, I'd rather just buy one, lol. I need the Llama 3 to run locally so we can take it anywhere. Any plush toy would do, but a bear or dog is preferred. I just need to outsource my kid's endless "why" questions.
Ask HN: A plush toy with local Llama3? Need to outsource kid's "why" questions
1–2 of 2 posts