Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Building a fully local LLM voice assistant to control my smart home

johnthenerd.com

Post reply on HN
Print view View original

191–194 of 194 posts

Re: Building a fully local LLM voice assistant to control my smart home

#191

Post by BrandoElFollito »

fragmede wrote: post #40
polishdude20 wrote: post #30

Earlier quoted context omitted.

What about like, if I said "switch off the lamp at 3:45" How would you translate the Json you'd get out of that to get the same output? The subject would be "lamp" . Your app code would need to know that lamp is also light.

In all seriousness, I have names for my lights for this very reason.

Same here (and for sub-areas). Now: this is sometimes stressful when I say "OK Google, switch off .... errrr ... pffff ..." and Google responds with a "come on, make up your mind" (or similar :))

Re: Building a fully local LLM voice assistant to control my smart home

#193

Post by abadugu »

balloob wrote: post #52

Founder of Home Assistant here. Great write up! With Home Assistant we plan to integrate similar functionality this year out of the box. OP touches upon some good points that we have also ran into and I would love the local LLM community to solve: * I would love to see a standardized API for local LLMs that is not just a 1:1 copying the ChatGPT API. For example, as Home Assistant talks to a random model, we should be…

lamma.cpp allows you to restrict the output such that it would always generate valid JSON https://github.com/ggerganov/llama.cpp#constrained-output-wi...

Re: Building a fully local LLM voice assistant to control my smart home

#194

Post by tamooj »

MrQuincle wrote: post #102
balloob wrote: post #64

Earlier quoted context omitted.

I think that LLMs are going to be really great for home automation and with Home Assistant we couldn't be better prepared as a platform for experimentation for this: all your data is local, fully accessible and Home Assistant is open source and can easily be extended with custom code or interface with custom models. All other major smart home platforms limit you in how you can access your own data. Here are some thin…

Retrospective questions would also be really great. Why did the lights not turn off downstairs this night? Or other questions involving history.

This is a really great use for AI. Hits a big pain point.
Post reply on HN