81–90 of 194 posts
Has the state of hobbyist microphone arrays improved? The thing that’s always given me pause here is that my Echo devices are quite good, especially for the cost, at picking things up in a relatively noisy kitchen environment.
Also, microphones in the wrong room responding. I'm having an issue with that as well.
Earlier quoted context omitted.
I think that LLMs are going to be really great for home automation and with Home Assistant we couldn't be better prepared as a platform for experimentation for this: all your data is local, fully accessible and Home Assistant is open source and can easily be extended with custom code or interface with custom models. All other major smart home platforms limit you in how you can access your own data. Here are some thin…
Reading this gave me an idea to extend this even further. What if the AI could look at your logbook history and suggest automations? For example, I have an automation that turns the lights on when it's dark based on a light sensor. It would be neat if AI could see "hey, you tend to manually turn on the lights when the light level is below some value, want to create an automation for that?"
Anyone know of a database of generic automations to train on?
I did the same thing, but I went the easy way and used OpenAI's API. Half way through, I got fed up with all the boilerplate, so I wrote a really simple (but very Pythonic) wrapper around function calling with Python functions: https://github.com/skorokithakis/ez-openai Then my assistant is just a bunch of Python functions and a prompt. Very very simple. I used an ESP32-Box with the excellent Willow project for the l…
> > Building a fully local LLM voice assistant > I did the same thing, but I went the easy way and used OpenAI's API. This is a cool project, but it's not really the same thing. The #1 requirement that OP had was to not talk to any cloud services ("no exceptions"), and that's the primary reason why I clicked on this thread. I'd love to replace my Google Home, but not if OpenAI just gets to hoover up the data instead.
I did this as well. I also ended up writing a classifier using some python library that seems to outperform home assistant's implementation. Not sure what the issue is there. I just followed the instructions from an LLM and the internet.
You installed it and customised your prompts and then… it worked? It didn’t work? You added the hugging face voice model?
I appreciate the prompt, but broadly speaking it feels like there’s a fair bit of vague hand waving here: did it actually work? It mixtral good enough to consistently respond in an intelligent manner?
My experience with this stuff has been mixed; broadly speaking, whisper is good and mixtral isn’t.
It’s basically quite shit compared to GPT4, no matter how careful your prompt engineering is, you simply can’t use tiny models to do big complicated tasks. Better than mistral, sure… but on average generating structured correct (no hallucination craziness) output is a sort of 1/10 kind of deal (for me).
…so, some unfiltered examples of the actual output would be really interesting to see here…
Was I the only who got to the end and was like, “and then…?” You installed it and customised your prompts and then… it worked? It didn’t work? You added the hugging face voice model? I appreciate the prompt, but broadly speaking it feels like there’s a fair bit of vague hand waving here: did it actually work? It mixtral good enough to consistently respond in an intelligent manner? My experience with this stuff has be…
Earlier quoted context omitted.
I can't help but think of someone downloading "Best Assistant Ever LLM" which pretends to be good but unlocks the doors for thieves or whatever. Is that a dumb fear? With an app I need to trust the app maker. With an app that takes random LLMs I also need to trust the LLM maker. For text gen, or image gen I don't care but for home automation, suddenly it matters if the LLM unlocks my doors, turns on/off my cameras, t…
That could be solved by using something like Anthropic's Constitutional AI[1]. This works by adding a 2nd LLM that makes sure the first LLM acts according to a set of rules (the constitution). This could include a rule to block unlocking the door unless a valid code has been presented. [1]: https://www-files.anthropic.com/production/images/Anthropic_...