Live data from Hacker News

Home Assistant 2023.11

home-assistant.io

161–170 of 195 posts

Re: Home Assistant 2023.11

#161

Earlier quoted context omitted.

This is very helpful, thanks. I am grateful for your explanations of the voice aspect - Amazon has kept all of this under wraps so much so that I didn't understand all the difficulties until I read your site just now. I can guess at the difficulties based on how often I have to repeat simple commands to Alexa, or "normal people bread" (my fam's word for non-grain, non-healthy bread) gets changed to "normal maple brea…

My pleasure! If you have a lot of time and patience you can read my very long recent response[0] to a user asking about this where I go into arguably far too much detail. For context Wyoming is the fundamental protocol for the entire Home Assistant/ESPHome implementation. In terms of commercialization, yes and no. Speaking of experience and background - the real genesis of Willow was three years ago when I was approa…

I know it's difficult, but is there a way to gather feedback from the user when a voice command is below a certain threshold of understandability? Or to build a context catalog, such as time of day specific types of commands are expected?

I think these two areas could be holding the commercial voice assistants back, since the majority of bug reports on the Google Home and Alexa subreddits are people complaining about being misheard.

Re: Home Assistant 2023.11

#162

Earlier quoted context omitted.

Yeah, I am perfectly capable of writing my desired logic in ten or more actual programming languages, but I'm stuck with writing imperative code in a serialization language. Hass is the great equalizer of home automation, difficult to script for non-programmers AND programmers.

Isn’t HA open source? I wonder if it would be possible to build an alternate automation running that runs in a given language.

There's AppDaemon/NetDaemon if you want to write automations in python or c#, but very few people use them, because it's massive overkill.

Re: Home Assistant 2023.11

#163

Earlier quoted context omitted.

I recently did the same and have been thrilled with it though I'm sad that the bulbs don't transition to new colors. They immediately change which looks a little jarring.

I had the same thought at first since that's the default, but it's configurable! In the zigbee2mqtt control panel, click the device, choose "Settings (specific)", and change transition to 1. The look/feel ends up being indistinguishable from the Hue defaults.

Thank you for the info! Why is that not the default... :/

For reference:

"Settings > Devices & Services > Zigbee Home Automation > Configure > Global Options > Default light transition time" = 1

PS. Not sure what this does exactly:

"Enable enhanced light color/temperature transition from an off-state"

Re: Home Assistant 2023.11

#164

Earlier quoted context omitted.

One of the things I'm really surprised by about HA/Nabu Casa is the complete lack of an LTS branch/releases. Things related to homes are measured in years or decades. HA has gotten better about it but there are still occasional "cross your fingers and pray" scenarios when doing upgrades because every single release combines new functionality, fixes, breaking changes, and introduces new issues (of course). People come…

I think the answer to this is generally to pin to a working version and expect to upgrade once a year unless there's a security patch. I think the answer the HA folks would give is to point out that they are still under very heavy development and "longterm stability" just isn't something that the project has reached in a way that supports LTS. I don't think this answer is wrong - HA today is amazingly different than…

In a way HA is fundamentally an operating system for your home. It does target more technical users than Joe consumer but not by much in the grand scheme of things, especially as they intend to make it more and more 100% web driven, sell "plug in and go hardware", etc.

The plug in and go hardware is interesting because when you think about it a user who is intimidated to flash an SD card and stick it in a Raspberry Pi is going to have quite the shock when an upgrade eventually becomes necessary and they encounter the challenge that is trying to upgrade even a many months old HA install (forget about years).

As they target more and more users of less technical ability and sophistication this is going to only get worse and worse. If you look through this thread even the HN crowd (which leans heavily technical) is saying things that essentially come down to "the last thing I need in my life is more time spent on Github issues and random forums". Many of them end up going back around to "full home luddite" mode because they just can't stand to have to debug a light switch.

I appreciate this all too well. Many people who know me (their nerdy friend) are surprised I use iPhone, Mac, etc. I simply tell them something like "when I spend all day doing the hard tech stuff I have to do I need to be able to turn that part of my brain off and use something dumb". When I'm checked out and burnt out yes please give me the Fisher-Price experience that is the iPhone.

The issue with your upgrade approach is the same thing as all rolling releases - the more time that goes by, the more likely an upgrade is likely to break things even worse.

If you peruse the HA community forums, reddit, Discord, etc you will often see advice like "if you're not going to upgrade every month when you do upgrade do it progressively through each release", which is still and arduous and very time consuming process.

Re: Home Assistant 2023.11

#165

Earlier quoted context omitted.

Very nice! Would you be interesting in integrating with my project Willow[0]? Willow supports Home Assistant, OpenHAB, and generic REST+MQTT endpoints today. With Home Assistant and OpenHAB we benefit from their specific API support for providing speech to text output and processing through things like the HA Assist Pipelines[1]. From our standpoint we handle wake word, VAD+AEC+BSS, STT, TTS, user feedback, etc. All…

Nice! What languages do you support? (for STT & TTS)

Thanks!

STT is "just" a very heavily optimized (beyond even faster-whisper) Whisper implementation, so all of those languages[0].

For TTS we now use Coqui, which has a wide range of models with various voices, languages, etc. It even supports Meta MMS which has support for 1,100 languages[1].

[0] - https://github.com/openai/whisper#available-models-and-langu...

[1] - https://about.fb.com/news/2023/05/ai-massively-multilingual-...

Re: Home Assistant 2023.11

#166
post #16

There's a decent amount of friction for a European resident trying to use HA. The landing page has two products with pricing in dollars and nothing else w.r.t. hardware. Click "Getting started" and there's still no sign of what to buy. Click "Installation" and then there are 9+ platforms (and multiple subplatforms) but no quick and realistic comparison of features or pricing. Is a NUC12WSHi3 a better deal, more energ…

I'm in Europe and this hasn't been my experience _at all_. I recently started using HA. I bought a HomeAssistant Yellow box which was very easy and got delivered to me speedily from within Europe. I set up my device and the web interface allowed me to link it to their cloud offering, where I could subscribe to the plan in euros - because it knew I was in The Netherlands. But it also works just fine without the subscr…

Good to know. I wasn't aware there's a cloud. From what I can tell, Yellow wouldn't be necessary if I have a Hue bridge. I definitely don't need GPIO. Most important to me is usability by others, so what would be the most inconvenient failure modes?

Re: Home Assistant 2023.11

#167
post #7

Hass is the kind of software that has a lot of rough edges, but you use it anyway because there's very little direct competition. And every release feels like so much stuff has been finally polished, but then you deploy the new version and there's still a lot of stuff that feels or looks weird (the part-bad-UI-part-YAML automation). I have been using it for a couple of years now and I still haven't decided whether I…

We are making Gladys Assistant ( https://gladysassistant.com/ ), an open-source smart home software. It's less "techy" than HA (no YAML files, no CLI), and UI first. We have way less integrations for now, but are working hard on it. Don't hesitate to try it and make us some feedback.

Is in packaged in Linux distributions?

Re: Home Assistant 2023.11

#168

Earlier quoted context omitted.

My pleasure! If you have a lot of time and patience you can read my very long recent response[0] to a user asking about this where I go into arguably far too much detail. For context Wyoming is the fundamental protocol for the entire Home Assistant/ESPHome implementation. In terms of commercialization, yes and no. Speaking of experience and background - the real genesis of Willow was three years ago when I was approa…

I know it's difficult, but is there a way to gather feedback from the user when a voice command is below a certain threshold of understandability? Or to build a context catalog, such as time of day specific types of commands are expected? I think these two areas could be holding the commercial voice assistants back, since the majority of bug reports on the Google Home and Alexa subreddits are people complaining about…

I've been thinking about this a little recently. Raw brain dump incoming...

The problem with intent matching now (say with Home Assistant) is that the transcribed speech more-or-less needs to exactly (character for character) match the defined entities (names of lights, etc) as well as the grammar and structure expected by the intent definitions.

Something as simple as a hyphen in "turn-off" currently breaks the matching. That's an easy one to fix, I'm just providing it as an example.

In terms of addressing this, I've kicked around a few ideas:

With Home Assistant at least we can pull all of the entities and supported intents. We have a variety of options to do all kinds of fuzzy matching with these now known phrases. We'd fix the transcription based on something like nearest neighbor (more or less) and send the clean command to HA. There is also a way to handle this in the prompt to Whisper.

A literal text embedding model with nearest neighbor search seems kind of ridiculous but I've been curious about it. The same could be done at the audio level by essentially making an embedding of the Mel Spectrogram of the actual audio (which we could have available) and searching on that.

There are also approaches with a variety of NLP implementations, language models, etc that could be combined or used separately.

We've also considered some more manual approaches - things like an interface that logs sessions where you can (after the fact) find a session/command that went wrong, and basically map it to what you wanted. While this may seem tedious we get some reports that our speech recognition consistently mis-transcribes a given voice command. Implementing a lookup table to correct for this is simple. The biggest challenge to this is how to deal with the UI/UX aspects.

Re: Home Assistant 2023.11

#169

Earlier quoted context omitted.

This is very helpful, thanks. I am grateful for your explanations of the voice aspect - Amazon has kept all of this under wraps so much so that I didn't understand all the difficulties until I read your site just now. I can guess at the difficulties based on how often I have to repeat simple commands to Alexa, or "normal people bread" (my fam's word for non-grain, non-healthy bread) gets changed to "normal maple brea…

> Basically, I want an Alexa setup without the dependence on (or financial expectations from) Amazon Amen. +1 to timers, schedules, integration with a lighting bridge or even kitchen appliances e.g. Home Connect, custom routines, music (including Bluetooth and/or TuneIn), line out (so I can connect my own speakers), microphone relays that I can put all around the house instead of owning 5 or 6 RaspPis and the associa…

> microphone relays that I can put all around the house instead of owning 5 or 6 RaspPis and the associated 15 to 30 watts

I've always found this approach odd and this is one the reasons we primarily target the ESP-BOX-3 from Espressif[0]. For $50 you take it out of the box, flash from our web flasher, and stick it in your house. Given that it's ESP32-S3 based total power consumption is somewhere in the 100 milliwatt range. Once initially flashed all upgrades are done over the air (with The thought of managing half a dozen full Linux machines (Pis) just to get audio for stuff like this boggles my mind. Additionally, the audio quality is significantly better with the ESP-BOX-3 vs Pi, etc because the entire device and software stack is holistically engineered for high quality far-field voice capture. Acoustically tuned enclosure, dual microphones, acoustic echo cancellation, blind source separation, voice activity detection, wake word, etc.

As I like to tell people - if you think you're going to slap a random microphone together with a Raspberry Pi and compete with Alexa you have another thing coming. I go into greater detail in this issue[1].

Getting high quality audio is step one. Step two is accurate transcription of that audio. Steps 3 - ? are what you're describing. We know what you said, now what do we do with it?

Now that we feel steps one and two are more-or-less nailed steps three and beyond are our next focus. The good news is the final step is of course user feedback and we have that handled with text to speech and output on the BOX-3 LCD display. It's just currently the wide gulf in between these that needs focus.

In short, our mouth and ears work well. It's the brain that needs work.

[0] - https://www.espressif.com/en/news/ESP32-S3-BOX-3

[1] - https://github.com/toverainc/willow/issues/317#issuecomment-...

Re: Home Assistant 2023.11

#170

There's a decent amount of friction for a European resident trying to use HA. The landing page has two products with pricing in dollars and nothing else w.r.t. hardware. Click "Getting started" and there's still no sign of what to buy. Click "Installation" and then there are 9+ platforms (and multiple subplatforms) but no quick and realistic comparison of features or pricing. Is a NUC12WSHi3 a better deal, more energ…

Nonsense. HA is software not hardware. Get any pc, raspberry pi, whatever, install, follow the pretty interface instructions. I have no idea why you think European has anything at all to do with that. > then there are 9+ platforms (and multiple subplatforms) but no quick and realistic comparison of features or pricing. No. It is simply "what hardware or OS do you have? Click here".

I don't want to run HA on hardware I already have. I want to put a small box with new hardware on my bookshelf where my Google Home used to live until it was replaced with Alexa, which got removed three weeks ago. If HA is not hardware, why do they have multiple hardware platforms for sale? And what is actually the best value for a dedicated HA device? That is unclear. Why would you need more extensible storage or a variety of RAM possibilities for HA? That is not clear from the first few pages.

I'm sure I can take a spare RPi from my bottom desk drawer and get HA running before lunch tomorrow. I also know that's a waste of a RPi if there's purpose-built hardware (and by that, I mean power profiled, no useless Arduino-layout pins, no SSH configuration, ideally no manual installation at all). If I'm not around and HA stops running because RPis sometimes have weird clock issues or someone closes the power cord in a desk drawer (RIP old laptop) or a service was misconfigured or SD flash storage sometimes goes haywire, are my family members going to be in the dark, literally, while I'm away?

A site that doesn't spoonfeed you the step-by-step, dummy-proof onboarding (a la Hue) usually indicates that the product will require equally esoteric maintenance.

My partner only thinks of Raspberry Pi as a food, and I know of it as a collection of known and yet-to-be-discovered vulnerabilities that runs about 300 mA too much all the time. I have a NUC. It's a royal pain in my ass because it's my primary device and if you don't have a very precise combination of drivers and BIOS settings, it overheats and/or refuses to wake from sleep. (It's actually a replacement; the first overheated one too many times.) I will never, ever run HA on a NUC.

Same deal with Docker: Every time I touch containers, I discover the Who's Who? of certificate errors, "jessie/bionic were last in vogue 5 years ago; no version pin, no run" (yesterday's error), "No connection could be made because the target machine actively refused it", system clock is wrong, etc.

I'm not so cruel to subject my family to opening up a terminal or finding the right manpage anytime the smart home starts acting dumb.

-----

As far as residency mattering... Dollars are on the home page. Only after clicking a few links to buy can I find a variety of countries for buying a Yellow or Green, but the place where I live is not actually the best option, price-wise. Unless someone from mediarath is going to phone me up and walk me through the setup or throw in the perfunctory bag of Goldbären, there's no point in paying extra when the guy a few borders over will ship it for less.

People in Denmark seem to be getting screwed worse, at 126 euros per Green. It's one thing if this was an American or European product, but they're all COO China (and it's still not even breakeven to buy bulk from the Chinese vendor, it would be the U.S. price before tax and customs---ultimately more than the Danes).

Post reply on HN