Live data from Hacker News

Using ChatGPT for home automation

atomic14.com

21–30 of 117 posts

Re: Using ChatGPT for home automation

#22
I had been thinking about doing this.

I’m getting really tired of talking to Alexa now I’m used to a machine actually understanding me.

Lights is just the start. Things like getting the weather, playing a playlist (or coming up with a new one for me) would all be SO much better with an LLM instead of a dumb bot.

Edit: if you’re going to downvote. Leave a comment at least. Are there just a lot of Alexa fans in the house?

Re: Using ChatGPT for home automation

#23
post #14
post #5

Super exciting to see the work happening in this area! I can especially appreciate the use of ChatGPT to orchestrate the necessary API calls, rather than relying on some kind of middleware to do it. I have been working in this area (LLMs for ubiquitous computing, more generally) for my PhD dissertation and have discovered some interesting quality issues when you dig deeper [0]. If you only have lights in your house,…

> If I say "it's too chilly in here" in a house with only lights, it will turn them on as a way of "warming things up". Thanks for the example that's interesting. FWIW, this is pretty much what has been described as "waluigi" effect a bit extended: in a text you'll find on the internet, if some information at the beginning is mentioned, it WILL be relevant somewhere at some point later in that text. So an auto-comple…

> FWIW, this is pretty much what has been described as "waluigi" effect a bit extended

Sorry I disagree for some reasons. First, turning the lights on is literally the only thing the bot can do to heat up the house at all. Turning on the lights does heat it up a little bit. So it's the right answer. Second, that's not the Waluigi effect, not even 'pretty much' and not even 'a bit extended'. Both of them are talking about things LLMs say, but other than that no.

The Waluigi effect applied to this scenario might be like, you tell the bot to make the house comfortable, and describe all the ways that a comfortable house is like. Then by doing this you have also implicitly told the bot how to make the most uncomfortable house possible. Its behavior is only one comfortable/uncomfortable flip away from creating a living hell. Say that in the course of its duties the bot is for some reason unable to make the house as comfortable as it would like to be able to do. It might decide that it didn't do it, because it's actually trying to make the house uncomfortable instead of comfortable. So now you got a bot turning your house into some haunted house beetlejuice nightmare.

Re: Using ChatGPT for home automation

#24
post #12

I'm not against idea of having LLM be smart assistant for home, but I do have problem with sending any of that to cloud. It's one thing to use it as convenient way to change anything remotely but linking home automation not only into constant internet connectivity but also "that one particular cloud thing that might disappear at any moment" (hello google) just seems like setting yourself for problems later. At least…

[deleted]

Re: Using ChatGPT for home automation

#25
post #13
post #5

Super exciting to see the work happening in this area! I can especially appreciate the use of ChatGPT to orchestrate the necessary API calls, rather than relying on some kind of middleware to do it. I have been working in this area (LLMs for ubiquitous computing, more generally) for my PhD dissertation and have discovered some interesting quality issues when you dig deeper [0]. If you only have lights in your house,…

> If I say "it's too chilly in here" in a house with only lights, it will turn them on as a way of "warming things up". is it bad that I'm on GPT's side on this, i mean if they are incandescent lights they are small electric heaters and what else do you expect it to do

Gotta wonder why someone is saying “turn up the heat” to an AI that’s only connected to lights.

Re: Using ChatGPT for home automation

#26
post #15
post #12

I'm not against idea of having LLM be smart assistant for home, but I do have problem with sending any of that to cloud. It's one thing to use it as convenient way to change anything remotely but linking home automation not only into constant internet connectivity but also "that one particular cloud thing that might disappear at any moment" (hello google) just seems like setting yourself for problems later. At least…

"Internet of Things will not happen until LAN of Things arrives", to paraphrase someone. This already happens in the industry, like heavy industry. At home, it's held back by absence of an adequate server. Often a router box or a NAS would be fine to host something like OwnCloud. But to run ML middle, different and much more expensive hardware is required, which would sit idle 99% of time.

LAN of things - this is a fascinating idea. Can you share where you are paraphrasing this from or link to more info on this concept? Sounds familiar with the self hosted applications people now run on their NAS/routers these days.

Re: Using ChatGPT for home automation

#27
post #20

I have been using chat GPT to control my light colours for about a month now. It's too tedious to properly set the colours and temperatures of our lights manually and too complex to consider all factors like activity, weather, music, time of day and season. Chat GPT is now our personal lighting DJ, giving us dynamic and interesting light combinations that respect our circadian rhythm. Here's my prompt - the output of…

That's really cool. Are you using the API to run this locally?

Re: Using ChatGPT for home automation

#28
post #20

I have been using chat GPT to control my light colours for about a month now. It's too tedious to properly set the colours and temperatures of our lights manually and too complex to consider all factors like activity, weather, music, time of day and season. Chat GPT is now our personal lighting DJ, giving us dynamic and interesting light combinations that respect our circadian rhythm. Here's my prompt - the output of…

[flagged]

Re: Using ChatGPT for home automation

#29
post #20

I have been using chat GPT to control my light colours for about a month now. It's too tedious to properly set the colours and temperatures of our lights manually and too complex to consider all factors like activity, weather, music, time of day and season. Chat GPT is now our personal lighting DJ, giving us dynamic and interesting light combinations that respect our circadian rhythm. Here's my prompt - the output of…

That's really cool. Are you using the API to run this locally?

Yes, I access the API through Node Red which fills out the prompt template and returns Chat GPT's output to Home Assistant.

Costs about $3/year in API quota.

Re: Using ChatGPT for home automation

#30
post #13
post #5

Super exciting to see the work happening in this area! I can especially appreciate the use of ChatGPT to orchestrate the necessary API calls, rather than relying on some kind of middleware to do it. I have been working in this area (LLMs for ubiquitous computing, more generally) for my PhD dissertation and have discovered some interesting quality issues when you dig deeper [0]. If you only have lights in your house,…

> If I say "it's too chilly in here" in a house with only lights, it will turn them on as a way of "warming things up". is it bad that I'm on GPT's side on this, i mean if they are incandescent lights they are small electric heaters and what else do you expect it to do

Yeah but I think the idea is that it is a knob that calls to be turned. "It's warm in here" -> "I'll make the light blue so you feel nice and cool". "How fast do sparrows fly?" -> "Making the light brown". Like it might want to do _something_ and tweaking the hue or brightness are all it can do.

Good reason to always try to include in a prompt a way-out, a do-nothing or I-don't-understand answer.

Post reply on HN