Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Using ChatGPT for home automation

atomic14.com

Post reply on HN
Print view View original

1–10 of 117 posts

Re: Using ChatGPT for home automation

#2

Post by syntaxing »

Is there something that works with home assistant? Siri is just terrible and have been trying to replace it with anything. The ESP box posted last weeks looks pretty promising but wonder if there’s something that could work directly off of the rpi I host HA with.

Re: Using ChatGPT for home automation

#3

Post by tikkun »

syntaxing wrote: post #2

Is there something that works with home assistant? Siri is just terrible and have been trying to replace it with anything. The ESP box posted last weeks looks pretty promising but wonder if there’s something that could work directly off of the rpi I host HA with.

For anyone curious, the ESP box mentioned is likely: https://news.ycombinator.com/item?id=35948462

Re: Using ChatGPT for home automation

#5

Post by evmaki »

Super exciting to see the work happening in this area! I can especially appreciate the use of ChatGPT to orchestrate the necessary API calls, rather than relying on some kind of middleware to do it.

I have been working in this area (LLMs for ubiquitous computing, more generally) for my PhD dissertation and have discovered some interesting quality issues when you dig deeper [0]. If you only have lights in your house, for instance, the GPT models will always use them in response to just about any command you give, then post-rationalize the answer. If I say "it's too chilly in here" in a house with only lights, it will turn them on as a way of "warming things up". Kind of like a smart home form of hallucination. I think these sorts of quality issues will be the big hurdle to product integration.

[0] https://arxiv.org/abs/2305.09802

Re: Using ChatGPT for home automation

#10

Post by iamflimflam1 »

evmaki wrote: post #5

Super exciting to see the work happening in this area! I can especially appreciate the use of ChatGPT to orchestrate the necessary API calls, rather than relying on some kind of middleware to do it. I have been working in this area (LLMs for ubiquitous computing, more generally) for my PhD dissertation and have discovered some interesting quality issues when you dig deeper [0]. If you only have lights in your house,…

Very interesting paper!

It's something that I've been wondering about with ChatGPT plugins - they've kind of left it up to the user to enable/disable plugins. But there's definitely going to come a point where plugins conflict and the LLM is going to have to choose the most appropriate plugin to use.

I have been very impressed at how good it is at turning random commands into concrete API calls. You are right though, pretty much any command can be interpreted as an instruction to use a plugin.

Post reply on HN