Viewing profile — JohnTheNerd

or if you have an Apple Silicon Mac, this: https://github.com/TaterTotterson/microWakeWord-Trainer-Appl... I used it personally, did a lot of research (including asking questions t…

that's a great idea! I've been looking into that (I'm merely logging all prompts in a JSON file for now, so that I can analyze them later). skipping the LLM would be tough because …

If you are scared of messing with electricity like I am, instead of using power monitoring, another viable but less reliable option is to use vibration sensors. I picked up a simpl…

I think you have a valid point, but the risk of this feels exaggerated. I already had a few entities I didn't really need it using (not for security reasons, but to shorten the sys…

"successful" is a very optimistic way of looking at it. it has several downsides but largely works for my needs: - read access is mostly available for sensors, even if access wasn'…

I recommend opening the original link if possible, because the archive link is missing the demo video and a few important updates to the jinja templates!

that is correct! the less I rely on external companies and/or servers, the happier I am with my setup. I actually greatly simplified my infrastructure in the blog... there's a LOT …

I do it, but I'm completely insane: - I actually stay on top of all patches, including HomeAssistant itself - I run it behind a WAF and IPS. lots of VLANs around. even if you breac…

it is almost entirely the LLM. I can see this in action by typing a response on my computer instead of using my phone/watch, which bypasses Whisper and Piper entirely. your approac…

it actually works really well when I use it, but is slow because of the 4060Ti's (~8 seconds) and there is slight overfitting to the examples provided. none of it seemed to affect …

alternatively, could we not simply split by common characters such as newlines and periods, to split it within sentences? it would be fragile with special handling required for num…

thank you for building an amazing product! I suspect cloning OpenAI's API is done for compatibility reasons. most AI-based software already support the GPT-4 API, and OpenAI's offi…

power consumption. I am running multiple GPUs somewhere residential. the 4060Ti only draws 180W at max load (which it almost never reaches). 3090 is about double for 1.5x the VRAM,…

that is true, but consider two things: - motherboards and CPUs have a limited number of PCIe lanes available. I went with a second-hand Threadripper 2920x to be able to have 4 GPU'…

I never tried it, but I think it would go very poorly without a wake word of sorts. HomeAssistant seems to natively support wake words, but I haven't looked into it yet. I simply u…

yes, they are the 16GB models. beware that the memory bus limits you quite a bit. however, buying brand new, they are the best VRAM per dollar in the NVIDIA world as far as I could…

that is correct! I would much rather run everything in-house, where I know the quality won't be degraded over time (see the Google Assistant announcement from yesterday) and I am i…

that is correct, however I am already using all of my VRAM. it would mean I have to degrade my model quality. I instead decided that I would rather have one solid model, and have a…

I would strongly advise using a GPU for inference. the reason behind this is not mere tokens-per-second performance, but that there is a dramatic difference in how long you have to…