131–139 of 139 posts
Earlier quoted context omitted.
But that's just software that also runs fine locally. A few tools with a local LLM can do it.
Well I don't see people running their web search locally, so I don't think they will run their own search+LLM.
Earlier quoted context omitted.
Or why not just buy a blackwell rack? Runs everything today with bleeding edge performance. Overall whats the difference between 8k or 30k? /s
You jest, but there's a ton of people on /r/localLLaMA which have an RTX 6000 Pro. No one has a Blackwell rack. As long as you have the money this hardware is easily accessible to normal people, unlike fancy server hardware.
Earlier quoted context omitted.
And if it is plugged in to the wall, I'd be tempted to add a touch screen display and a camera just in case. But really my use case is as simple as 1. Wake word, what time is it in ____ 2. Wake word, how is the weather in ____ 3. Wake word, will it rain/snow/?? in _____ today / tomorrow / ?? 4. Wake word, what is ______ 5. Wake word, when is the next new moon / full moon? 6. Wake word, when is sunrise / sunset? And s…
So you need a clock maybe? Plus something like wttr.in
Earlier quoted context omitted.
This sounds a lot like gptars. I want a little gptars tearing around my house. https://youtube.com/shorts/e2t0RxX4b54
I forgot about him. Great project! Reminds me of a video from the 90's where some wizard put a camcorder and a giant antenna on a petrol powered rc car, an even bigger antenna on his house and controlled it from a 40's style sofa and a huge tube TV in his cramped garage. Over a mile range. Surrounded by enormous cars I think he was going 40-50 mph but with the screaming engine sound and the camera so low to the groun…
There is a huge market segment waiting here. At least I think there is. Well, at least people like me want this. Ok, tens of dollars can be made at least. It is just missing a critical tipping point. Basically, I want an alexa like device for the home backed by local inference and storage with some standardized components identified: - the interactive devices - all the alexa/google/apple devices out there are this in…
Even gave it a custom wake word, she's Janet now.
HA is pretty clunky and there's a lot of manual setup. But I have a voice assistant contained entirely within my local infrastructure. I'm even planning to wire it up to my local ollama server for actual AI inference behind it.
So far it's exactly as crappy as Alexa, but only because I haven't waded deep enough into configuration. I'm okay with tools being crap when it's my fault instead of the tool being crap because it doesn't make Amazon enough money.
Earlier quoted context omitted.
What's wrong with the wakeword stuff? Great timing as I was looking into it yesterday as was thinking about writing my own set of agents to run house stuff. I don't want to spent loads of time on voice interaction so HA wakeword stuff would've been useful. If not I'll bypass HA for voice and really only use HA via mcp. I can do fw dev for micros...but omg do I not want to spend the time looking thru a datasheet and g…
You can use the vendor supported wakewords, and they are generally pretty good. However-> These are device specific. The devices I purchased for this purpose have very few vendor supported wakewords, but even more prominently, refuse to integrate with HA. Possible firmware issue, but I have reloaded the firmware 30 times. I dont necessarily want to purchase something else for this purpose. Which is where building a b…
It's not really a big burden.
A tiny AI running locally is the third option you want. That's the only reasonable way to do configurable wake word detection
There is a huge market segment waiting here. At least I think there is. Well, at least people like me want this. Ok, tens of dollars can be made at least. It is just missing a critical tipping point. Basically, I want an alexa like device for the home backed by local inference and storage with some standardized components identified: - the interactive devices - all the alexa/google/apple devices out there are this in…
Just last week I hacked my Echo Show to install a custom OS and hook it into HomeAssistant. Even gave it a custom wake word, she's Janet now. HA is pretty clunky and there's a lot of manual setup. But I have a voice assistant contained entirely within my local infrastructure. I'm even planning to wire it up to my local ollama server for actual AI inference behind it. So far it's exactly as crappy as Alexa, but only b…
Wowsers I did not know this was a thing; TIL, thanks!
Earlier quoted context omitted.
Thanks for pointing this out, https://hackyournews.com should be up and running again!
Is this your project? It would be great to bolster it with links to comment sections and the current points tally.
Up-to-date comment tallies are hard, since the summaries are only updated a few times a day.