Show HN: Pi-C.A.R.D, a Raspberry Pi Voice Assistant

#1

Post by nkaz123 » Mon, May 13, 2024, 7:03 PM UTC

Pi-card is an AI powered voice assistant running locally on a Raspberry Pi. It is capable of doing anything a standard LLM (like ChatGPT) can do in a conversational setting. In addition, if there is a camera equipped, you can also ask Pi-card to take a photo, describe what it sees, and then ask questions about that.

It uses distributed models so latency is something I'm working on, but I am curious on where this could go, if anywhere.

Very much a WIP. Feedback welcome :-)

Show HN: Pi-C.A.R.D, a Raspberry Pi Voice Assistant
github.com

Re: Show HN: Pi-C.A.R.D, a Raspberry Pi Voice Assistant

#2

Post by harwoodr » Mon, May 13, 2024, 7:35 PM UTC

I see that a speaker is in the hardware list - does this speak back?

Re: Show HN: Pi-C.A.R.D, a Raspberry Pi Voice Assistant

#3

Post by eddieroger » Mon, May 13, 2024, 7:45 PM UTC

> Why Pi-card? > Raspberry Pi - Camera Audio Recognition Device.

Missed opportunity for LCARS - LLM Camera Audio Recognition Service, responding to the keyword "computer," naturally. I guess if this ran elsewhere from a Pi, it could be LCARS.

Re: Show HN: Pi-C.A.R.D, a Raspberry Pi Voice Assistant

#4

Post by rkagerer » Mon, May 13, 2024, 7:47 PM UTC

eddieroger wrote: post #3

> Why Pi-card? > Raspberry Pi - Camera Audio Recognition Device. Missed opportunity for LCARS - LLM Camera Audio Recognition Service, responding to the keyword "computer," naturally. I guess if this ran elsewhere from a Pi, it could be LCARS.

Pi-C.A.R.D is perfect. Read it 100% as Picard, and more recognizable that LCARS.

Re: Show HN: Pi-C.A.R.D, a Raspberry Pi Voice Assistant

#5

Post by rkagerer » Mon, May 13, 2024, 7:50 PM UTC

I wanted to create a voice assistant that is completely offline and doesn't require any internet connection. This is because I wanted to ensure that the user's privacy is protected and that the user's data is not being sent to any third party servers.

Props, and thank you for this.

Re: Show HN: Pi-C.A.R.D, a Raspberry Pi Voice Assistant

#6

Post by orthecreedence » Mon, May 13, 2024, 8:09 PM UTC

rkagerer wrote: post #4

eddieroger wrote: post #3

> Why Pi-card? > Raspberry Pi - Camera Audio Recognition Device. Missed opportunity for LCARS - LLM Camera Audio Recognition Service, responding to the keyword "computer," naturally. I guess if this ran elsewhere from a Pi, it could be LCARS.

Pi-C.A.R.D is perfect. Read it 100% as Picard, and more recognizable that LCARS.

Just configure it to respond to "Computer" and you're good to go.

Re: Show HN: Pi-C.A.R.D, a Raspberry Pi Voice Assistant

#7

Post by bdcravens » Mon, May 13, 2024, 8:11 PM UTC

eddieroger wrote: post #3

> Why Pi-card? > Raspberry Pi - Camera Audio Recognition Device. Missed opportunity for LCARS - LLM Camera Audio Recognition Service, responding to the keyword "computer," naturally. I guess if this ran elsewhere from a Pi, it could be LCARS.

Or LLM Offline Camera, User Trained Understanding Speech

LOCUTUS

Re: Show HN: Pi-C.A.R.D, a Raspberry Pi Voice Assistant

#8

Post by MisterTea » Mon, May 13, 2024, 8:13 PM UTC

eddieroger wrote: post #3

> Why Pi-card? > Raspberry Pi - Camera Audio Recognition Device. Missed opportunity for LCARS - LLM Camera Audio Recognition Service, responding to the keyword "computer," naturally. I guess if this ran elsewhere from a Pi, it could be LCARS.

This is why we can't have nice LCARS things: https://en.wikipedia.org/wiki/LCARS#Legal

Re: Show HN: Pi-C.A.R.D, a Raspberry Pi Voice Assistant

#9

Post by nkaz123 » Mon, May 13, 2024, 8:14 PM UTC

harwoodr wrote: post #2

I see that a speaker is in the hardware list - does this speak back?

Yes! I'm currently using https://espeak.sourceforge.net/, so it isn't especially fun to listen to though.

Additionally, since I'm streaming the LLM response, it won't take long to get your reply. Since it does it a chunk at a time, there's occasionally only parts of words that are said momentarily. Also of course depends on what model you use or what the context size is for how long you need to wait.

Re: Show HN: Pi-C.A.R.D, a Raspberry Pi Voice Assistant

#10

Post by ornornor » Mon, May 13, 2024, 8:18 PM UTC

rkagerer wrote: post #5

I wanted to create a voice assistant that is completely offline and doesn't require any internet connection. This is because I wanted to ensure that the user's privacy is protected and that the user's data is not being sent to any third party servers. Props, and thank you for this.

Ditto!