Live data from Hacker News

Show HN: Gdańsk AI – full stack AI voice chatbot

github.com

11–20 of 35 posts

Re: Show HN: Gdańsk AI – full stack AI voice chatbot

#11
post #10

Great job on Gdańsk AI! How do you handle the speech-text/API latency? Coincidentally, I'm working on an idea that is similar to your other project https://poss.market/market/ How's it going? Would love to learn more.

Hi, thanks! STT/TTS latencies are a bit bottleneck here unfortunately, so it's not as fast as I'd want to

I'm about to launch poss market on production! Feel free to drop a mail at jed@maczan.pl

Re: Show HN: Gdańsk AI – full stack AI voice chatbot

#13

I've honestly lost all interest in anything integrating with OpenAI at this point. Llama 2 is giving completions at ChatGPT levels with a single GPU. I've replaced all of my LLM usage with it. Open local models are the future.

Open local models are literally the past, but the very recent past. I therefore agree -- as long as they remain only on the order of a year older than the cutting edge, their future looks extremely bright.

I just hope for-profit enterprises continue wanting to push that frontier as hard as they have been. (Wait, actually also if they stop doing that it might be for the best ...)

Re: Show HN: Gdańsk AI – full stack AI voice chatbot

#17

Related, what’s the current SOTA on STT models freely available? T5 is pretty good but the closed Google and Meta stuff seems better.

TorToiSe (https://github.com/neonbjb/tortoise-tts) produces the best quality speech of any freely available model. However, its long inference times makes it impractical for voice chatbots like Gdansk.

Re: Show HN: Gdańsk AI – full stack AI voice chatbot

#18
I've always wondered if there's a better way of making voice assistants. With this stack, the AI will not be able to answer "what is this sound?", or give you UK-based information because it picked up on your British accent. It's bottlenecked by text. A model that can understand audio as input, and output audio directly, could be so much more powerful

Re: Show HN: Gdańsk AI – full stack AI voice chatbot

#20
post #18

I've always wondered if there's a better way of making voice assistants. With this stack, the AI will not be able to answer "what is this sound?", or give you UK-based information because it picked up on your British accent. It's bottlenecked by text. A model that can understand audio as input, and output audio directly, could be so much more powerful

Sure there's a better way. https://google-research.github.io/seanet/audiopalm/examples/

There's no reason autoregressive LMs can't be used to model audio data.

Post reply on HN