Built out the demo on my M1 Max Macbook and it was absolutely terrible. Around 10 seconds for each reply, and even then it was saying something totally unrelated.
[flagged]
Nvidia PersonaPlex 7B on Apple Silicon: Full-Duplex Speech-to-Speech in Swift
61–70 of 139 posts
Re: Nvidia PersonaPlex 7B on Apple Silicon: Full-Duplex Speech-to-Speech in Swift
#62Built out the demo on my M1 Max Macbook and it was absolutely terrible. Around 10 seconds for each reply, and even then it was saying something totally unrelated.
Also in general I don't know get what the appeal of a 7b full-duplex (speech-to-speech) model is: 7b can't be very intelligent on its own, and for anything useful, you'd need tool-calls, which speech-to-speech models can't do. This is also why ChatGPT voice mode annoys by never doing a web search or reading a link (in fact it pretends to search or read, outright makes up stuff, and when pushed admits it can't really read web pages or do web searches).
There are probably definitely use cases for this though, open to be educated on those.
Re: Nvidia PersonaPlex 7B on Apple Silicon: Full-Duplex Speech-to-Speech in Swift
#63I am strongly put off by the LLM writing in this piece. It makes me question quality of the project before even attempting a download.
Who would put effort into building this only to compose a low effort puff piece?
Re: Nvidia PersonaPlex 7B on Apple Silicon: Full-Duplex Speech-to-Speech in Swift
#64I am strongly put off by the LLM writing in this piece. It makes me question quality of the project before even attempting a download. Who would put effort into building this only to compose a low effort puff piece?
I hate those AI generated graphs / charts more than the text
Re: Nvidia PersonaPlex 7B on Apple Silicon: Full-Duplex Speech-to-Speech in Swift
#65Earlier quoted context omitted.
> You just need an audio buffer That alone to do right on macOS using Swift is an exercise in pain that even coding bots aren't able to solve first time right :)
I beg to differ. My agent just one-shotted a MicrophoneBufferManager in swift when asked. Complete with AVFoundation and a tap for the audio buffer. It really is trivial.
Any chance of pushing it to GitHub? My swift knowledge could be written out on an oversized beer coaster currently, so I'm still collecting useful snippets
Re: Nvidia PersonaPlex 7B on Apple Silicon: Full-Duplex Speech-to-Speech in Swift
#66This sounds quite dangerous https://www.theguardian.com/technology/2026/mar/04/gemini-ch...
Your article does a great job of summerizing the dangers (no idea what those people are that downvote you for it): > Before long, Gavalas and Gemini were having conversations as if they were a romantic couple. The chatbot called him “my love” and “my king” and Gavalas quickly fell into an alternate world, according to his chat logs. > kill himself, something the chatbot called “transference” and “the real final step”…
There are tons of safety concerns of this shape around LLMs, but do they have anything to do with the particular one presented in this article?
Unless I'm missing something, what's being presented is a small speech on-device model, not an explicit use case like a "virtual friend".
Re: Nvidia PersonaPlex 7B on Apple Silicon: Full-Duplex Speech-to-Speech in Swift
#67Built out the demo on my M1 Max Macbook and it was absolutely terrible. Around 10 seconds for each reply, and even then it was saying something totally unrelated.
Also in general I don't know get what the appeal of a 7b full-duplex (speech-to-speech) model is: 7b can't be very intelligent on its own, and for anything useful, you'd need tool-calls, which speech-to-speech models can't do. This is also why ChatGPT voice mode annoys by never doing a web search or reading a link (in fact it pretends to search or read, outright makes up stuff, and when pushed admits it can't really…
Gemini live api and grok voice api can make tool calls and they're speech to speech models
Re: Nvidia PersonaPlex 7B on Apple Silicon: Full-Duplex Speech-to-Speech in Swift
#68[deleted]
Re: Nvidia PersonaPlex 7B on Apple Silicon: Full-Duplex Speech-to-Speech in Swift
#69I am strongly put off by the LLM writing in this piece. It makes me question quality of the project before even attempting a download. Who would put effort into building this only to compose a low effort puff piece?
I hate those AI generated graphs / charts more than the text
You on about this article or other articles? I dont mind AI generated images to a degree, charts I might start to worry.
Re: Nvidia PersonaPlex 7B on Apple Silicon: Full-Duplex Speech-to-Speech in Swift
#70Earlier quoted context omitted.
Some more details: > The family’s lawyers say he wasn’t mentally ill, but rather a normal guy who was going through a difficult divorce. > Gavalas first started chatting with Gemini about what good video games he should try. > Shortly after Gavalas started using the chatbot, Google rolled out its update to enable voice-based chats, which the company touts as having interactions that “are five times longer than text-b…
> The chatbot took on a persona that Gavalas hadn’t prompted That's an interesting claim, how can we be sure of it? If Gavalas didn't have to do anything special to elicit the bizarre conspiracy-adjacent content from Gemini Pro, why aren't we all getting such content in our voice chats? Mind you, the case is still extremely concerning and a severe failure of AI safety. Mass-marketed audio models should clearly includ…
There are many explanations why these incidents could be rare but not impossible.
These models are still stochastic and very good at picking up nuances in human speech. It may be simply unlikely to go off the rails like that or (more terrifyingly) it might pick up on some character trait or affectation.
Honestly I'm appalled by the lack of safety culture here. "My plane killed only 1% of pilots" and variations thereof is not an excuse in aerospace, but it seems perfectly acceptable in AI. Even though the potential consequences are more catastrophic (from mass psychosis to total human extinction if they achieve their AGI).