11–20 of 48 posts
the demo doesn't mimic my voice unless I misunderstand 'mimic'
are you guys using livekit for webrtc? If yes, are you using livekit agents as well?
are you guys using livekit for webrtc? If yes, are you using livekit agents as well?
Yes! LiveKit is great - and we are using livekit agents but had to override a few low-level library components for our use case.
I really like the concept, but I don't understand why you guys are building an entire video conferencing platform. That sounds like years of work building the network and millions of VC funds. It could be a standalone app that exports video to existing conferencing services. I would pay good money for that.
Thanks! We have a virtual camera on our roadmap as well, but by building the conferencing platform end to end we can optimize both latency and conversation UX to a much higher degree. We're also lucky to be building this now and not five years ago - there are some solid webrtc infra companies and open source projects to build on.
Are you training your own translation models? or using third-party services?
>> >> Think real-time translation + natural expressions + perfect lip sync.
not yet, based on the demo.
Cool idea, but just watching your demo it looks like it doesn’t work. Is there any change in the video? The lip movements certainly don’t look synchronized, and audio often continues after the person stops talking. It also doesn’t do any audio mimicking. It really doesn’t look like it does anything that Google Translate doesn’t.
Assuming the tech is solid, I think that if you had developed this as a browser extension to work on top of Meet/Teams/etc, not only would your dev time have been much shorter and adoption much faster, but Google/Microsoft/etc would have probably bought you out in a blink of an eye.