Just watching some olympic games and it occurred to me almost all video players has the issue of audio & video mismatch.
Is it because of floating point issue? What's the root cause?
Ask HN: What's the root cause of audio and video mismatch?
1–5 of 5 posts
Re: Ask HN: What's the root cause of audio and video mismatch?
#2Audio and video are encoded, compressed, and transmitted differently because of how humans audially/visually decode them. We fare better dropping late video frames than degrading their quality, where the opposite is true for audio. As we transmit the two as separate, asynchronous signals, it's unsurprising that they are frequently out of sync.
Re: Ask HN: What's the root cause of audio and video mismatch?
#3Audio and video are encoded, compressed, and transmitted differently because of how humans audially/visually decode them. We fare better dropping late video frames than degrading their quality, where the opposite is true for audio. As we transmit the two as separate, asynchronous signals, it's unsurprising that they are frequently out of sync.
This, but also at the physical devices level, there will be different delays. For example my video stream goes to the projector with some specific frame delay. But the audio goes over bluetooth to a speaker, which introduces its own per-packet delay. The source tries to balance those as much as possible, but the result will differ slightly each time they're turned on.
Re: Ask HN: What's the root cause of audio and video mismatch?
#4Latency
Re: Ask HN: What's the root cause of audio and video mismatch?
#5they follow different channels and at some point the sync is lost...youll get this, for instance, when a synced stream is diverted for additional commentators audio...the commentator and you see the original video, the commentator hears the original audio, you hear the delayed original audio mixed with the commentators audio