Live data from Hacker News

Scaling up the Prime Video audio/video monitoring service and reducing costs

primevideotech.com

161–170 of 526 posts

Re: Scaling up the Prime Video audio/video monitoring service and reducing costs

#161
These days when project managers of new products seek my advice as a solutions architect I tend to suggest they create a minimally viable product that is written modularly so it can scale, but deploy it very simply on a few servers just like we used to 15 years ago.

Scaling is definitely a good thing, microservices make scaling easier, no doubt about that. But an MVP rarely needs k8s level scaling, it just needs to be written well so it can scale in the future.

Re: Scaling up the Prime Video audio/video monitoring service and reducing costs

#162
post #99

Earlier quoted context omitted.

I don't see whats funny about my statement. Please elaborate on your definition of monoliths vs scalable microservices.

To most people, "mono" refers to a single codebase, not a single deployed instance. I've worked on many monoliths that run multiple instances in production. Microservices are no more or less scalable than a monolith. The main benefit of Microservices is allowing multiple teams to work independently from each other without everyone "stepping on each others toes". You can have scalable monoliths and unscalable microser…

Thank you for clarifying. It's seems my definition doesn't correspond to others'. Then do we lack a word for a monolithic application that handles everything and that can only have one instance running?

Re: Scaling up the Prime Video audio/video monitoring service and reducing costs

#163
post #93

Earlier quoted context omitted.

> lately "lateley" as in "for the last 5 years"?

more like ~10 years. 2014: https://martinfowler.com/articles/microservices.html but also 2015: https://martinfowler.com/bliki/MonolithFirst.html

Yeah that seems closer to my experience. From my perspective, 2016ish was peak. At least thats when I had to to argue the most against trying to needlessly break up services.

Re: Scaling up the Prime Video audio/video monitoring service and reducing costs

#164

AWS is truly a customer first company. I been AWS customer in its early days (2006-2012) and then recently (2022-now). And they have been consistent in being customer-first. In the last year, they have proactively helped us cut our AWS spend by multiples. I'm not surprised at all by this article coming from within Amazon. Kudos for maintaining such a culture.

[deleted]

Re: Scaling up the Prime Video audio/video monitoring service and reducing costs

#165

My word. I'm sort of gob smacked this article exists. I know there are nuances in the article, but my first impression was it's saying "we went back to basics and stopped using needless expensive AWS stuff that caused us to completely over architect our application and the results were much better". Which is good lesson, and a good story, but there's a kind of irony it's come from an internal Amazon team. As another…

Yep, expect the Lambda team to raise hell.

Do you think the Lambda team want people to use as many of their services as possible even when it's not actually appropriate and there are better architectures and approaches available? I doubt that. They probably understand that Lambda is a good service for some things and not for others, and using it as a part of deploying things to AWS is a great idea but using it where it doesn't fit makes all of AWS look bad (in particular, hard to use and expensive.)

Re: Scaling up the Prime Video audio/video monitoring service and reducing costs

#166
post #34

Of all the video streaming services I have used, PrimeVideo is the one where the video/audio sync becomes terrible progressively. It is pretty bad. It happens in 8 out of 10 movies. There is some misconfiguration in their AV transcoding pipeline. And here, we have an article talking about Monolith vs. Microservices improving user experience.

Of all the streaming services that have irritated me, I can't recall any serious technical problems with prime. I suppose I have a vague memory of poor AV sync that could have been on prime, it was always a problem at the start of streaming that would work itself out after a few seconds. Netflix's shiny new compression scheme a couple years ago didn't work on my Sony TV's buggy silicon. The only way I got that fixed…

For me, the sync is fine at the start of playback on PrimeVideo. It just becomes bad progressively (which leads me to believe they have used a video framerate that is ever so slightly different from the source and have keyframes insertion after a longer than optimal duration; similarly sample rate mismatch for output audio relative to input audio stream could be a potential cause).

And I use a FireStick, FWIW.

BTW, their own trascoder product MediaConvert seems to have this issue (It is possible that it could be user error too in how they have used the product or setup the parameters). [1]

My guess is PrimeVideo dogfoods MediaConvert and they also have this issue. They could have fixed it for newer content, but previously transcoded content still has issues (which will remain until they are re-transcoded).

[1]: https://repost.aws/questions/QUGajgu4zKTlewlTg1M96i_Q/questi...?

Re: Scaling up the Prime Video audio/video monitoring service and reducing costs

#167

As a former AWS employee I can almost guarantee that the person that made the original design got a promotion over it.

They put individual video frames as images in S3. That’s ubsurdly dumb. It’s like putting a frame buffer on an HDD.

In any normal company, not one that profits from such dumbness :)

Re: Scaling up the Prime Video audio/video monitoring service and reducing costs

#168
post #135
post #10

I'm pretty convinced that microservices are one of those things that make sense 5% of the time and the other 95% is cargo culting.

My team owns an API monolith that hosts several completely unrelated endpoints. I keep thinking this would be a good candidate for breaking into microservices, but I do wonder if I'm buying into the hype.

You are. People like you nuked all productivity we had at my last company.

Re: Scaling up the Prime Video audio/video monitoring service and reducing costs

#169
post #160
post #131

Earlier quoted context omitted.

I feel like it’s an object lesson in using the right solution for a problem. Step functions do not appear to me to be something that you’d use for things that need to be executed multiple times per second.

Yeah, this is my takeaway too. I'm pretty happy with the monolith that we run at our business and this seems to validate our decision to stick to that monolith, but I'm also pretty confident that where we use AWS Lambda, serverless is absolutely the right way to go. For example, I've written a Lambda application to reply to webhook calls and send API calls whenever those come in. It costs maybe $2 per month to run in…

For some Alexa integrations it is neat and convenient, but I went back to hosting such small interfaces as a service on another server. Not an EC2 instance, just another hosted unmanaged server. They are as cheap as they can get right now.

Re: Scaling up the Prime Video audio/video monitoring service and reducing costs

#170

I guess what AWS sells is not servers, but software to manage them automatically, to load balance, to replicate etc. Once, in a short time, GPT can write such (pretty standard) software for you, Amazon will, too, go down.

You're vastly oversimplifying this, imho. It's not just being able to write something and get AI to write terraform for you (it doesn't do it all that well atm in reality, for anything complex). You can't automate the people who you need to convince to make those decisions internally, on the whole, at least :)
Post reply on HN