Scaling is definitely a good thing, microservices make scaling easier, no doubt about that. But an MVP rarely needs k8s level scaling, it just needs to be written well so it can scale in the future.
Scaling up the Prime Video audio/video monitoring service and reducing costs
161–170 of 526 posts
Re: Scaling up the Prime Video audio/video monitoring service and reducing costs
#162Earlier quoted context omitted.
I don't see whats funny about my statement. Please elaborate on your definition of monoliths vs scalable microservices.
To most people, "mono" refers to a single codebase, not a single deployed instance. I've worked on many monoliths that run multiple instances in production. Microservices are no more or less scalable than a monolith. The main benefit of Microservices is allowing multiple teams to work independently from each other without everyone "stepping on each others toes". You can have scalable monoliths and unscalable microser…
Re: Scaling up the Prime Video audio/video monitoring service and reducing costs
#163Earlier quoted context omitted.
> lately "lateley" as in "for the last 5 years"?
more like ~10 years. 2014: https://martinfowler.com/articles/microservices.html but also 2015: https://martinfowler.com/bliki/MonolithFirst.html
Re: Scaling up the Prime Video audio/video monitoring service and reducing costs
#164AWS is truly a customer first company. I been AWS customer in its early days (2006-2012) and then recently (2022-now). And they have been consistent in being customer-first. In the last year, they have proactively helped us cut our AWS spend by multiples. I'm not surprised at all by this article coming from within Amazon. Kudos for maintaining such a culture.
Re: Scaling up the Prime Video audio/video monitoring service and reducing costs
#165My word. I'm sort of gob smacked this article exists. I know there are nuances in the article, but my first impression was it's saying "we went back to basics and stopped using needless expensive AWS stuff that caused us to completely over architect our application and the results were much better". Which is good lesson, and a good story, but there's a kind of irony it's come from an internal Amazon team. As another…
Yep, expect the Lambda team to raise hell.
Re: Scaling up the Prime Video audio/video monitoring service and reducing costs
#166Of all the video streaming services I have used, PrimeVideo is the one where the video/audio sync becomes terrible progressively. It is pretty bad. It happens in 8 out of 10 movies. There is some misconfiguration in their AV transcoding pipeline. And here, we have an article talking about Monolith vs. Microservices improving user experience.
Of all the streaming services that have irritated me, I can't recall any serious technical problems with prime. I suppose I have a vague memory of poor AV sync that could have been on prime, it was always a problem at the start of streaming that would work itself out after a few seconds. Netflix's shiny new compression scheme a couple years ago didn't work on my Sony TV's buggy silicon. The only way I got that fixed…
And I use a FireStick, FWIW.
BTW, their own trascoder product MediaConvert seems to have this issue (It is possible that it could be user error too in how they have used the product or setup the parameters). [1]
My guess is PrimeVideo dogfoods MediaConvert and they also have this issue. They could have fixed it for newer content, but previously transcoded content still has issues (which will remain until they are re-transcoded).
[1]: https://repost.aws/questions/QUGajgu4zKTlewlTg1M96i_Q/questi...?
Re: Scaling up the Prime Video audio/video monitoring service and reducing costs
#167As a former AWS employee I can almost guarantee that the person that made the original design got a promotion over it.
They put individual video frames as images in S3. That’s ubsurdly dumb. It’s like putting a frame buffer on an HDD.
Re: Scaling up the Prime Video audio/video monitoring service and reducing costs
#168I'm pretty convinced that microservices are one of those things that make sense 5% of the time and the other 95% is cargo culting.
My team owns an API monolith that hosts several completely unrelated endpoints. I keep thinking this would be a good candidate for breaking into microservices, but I do wonder if I'm buying into the hype.
Re: Scaling up the Prime Video audio/video monitoring service and reducing costs
#169Earlier quoted context omitted.
I feel like it’s an object lesson in using the right solution for a problem. Step functions do not appear to me to be something that you’d use for things that need to be executed multiple times per second.
Yeah, this is my takeaway too. I'm pretty happy with the monolith that we run at our business and this seems to validate our decision to stick to that monolith, but I'm also pretty confident that where we use AWS Lambda, serverless is absolutely the right way to go. For example, I've written a Lambda application to reply to webhook calls and send API calls whenever those come in. It costs maybe $2 per month to run in…
Re: Scaling up the Prime Video audio/video monitoring service and reducing costs
#170I guess what AWS sells is not servers, but software to manage them automatically, to load balance, to replicate etc. Once, in a short time, GPT can write such (pretty standard) software for you, Amazon will, too, go down.