Live data from Hacker News

Scaling up the Prime Video audio/video monitoring service and reducing costs

primevideotech.com

501–510 of 526 posts

Re: Scaling up the Prime Video audio/video monitoring service and reducing costs

#501
post #282
post #194

Earlier quoted context omitted.

There was an article not long ago from AWS saying they'll be focussing on cutting cost for customers. Maybe the next step of that process will be pushing their clients off of AWS and telling them to just host on prem.

I know you're joking around, but no, as they also explained a benefit of cloud (and therefore using AWS) is that it can scale flexibly with their customers' businesses. If your business invests in physical servers anticipating strong growth next year then later finds out actually we're going into a recession and those servers are no longer needed, then that's a sunk cost. With cloud if demand drops you can scale up a…

> as they also explained a benefit of cloud (and therefore using AWS)

Although in this specific case, being a team at AWS, they are using their own company data centers, so it's essentially on-prem to them.

Re: Scaling up the Prime Video audio/video monitoring service and reducing costs

#502
post #457

Earlier quoted context omitted.

Yup, and you are paying the premium of cloud forever, which over some vanilla compute & storage can be a lot. And cloud proponents pretend data center / rack space / server leasing doesn't exist either, for those trying to avoid large up front costs.

I'm a cloud proponent because it means not having to sit through hours of meetings to deploy a $5/mo virtual machine. It also means some poor fuck at AWS gets woken up in the middle of the night instead of me when things go to shit. It absolutely comes at a cost, and might not be the right fit for an organisation that's absolutely on top of it's hardware requirements and can afford to divert resources from new develo…

> I'm a cloud proponent because it means not having to sit through hours of meetings to deploy a $5/mo virtual machine.

I'd hope there aren't actually hours of meetings for a single $5/mo VM?

But I would hope there are reviews and meetings when deploying enough of these to amount to real money. Companies that don't do that soon enough find themselves with a million dollar AWS bill without understanding what's going on.

Spend is spend, it's vital to understand what is being spent on what and why.

Re: Scaling up the Prime Video audio/video monitoring service and reducing costs

#503
post #35

Next they will transition to on premises hardware from the cloud to save another 90%.... oh wait...

I imagine they will transition to bare metal as the next step.

Don't. There's no benefit to using metal as opposed to the largest virt (which will take up the entire server anyways) pretty much. Metal just tends to be somewhat less reliable. Source: I work here.

Re: Scaling up the Prime Video audio/video monitoring service and reducing costs

#504
post #35

Earlier quoted context omitted.

I imagine they will transition to bare metal as the next step.

Don't. There's no benefit to using metal as opposed to the largest virt (which will take up the entire server anyways) pretty much. Metal just tends to be somewhat less reliable. Source: I work here.

Sure, mine was a tongue-in-cheek comment, but there are cost benefits of bare metal in some use cases, especially if your workload is more or less predictable.

Re: Scaling up the Prime Video audio/video monitoring service and reducing costs

#505
post #10

I'm pretty convinced that microservices are one of those things that make sense 5% of the time and the other 95% is cargo culting.

I absolutely agree, buuuut also realize we as programmers don't even have the same definition of what a microservice is. A lot of people here say...one service per team. But to me that is, or can be, a monolith. Often a team is a product line, so you have one service for that product. Is that a monolith? I don't know either, I guess. I -do- know most people who go around promoting that sweet microservice life end up…

meh

In my org in Google we average over one microservice per engineer. I'll be adding two in the next couple weeks. With the right automation setup you don't notice them any more than you do server instances.

Re: Scaling up the Prime Video audio/video monitoring service and reducing costs

#506

Earlier quoted context omitted.

I didn't miss where you mentioned it. I missed where you considered it. As in, you know, gave any thought to the practicalities involved.

You're really claiming you can read my mind to know what I have and have not considered right now, despite me bringing it up specifically. Alrighty then.

I'm simply going by what you've written here. If you have considered it, then you have not "shown your work," so to speak.

Re: Scaling up the Prime Video audio/video monitoring service and reducing costs

#508

Earlier quoted context omitted.

I agree, my intuition would put it to 1% vs. 99% (difficult to quantify of course). I haven't yet seen a project/product which would need microservice architecture for technical reasons. If you need to scale, you can just scale monoliths (perhaps serving in different roles). The use case for microservice architecture is IMHO an organizational / high level architecture driven. I've worked in a big company (20K employe…

Seems like Conway's law applies:- "Any organization that designs a system (defined broadly) will produce a design whose structure is a copy of the organization's communication structure." -- Melvin E. Conway https://en.wikipedia.org/wiki/Conway%27s_law

The organizational structure doesn't have to be reflected in the built artifact(s), though. Just look at Chrome. It has who knows how many teams working on it, but gets built into a single giant DLL (or executable, depending on your platform). And newer languages like Go and Rust make it easier to link everything into one big artifact like this.

Re: Scaling up the Prime Video audio/video monitoring service and reducing costs

#509
post #458

Earlier quoted context omitted.

I worked for a global company that maintained it's own "cloud" of VMs that we'd use for development purposes. They were entirely unusable. Opening a relatively small file in notepad could take multiple minutes. OS click and typing response times were measured in seconds. Despite wasting thousands of developer hours each year, they refused to upgrade their data center. Probably because doing so would have been a major…

Notepad? Clicking? I think I see the problem.

Mostly deployed on windows VMs, the only access was to remote in.

Typing/executing in Powershell was just as slow

Re: Scaling up the Prime Video audio/video monitoring service and reducing costs

#510

Earlier quoted context omitted.

You're really claiming you can read my mind to know what I have and have not considered right now, despite me bringing it up specifically. Alrighty then.

I'm simply going by what you've written here. If you have considered it, then you have not "shown your work," so to speak.

And if I were being graded that would matter.

As is, I've no responsibility to show you anything, and you're just making unwarranted assumptions about what I have and haven't considered, based on a pretty selective reading of what I've said.

Post reply on HN