Migrating Uber's ledger data from DynamoDB to LedgerStore • Hacker News Board

Re: Migrating Uber's ledger data from DynamoDB to LedgerStore

#341

Post by yazaddaruvala » Fri, May 24, 2024, 7:12 AM UTC

cced wrote: post #285

yazaddaruvala wrote: post #277

Reading the article it’s clear pretty quickly that Uber was using DynamoDB poorly. It seems they need strong consistency for certain CUJs and then a lot of data warehousing for historical transactions. It’s strange to me that they didn’t first convert their 2 table DynamoDB architecture into DynamoDB and Redshift architecture or similar. This is a pretty common pattern.

Can you post some references to this pattern?

Mostly just look into “archiving into data warehouse” type patterns.

You can also look into “realtime data warehousing”.

Meanwhile, it’s so common, AWS built it into their product.

https://aws.amazon.com/about-aws/whats-new/2023/11/amazon-dy...

Re: Migrating Uber's ledger data from DynamoDB to LedgerStore

#342

Post by beanjuiceII » Fri, May 24, 2024, 1:05 PM UTC

barfbagginus wrote: post #223

vsnf wrote: post #178

Earlier quoted context omitted.

While your broader point is well taken, isn’t Uber a famous Go shop?

Lol I was not being on topic or constructive - just repeating the meme that rust is synonymous with "blazing fast", because of endless statements to the effect of "rust is blazing fast," or "if you want blazing fast code, use rust," or the endless blazing fast rust libraries: https://duckduckgo.com/?q=blazing+fast+rust Now I'm not an expert in either rust or go. But I know my deductive meme logic: 1. Uber's solution…

i thought it was fun :D

Re: Migrating Uber's ledger data from DynamoDB to LedgerStore

#343

Post by omeid2 » Fri, May 24, 2024, 1:20 PM UTC

Retric wrote: post #340

omeid2 wrote: post #339

Earlier quoted context omitted.

Why are these companies going so far as purchasing equipment for 3rd parties instead of doing it in house?

Several reasons, both from Apples perspective and the supplier’s. Suppliers don’t want to purchase a bunch of equipment and scale their manufacturing capacity for a contract that could go away at any time. So when Apple shows up they are going to price that risk in to their bid or sometimes just outright say no. However, by Apple buying that equipment those risks suddenly get reduced. Apple on the other hand has huge…

That is a long way of saying "economy of scale".

Re: Migrating Uber's ledger data from DynamoDB to LedgerStore

#344

Post by TheNewsIsHere » Fri, May 24, 2024, 2:54 PM UTC

admax88qqq wrote: post #337

TheNewsIsHere wrote: post #209

Earlier quoted context omitted.

You could potentially take it as an investment loss for tax purposes. Whether that’s proper depends greatly on the circumstances surrounding how the money was accounted for and spent.

That's not how taxes work. Investing $1 doesn't count as a loss for tax purposes.

I did not claim that investing $1 is a tax loss.

Re: Migrating Uber's ledger data from DynamoDB to LedgerStore

#345

Post by [deleted] » Fri, Jun 07, 2024, 3:48 PM UTC

xyst wrote: post #185

Uber must have picked up some Google rejects. This type of homegrown project was seen at Google all the time. Usually to aim for a significant promotion. “Designed and built homegrown system to save $Xm! Give me promo, bro?” Just so happened to ignore that it took X+Y additional to build. Also it will probably be going to the G graveyard in a few years.

[deleted]