I wonder if they considered https://tigerbeetle.com
Migrating Uber's ledger data from DynamoDB to LedgerStore
11–20 of 345 posts
Re: Migrating Uber's ledger data from DynamoDB to LedgerStore
#12> Uber migrated all its payment transaction data from DynamoDB and blob storage into a new long-term solution No way they have 1 trillion transactions right?
1T "records". Any given transaction can have N records. I'm assuming this includes Uber Eats as well.
Still, they have 10B rides in 2023 including Eats, say 75-100B since inception. What would be a record such that each transaction needs 10-15 on average?
Re: Migrating Uber's ledger data from DynamoDB to LedgerStore
#13Original story looks to be https://www.uber.com/en-AU/blog/migrating-from-dynamodb-to-l...
Re: Migrating Uber's ledger data from DynamoDB to LedgerStore
#14So did the engineers who proposed this get some kind of bonus considering how much money they saved the company?
Re: Migrating Uber's ledger data from DynamoDB to LedgerStore
#15The original[1][2] articles are a better read IMO. The link is just a summary of the two with added spelling and grammatical errors that materially impact the meaning.
1. https://www.uber.com/blog/how-ledgerstore-supports-trillions...
2. https://www.uber.com/blog/migrating-from-dynamodb-to-ledgers...
Re: Migrating Uber's ledger data from DynamoDB to LedgerStore
#16I’m working on a specialized data store[1] that would be perfect for this kind of use case (large “cold” storage with indexing). But I’m having trouble finding potential customers. I’ve tried Google search ads but got 99% spam and 1% potential investors, but 0% potential customers. If anybody has any ideas I’m all ears. 1. https://www.haystackdb.dev/
You need to be doing enterprise sales not marketing. There is a lot of advice here and in general on that but you definitely need to be making calls with that type of business.
Re: Migrating Uber's ledger data from DynamoDB to LedgerStore
#17I’m working on a specialized data store[1] that would be perfect for this kind of use case (large “cold” storage with indexing). But I’m having trouble finding potential customers. I’ve tried Google search ads but got 99% spam and 1% potential investors, but 0% potential customers. If anybody has any ideas I’m all ears. 1. https://www.haystackdb.dev/
Maybe find more articles like the above
try connect to the respective people at said teams via LinkedIn and ask feedback
Re: Migrating Uber's ledger data from DynamoDB to LedgerStore
#18I wonder if 1.7 petabytes of data (1T indexed records) could fit on a single (very) beefy baremetal server for under a couple thousand dollars a month, served by SQLite.
Like this: https://use.expensify.com/blog/scaling-sqlite-to-4m-qps-on-a...
Re: Migrating Uber's ledger data from DynamoDB to LedgerStore
#19Earlier quoted context omitted.
1T "records". Any given transaction can have N records. I'm assuming this includes Uber Eats as well.
Still, they have 10B rides in 2023 including Eats, say 75-100B since inception. What would be a record such that each transaction needs 10-15 on average?
Consider it might be quite de-normalized as typical at scale.
Some records for the customer, some for the driver, some for the restaurant...
Re: Migrating Uber's ledger data from DynamoDB to LedgerStore
#20I’m working on a specialized data store[1] that would be perfect for this kind of use case (large “cold” storage with indexing). But I’m having trouble finding potential customers. I’ve tried Google search ads but got 99% spam and 1% potential investors, but 0% potential customers. If anybody has any ideas I’m all ears. 1. https://www.haystackdb.dev/
With a disclaimer that I have no formal nor practical background in marketing, here are some ideas:
1. It is a bit unclear to me when I would use Haystack. The main advantage seems to be cost cutting. It would be nice to see some realized examples of this.
2. When competing for price, you may look like the cheap, and thereby untrusted alternative. There is a risky business paradox here, for which I am sure a fellow HN poster will supply the name: you charge less, therefore you make less, and you will not be able to sustain the service, making me not want to spend money.
3. Have you tried looking for companies that may actually need this solution? Have you tried contacting them directly?