Kinda makes you wonder why you need cloud for anything besides remote encrypted backups if you can run all that on 12GB
what about failover story if server dies? PG failover setup is complicated, and cloud infra handles this for you.
Indexing 100M vectors in 20 minutes on PostgreSQL with 12GB RAM
11–20 of 27 posts
Re: Indexing 100M vectors in 20 minutes on PostgreSQL with 12GB RAM
#12Earlier quoted context omitted.
what about failover story if server dies? PG failover setup is complicated, and cloud infra handles this for you.
(Genuine question) What's your current plan for when your cloud provider goes offline? Do you have a failover story, or it a case of "wait for them to come back online"?
Re: Indexing 100M vectors in 20 minutes on PostgreSQL with 12GB RAM
#13Kinda makes you wonder why you need cloud for anything besides remote encrypted backups if you can run all that on 12GB
what about failover story if server dies? PG failover setup is complicated, and cloud infra handles this for you.
Not every use case requires 100% uptime
Re: Indexing 100M vectors in 20 minutes on PostgreSQL with 12GB RAM
#14Earlier quoted context omitted.
Because getting any hardware out of infra-team on premise is utterly miserable, across the board.
That's not the only alternative. Rent your VPS and add in extra volumes for like $10 per 100GB.
Netcup is under-rated but there are also other providers too at lowendbox/lowendtalk and I am interested to try out hetzner too sometime.
Re: Indexing 100M vectors in 20 minutes on PostgreSQL with 12GB RAM
#15Kinda makes you wonder why you need cloud for anything besides remote encrypted backups if you can run all that on 12GB
what about failover story if server dies? PG failover setup is complicated, and cloud infra handles this for you.
And yes, i agree, the PG failover setup (and especially dealing with a failure afterwards, to restore the ex-master is beyond infuriating).
But its not pay 10x the amount, while eating easily 10x performance infuriating :)
Re: Indexing 100M vectors in 20 minutes on PostgreSQL with 12GB RAM
#16Earlier quoted context omitted.
That's not the only alternative. Rent your VPS and add in extra volumes for like $10 per 100GB.
Funny thing but netcup has $10 per 1 TB Netcup is under-rated but there are also other providers too at lowendbox/lowendtalk and I am interested to try out hetzner too sometime.
Not counting the fact that Netcup is raided (also Netcup is limited to 8TB on a VPS).
That is like 4.7 Euro /TB. That is like 4$/TB. 6 Euro / TB in a raid 5 setup.
I do not understand why they are not using this new pricing model on their older servers. There the best you can get is like 10 Euro /TB (for the single 15TB U.2).
Re: Indexing 100M vectors in 20 minutes on PostgreSQL with 12GB RAM
#17Earlier quoted context omitted.
what about failover story if server dies? PG failover setup is complicated, and cloud infra handles this for you.
(Genuine question) What's your current plan for when your cloud provider goes offline? Do you have a failover story, or it a case of "wait for them to come back online"?
But realistically, I believe major clouds (google, aws) likely has more robust org and infra for recovery than I can built and maintain.
Re: Indexing 100M vectors in 20 minutes on PostgreSQL with 12GB RAM
#18Earlier quoted context omitted.
what about failover story if server dies? PG failover setup is complicated, and cloud infra handles this for you.
What are you willing to pay for cloud-native failover? Not every use case requires 100% uptime
Re: Indexing 100M vectors in 20 minutes on PostgreSQL with 12GB RAM
#19Imagine paying $250+/mo for 32GB of RAM and 4 VCPUs. No wonder Amazon is swimming in cash, the markup on this is bonkers.
Re: Indexing 100M vectors in 20 minutes on PostgreSQL with 12GB RAM
#20> $272 monthly + GPU cost Imagine paying $250+/mo for 32GB of RAM and 4 VCPUs. No wonder Amazon is swimming in cash, the markup on this is bonkers.
https://www.latitude.sh/pricing/c2-small-x86?gen=gen-2
hetzner doesn't even have specs this low from what i can tell!
https://www.hetzner.com/dedicated-rootserver/#cores_threads_...