Live data from Hacker News

What the hell have you built

wthhyb.sacha.house

11–20 of 239 posts

Re: What the hell have you built

#11
post #3

s/postgres/sqlite/g

This. So much this. Of course, at one point you start wanting to do queues, and concurrent jobs, and not even WAL mode and a single writer approach can cut it, but if you've reached that point then usually you a) are in that "this is a good problem to have" scalability curve, and b) you can just switch to Postgres.

I've built pretty scalable things using nothing but Python, Celery and Postgres (that usually started as asyncio queues and sqlite).

Re: What the hell have you built

#12
Oh my word Riak - I haven't seen that DB mentioned for years!

I totally get the point it makes. I remember many years ago we announced SocketStream at a HackerNews meet-up and it went straight to #1. The traffic was incredible but none of us were DevOps pros so I ended up restarting the Node.js process manually via SSH from a pub in London every time the Node.js process crashed.

If only I'd known about upstart on Ubuntu then I'd have saved some trouble for that night at least.

I think the other thing is worrying about SPOF and knowing how to respond if services go down for any reason (e.g. server runs out of disk space - perhaps log rotation hasn't been setup, or has a hardware failure of some kind, or the data center has an outage - I remember Linode would have a few in their London datacenter that just happened to occur at the worst possible time).

If you're building a side project I can see the appeal of not going overboard and setting up a Kubernetes cluster from the get-go, but when it is things that are more serious and critical (like digital infrastructure for supporting car services like remotely turning on climate controls in a car), then you design the system like your life depends on it.

Re: What the hell have you built

#13
post #6

Nah, postgres is overhyped, MariaDB is enough and recently: https://mariadb.org/mariadb-vs-postgresql-understanding-the-... >

I love this comment because it misses the point in exactly the way the article talks about.

But what if all 12 users log in 100 times during the same second of the day?

Re: What the hell have you built

#16

Heh Once you have a service that has users and costs actual money, while you don’t need to make it a spaghetti of 100 software products, you need a bit of redundancy at each layer — backend, frontend, databases, background jobs — so that you don’t end up in a catastrophic failure mode each time some piece of software decides to barf.

uh, maybe you only have the issue that you need redundancies because you have so many pieces of software that can barf?

I mean it will happen regardless just from the side effects of complexity. With a simpler system you can at least save on maintenance and overhead.

Re: What the hell have you built

#17
post #7

I feel like sometimes it’s a form of procrastination. There are things we don’t want to do (talk to costumers, investors, legal, etc.), so instead we do the fun things (fun for engineers). It’s a convenient arrangement because we can easily convince ourselves and others that we’re actually being productive (we’re not, we’re just spinning wheels).

It's the natural evolution to becoming a fun addict.

Unless you actively push yourself to do the uncomfortable work every day, you will always slowly deteriorate and you will run into huge issues in the future that could've been avoided.

And that doesn't just apply to software.

Re: What the hell have you built

#20
Are you doing software for money? Because not having Kubernetes in the project will stop you from receiving money. Someone please create with one of these smart AI tools the ultimate killer app: Kubernetes+crypto+AI+blockchain+Angular+Redux+Azure (Working only in Chrome browser).
Post reply on HN