Live data from Hacker News

“Fashion Is Hard. PostgreSQL Is Easy” [video]

tech.zalando.com

81–90 of 140 posts

Re: “Fashion Is Hard. PostgreSQL Is Easy” [video]

#81

Earlier quoted context omitted.

What is a good space to look at when you get write heavy data to the point of streaming?

The filesystem. Ok, that not completely serious, but almost completely.

Could work dump the incoming steam to disk in some sensibel text format and have an asynchronous queue process the data into the database.

Re: “Fashion Is Hard. PostgreSQL Is Easy” [video]

#82

I love PostgreSQL. But for a personal project I went with MongoDB, because my data set was a perfect match for mongo's design. Now I love mongo too, I'm amazed with how easy it has been to maintain 100% uptime on comodity hardware (one server is literally in a room in my apartment) through all the random server downtimes, upgrades, migrations, etc. And now I have more ideas for some personal projects, and they would…

If mongo impresses you, you should check out rethinkdb: https://github.com/rethinkdb/rethinkdb

Re: “Fashion Is Hard. PostgreSQL Is Easy” [video]

#83

I love PostgreSQL. But for a personal project I went with MongoDB, because my data set was a perfect match for mongo's design. Now I love mongo too, I'm amazed with how easy it has been to maintain 100% uptime on comodity hardware (one server is literally in a room in my apartment) through all the random server downtimes, upgrades, migrations, etc. And now I have more ideas for some personal projects, and they would…

do take a look if you can leverage jsonb datastructure of postgres - you get 80% of the power of mongo and all the advantages of postgres.

https://www.compose.io/articles/is-postgresql-your-next-json...

Re: “Fashion Is Hard. PostgreSQL Is Easy” [video]

#84
post #39

I had a job interview at Zalando a while ago, and apart from the huge bunch of bananas at the entrance to the developer's den, the one thing I remember most about was the fact that apparently they're using stored procedures for basically any database transaction. Which is probably a more unorthodox use of databases these days, at least for Postgres (I've heard it was more common for SQL Server and I once had the ques…

Isn't That how your supposed to do it using Sprocs is more time consuming but it does have several advantages from security and performance.

Re: “Fashion Is Hard. PostgreSQL Is Easy” [video]

#85

Earlier quoted context omitted.

That's probably the best way of looking at it. PostgreSQL is generally going to be the best solution for 90% of your data, short of having a subset that's write heavy to the point of streaming.

What is a good space to look at when you get write heavy data to the point of streaming?

It depends on what your needs are. If you just have a lot of data that is coming in quickly but you aren't doing constant analysis on it, you can still use Postgres. Switch to large batch writes for getting the data into the database to reduce the transaction overhead and look at using a Master-Slave replica setup. The 9.4/9.5 log replication features worked really well last time I used for them handling streaming data. We had a write master and a read slave and optimized accordingly. It worked pretty well once we got the log replication tuned accordingly.

Re: “Fashion Is Hard. PostgreSQL Is Easy” [video]

#86

Earlier quoted context omitted.

The filesystem. Ok, that not completely serious, but almost completely.

Could work dump the incoming steam to disk in some sensibel text format and have an asynchronous queue process the data into the database.

At that point may be something like Kafka starts looking attractive

Re: “Fashion Is Hard. PostgreSQL Is Easy” [video]

#87
post #39

I had a job interview at Zalando a while ago, and apart from the huge bunch of bananas at the entrance to the developer's den, the one thing I remember most about was the fact that apparently they're using stored procedures for basically any database transaction. Which is probably a more unorthodox use of databases these days, at least for Postgres (I've heard it was more common for SQL Server and I once had the ques…

Isn't That how your supposed to do it using Sprocs is more time consuming but it does have several advantages from security and performance.

There's no way you're "supposed to" do it. There are tradeoffs and you pick the approach you like most given those tradeoffs.

Re: “Fashion Is Hard. PostgreSQL Is Easy” [video]

#88
post #75
post #65

Earlier quoted context omitted.

Ping isn't a CLI, its a single command that expects no further input. A database shell is more like bash than ping. And Ctrl-C does not exit out of bash.

[deleted]

Ctrl-C conventionally does not kill shell-like things. This is, technically, of course because of cooperation of those shell-like things and their handling of SIGINT, but that's not actually relevant.

The following things (off the top of my head, and quickly verified) all handle Ctrl-C so that it kills only the current command and not the containing process:

bash, zsh, csh, ksh, mail, gnuplot, gdb, psql, vsql, python (interactive), ghci

While I object to captive user interfaces in general, if you're going to have one then handling ctrl-c inside it is the right thing to do.

Re: “Fashion Is Hard. PostgreSQL Is Easy” [video]

#89
post #59

Earlier quoted context omitted.

It's quite common for startups to have 1 or 2 sexy (and well-enough engineered) projects involving your favorite technology X, to run up the flagpole at conferences or in job ads, etc. But like as not, 80% of what they do (and of what you'll be doing as a developer there) is the same half-baked, post-"blitzkrieg" mop-up work you'll be doing pretty much anywhere else.

They were pretty straight about that: Java, ExtJS, stored procedures. Not exactly candidates for the sexiest development tools alive. They were pretty honest about that, no "this will look awesome on your resume" tomfoolery. It was a pretty great interview, and I almost took them up on their offer. So don't get me wrong, I neither want to praise their stack nor put it down, I just thought that their ubiquitous use of…

Alles klar. Thanks for clarifying.

Re: “Fashion Is Hard. PostgreSQL Is Easy” [video]

#90

PostgreSQL is great, but I've gone back to MySQL because of the ease of which I can setup replication (which I like to use when possible in addition to automated/periodic backups).

I'd love a honest, MODERN comparison of both systems. Sometimes I feel like the cargoculting with PostgreSQL is as bad now as it was with MySQL 10 years ago and MySQL is being badmouthed for mistakes from the MyISAM age.

MySQL has some features that I'm really missing in PostgreSQL, like more flexible compression, and batched index writeout.

Post reply on HN