271–280 of 378 posts
SQLite all over the place – it's great having a super portable DB format for quick little hits. There's nothing quite like sending a DB as an email attachment.
In the microsoft world SQL CE 4 is pretty nice for doing the same sort of thing.
MySQL, but I want to move us over to PostgreSQL soon; we are stuck with MySQL because we use WordPress for the public facing pages so my cofounder can use it as a sort of "CMS" without my needing to build any of that...
First class support for Postgres.
Earlier quoted context omitted.
Without going too much into specifics and picking on individual databases (which I could do, boy do I have the scars...) When you hit a certain traffic level, scalability, latency and robustness become far more important than single-node ops/s. I need to be able to add nodes and repair failed nodes while under load--I need the 99.9% latency mark to stay ~100ms while doing so. I don't really care how many bajillions o…
For everything you've said about Riak re: stability and happy scalability, that's exactly why I was excited to include it in this test. I would like to prevent myself/my team from acquiring too many of those scars, so please elaborate on what caused them ;) Especially if those scars came from Cassandra or HBase! The test hasn't been a "concocted scenario", it's measuring the performance[1] of a prototype implementati…
Btw, b/c I can totally see why you'd read it that way, that particular barb wasn't directed at you, more directed at some of the public benchmarks touted by (non-distributed) NoSQL database systems.
Re: cassandra, please see my reply to the sibling on this thread.
Also, feel free to email me jamie@bu.mp if I can answer any specific questions for you with things we ran into with various database systems.
Earlier quoted context omitted.
Without going too much into specifics and picking on individual databases (which I could do, boy do I have the scars...) When you hit a certain traffic level, scalability, latency and robustness become far more important than single-node ops/s. I need to be able to add nodes and repair failed nodes while under load--I need the 99.9% latency mark to stay ~100ms while doing so. I don't really care how many bajillions o…
Was your experience with Cassandra different? Happy at server 10 and 100, that is?
We got some very frank advice from some people whose opinions on databases I take very seriously to stay away, including reports from within FB.
Having said that, I cannot claim to have firsthand proven or disproven anything about Cassandra.
Earlier quoted context omitted.
Why do you use pgsql over mysql? I've used mysql a lot, and pgsql a little. I can't tell the difference, other than pgsql being slower and having less support. Some people swear by it, so I'm curious what I am missing.
When I first started doing serious DB work (back in the PostgreSQL 7.x/MySQL 3.x days), there were some show-stopper flaws in MySQL that made it a non-starter for my scenario. (In particular, you couldn't self-join a table, and "February 31" was treated as a valid date.) In performance terms, granted, pg was a bit of a dog in those days, but it outperformed MySQL in every benchmark I could throw at it, with minimal t…
It also didn't support transactions where postgres did. Essentially mysql was a dumb datastore with sql interface, whereas postgres was a database.
That's changed now, but postgres is still a head in reliability(shit just doesn't break) and feature-set. and I hear in speed these days. But I no longer care about speed these days, as an SSD backed postgres handles anything I can possibly throw at it.
Earlier quoted context omitted.
Such as? Really, I'd like to know the reason for why a company might choose Oracle.
Oracle costs at least twice as much as any other databases. Yet companies still buy it. Why do people buy things that cost twice as much? Hint: it's better. Forget price for a moment, any feelings you might have for Larry Ellison, the good/evil nature of the company, or whatever. Consider the software itself. Many people aren't all that familiar with the basic things a database is supposed to do. The list is large. I…
Are these good things?
We can also reverse this argument: if you're using Oracle, you will never have a use for 99% of its features.
Earlier quoted context omitted.
When I first started doing serious DB work (back in the PostgreSQL 7.x/MySQL 3.x days), there were some show-stopper flaws in MySQL that made it a non-starter for my scenario. (In particular, you couldn't self-join a table, and "February 31" was treated as a valid date.) In performance terms, granted, pg was a bit of a dog in those days, but it outperformed MySQL in every benchmark I could throw at it, with minimal t…
I'll second this. For the longest time mysql was the quickest way on the web to lose your data. As in corrupt databases. It also didn't support transactions where postgres did. Essentially mysql was a dumb datastore with sql interface, whereas postgres was a database. That's changed now, but postgres is still a head in reliability(shit just doesn't break) and feature-set. and I hear in speed these days. But I no long…
At present, it looks like the best choice is the forthcoming Intel 710 series drives, but if you need an SSD now, their 320 series, the Sandforce controller based drives with supercaps (like the OCZ Vertex Pro models, though I wouldn't touch those with a competitor's database), or a FusionIO card are the only remotely safe options.
Riak! We're ( http://bu.mp ) using more Riak every day. So far so good.
Earlier quoted context omitted.
If you can use SQLlite, you probably didn't need a real database. So the use cases overlap a bit with flat-files and JSON.
The JSON flat file sounds like variable length records where length is determined by parsing each record with global reader/writer locking? It's like public storage where you have to sift through everyone else's crap to get to yours, every item is stored in a bulk cargo box and only one customer gets to store their stuff at a time. If you're interested in db internals, here's a few algorithms that MySQL uses. Note th…
Something like
user_id=int(request.GET['id'])
data_type=int(request.GET['id'])
json_file="{0}-{1}-chart_data.json".format(user_id,data_type)
#get the file, decode, etc.
Thanks, I'll check out the MySQL thing, but I'm not actually intending to build my own database.