Earlier quoted context omitted.
It's a pretty bad database that can't queue up enough reads to keep the drive constantly active during a full-table scan.
It's a throughput problem, not an activity problem. Normally, since the rows are a fixed size the dbms will lay them out sequentially on disk. So, when the database reads from disk unless you read every column in the row, the dbms has to skip over data. This is kind of a high level picture, but hopefully it illustrates the point. Nearly all of the tick (>4GB/day) databases I've used aren't laid row oriented.
Samsung ships the world's highest capacity SSD, with 15TB of storage
71–80 of 147 posts
Re: Samsung ships the world's highest capacity SSD, with 15TB of storage
#72Earlier quoted context omitted.
I thought RAID and SSD were a terrible combination. As if both drives do exactly the same writes at the same time, chances are they will fail at the same time. Plus most RAID controllers don't support TRIM. Has the thinking changed?
> I thought RAID and SSD were a terrible combination Well there are different RAID settings. My product is an indexing engine (indexes Git repositories) and I've personally found RAID 0 reduces indexing time by about 30% compared to a single drive. I have a machine that has 4 SSDs running RAID 0 and I've found the performance gain after 3 SSDs is negligible. It seems like 3 SSDs running RAID 0 is the best combination…
Re: Samsung ships the world's highest capacity SSD, with 15TB of storage
#73Earlier quoted context omitted.
Our brain thinks linear, technology grows exponentially. http://www.kurzweilai.net/the-law-of-accelerating-returns
Kurzweil also claims, as the capstone final paragraph in this piece, that human life expectancy is on an exponential curve, which is false. Not just a little wrong, it's all the way wrong, and intentionally misleading, there's no possible way he doesn't know it's false. It's very easy to check the basic facts: https://en.m.wikipedia.org/wiki/Life_expectancy . Lifespan for people who live past 20 (discounting infant m…
I disagree however that nobody alive today will live "forever". The technology that might allow us to fix aging is on an exponential curve, look for example at the cost of genome sequencing. So the time is ripe for some breakthrough results in aging research that actually address some causes of aging.
[1] https://www.newscientist.com/article/dn25458-blood-of-worlds...
Re: Samsung ships the world's highest capacity SSD, with 15TB of storage
#74Earlier quoted context omitted.
That sounds perfectly reasonable, and 20 years ago I'd have said the same thing. It's even fairly likely that I did say it. You know where this is going, right? I was a SysAdmin at the time and one of the things I was responsible for was Oracle Financials. It was at the core of everything that mattered at that company -- and I was absolutely convinced that short of a water balloon fight in the machine room, my raid c…
I wonder, for such mission critical data a good strategy would be to start rotating out old drives at set periods. Maybe replace one drive of your RAID5 every 6 months, not matter what the health. Once you've replaced all the drives, they will all be staggered in age by 6 months. Hopefully then the chances of multiple failures is greatly reduced.
Re: Samsung ships the world's highest capacity SSD, with 15TB of storage
#75The 15.36TB PM1633a drive supports one full drive write per day, which means 15.36TB of data can be written every day on a single drive without failure over its five-year warranty. In other words, assuming good wear leveling, each bit can only be rewritten ~2K times, which is actually quite low for endurance... the capacity is high and they're using that to hide the fact that it's low, but if this was e.g. SLC flash…
They're not guaranteeing failure in 5 years, but are pretty sure it won't fail. If "pretty sure" is 98%, then that's 100K (or something like it, probability maths is hard).
Re: Samsung ships the world's highest capacity SSD, with 15TB of storage
#76Earlier quoted context omitted.
I thought RAID and SSD were a terrible combination. As if both drives do exactly the same writes at the same time, chances are they will fail at the same time. Plus most RAID controllers don't support TRIM. Has the thinking changed?
Yeah, the statistical chance of the same thing happening on both drives is the same, but the chance of it happening at the same time is pretty low.
Re: Samsung ships the world's highest capacity SSD, with 15TB of storage
#77Earlier quoted context omitted.
You're asking for 2 major tech steppings in a single product. We don't even have many mass market NVMe drives yet, and that aside, they're undoubtedly pushing the limits of their existing controller tech just to handle the capacity. Has NVMe seen much enterprise adoption yet? No surprise they chose an interface to match their intended customers' existing product lines
We put a couple of Intel 750s in our primary DB server and so many of our issues just went away instantly. Reading at 2GB/s is amazing. On a 10gb network, our network backups now happen at 1+GB/s. Of course we optimize our DB queries as much as possible but sometimes, you just hit a brick wall and can't speed things up because of how the data is structured. Instead of spending 100 developer/dbadmin hours on reorganiz…
Re: Samsung ships the world's highest capacity SSD, with 15TB of storage
#78The 15.36TB PM1633a drive supports one full drive write per day, which means 15.36TB of data can be written every day on a single drive without failure over its five-year warranty. In other words, assuming good wear leveling, each bit can only be rewritten ~2K times, which is actually quite low for endurance... the capacity is high and they're using that to hide the fact that it's low, but if this was e.g. SLC flash…
Given how SSDs work, this is actually pretty good reliability. No one is going to be writing the full disk of 15 TB of data every day.
Re: Samsung ships the world's highest capacity SSD, with 15TB of storage
#79On Amazon UK, the highest capacity Samsung SSD I can find is 2TB for 620GBP. So I am wondering when this 15TB we actually hit stores and what's the sweet spot price wise between 1 & 15TB.
http://www.anandtech.com/show/9652/samsung-details-3rd-gen-v...