Turk Posted January 22, 2014 Share Posted January 22, 2014 My last two blog posts were about expected drive lifetimes and drive reliability. These posts were an outgrowth of the careful work that we’ve done at Backblaze to find the most cost-effective disk drives. Running a truly unlimited online backup service for only $5 per month means our cloud storage needs to be very efficient and we need to quickly figure out which drives work.Because Backblaze has a history of openness, many readers expected more details in my previous posts. They asked what drive models work best and which last the longest. Given our experience with over 25,000 drives, they asked which ones are good enough that we would buy them again. In this post, I’ll answer those questions.Drive PopulationAt the end of 2013, we had 27,134 consumer-grade drives spinning in Backblaze Storage Pods. The breakdown by brand looks like this:Hard Drives by Manufacturer Used by BackblazeAs you can see, they are mostly Seagate and Hitachi drives, with a good number of Western Digital thrown in. We don’t have enough Toshiba or Samsung drives for good statistical results.Why do we have the drives we have? Basically, we buy the least expensive drives that will work. When a new drive comes on the market that looks like it would work, and the price is good, we test a pod full and see how they perform. The new drives go through initial setup tests, a stress test, and then a couple weeks in production. (A couple of weeks is enough to fill the pod with data.) If things still look good, that drive goes on the buy list. When the price is right, we buy it.We are willing to spend a little bit more on drives that are reliable, because it costs money to replace a drive. We are not willing to spend a lot more, though.Excluded DrivesSome drives just don’t work in the Backblaze environment. We have not included them in this study. It wouldn’t be fair to call a drive “bad” if it’s just not suited for the environment it’s put into.We have some of these drives running in storage pods, but are in the process of replacing them because they aren’t reliable enough. When one drive goes bad, it takes a lot of work to get the RAID back on-line if the whole RAID is made up of unreliable drives. It’s just not worth the trouble.The drives that just don’t work in our environment are Western Digital Green 3TB drives and Seagate LP (low power) 2TB drives. Both of these drives start accumulating errors as soon as they are put into production. We think this is related to vibration. The drives do somewhat better in the new low-vibration Backblaze Storage Pod, but still not well enough.These drives are designed to be energy-efficient, and spin down aggressively when not in use. In the Backblaze environment, they spin down frequently, and then spin right back up. We think that this causes a lot of wear on the drive.Failure RatesWe measure drive reliability by looking at the annual failure rate, which is the average number of failures you can expect running one drive for a year. A failure is when we have to replace a drive in a pod.This chart has some more details that don’t show up in the pretty chart, including the number of drives of each model that we have, and how old the drives are:Number of Hard Drives by Model at BackblazeThe following sections focus on different aspects of these results.1.5TB Seagate DrivesThe Backblaze team has been happy with Seagate Barracuda LP 1.5TB drives. We’ve been running them for a long time – their average age is pushing 4 years. Their overall failure rate isn’t great, but it’s not terrible either.The non-LP 7200 RPM drives have been consistently unreliable. Their failure rate is high, especially as they’re getting older.1.5 TB Seagate Drives Used by BackblazeThe Seagate Barracuda Green 1.5TB drive, though, has not been doing well. We got them from Seagate as warranty replacements for the older drives, and these new drives are dropping like flies. Their average age shows 0.8 years, but since these are warranty replacements, we believe that they are refurbished drives that were returned by other customers and erased, so they already had some usage when we got them.Bigger Seagate DrivesThe bigger Seagate drives have continued the tradition of the 1.5Tb drives: they’re solid workhorses, but there is a constant attrition as they wear out.The good pricing on Seagate drives along with the consistent, but not great, performance is why we have a lot of them.Hitachi DrivesIf the price were right, we would be buying nothing but Hitachi drives. They have been rock solid, and have had a remarkably low failure rate.Back at the beginning of Backblaze, we bought Western Digital 1.0TB drives, and that was a really good choice. Even after over 4 years of use, the ones we still have are going strong.We wish we had more of the Western Digital Red 3TB drives (WD30EFRX). They’ve also been really good, but they came after we already had a bunch of the Seagate 3TB drives, and when they came out their price was higher.What About Drives That Don’t Fail Completely?Another issue when running a big data center is how much personal attention each drive needs. When a drive has a problem, but doesn’t fail completely, it still creates work. Sometimes automated recovery can fix this, but sometimes a RAID array needs that personal touch to get it running again.Each storage pod runs a number of RAID arrays. Each array stores data reliably by spreading data across many drives. If one drive fails, the data can still be obtained from the others. Sometimes, a drive may “pop out” of a RAID array but still seem good, so after checking that its data is intact and it’s working, it gets put back in the RAID to continue operation. Other times a drive may stop responding completely and look like it’s gone, but it can be reset and continue running.Measuring the time spent in a “trouble” state like this is a measure of how much work a drive creates. Once again, Hitachi wins. Hitachi drives get “four nines” of untroubled operation time, while the other brands just get “two nines”.Untroubled Operation of Drives by Manufacturer used at BackblazeDrive Lifetime by BrandThe chart below shows the cumulative survival rate for each brand. Month by month, how many of the drives are still alive?Hitachi does really well. There is an initial die-off of Western Digital drives, and then they are nice and stable. The Seagate drives start strong, but die off at a consistently higher rate, with a burst of deaths near the 20-month mark.Having said that, you’ll notice that even after 3 years, by far most of the drives are still operating.What Drives Is Backblaze Buying Now?We are focusing on 4TB drives for new pods. For these, our current favorite is the Seagate Desktop HDD.15 (ST4000DM000). We’ll have to keep an eye on them, though. Historically, Seagate drives have performed well at first, and then had higher failure rates later.Our other favorite is the Western Digital 3TB Red (WD30EFRX).We still have to buy smaller drives as replacements for older pods where drives fail. The drives we absolutely won’t buy are Western Digital 3TB Green drives and Seagate 2TB LP drives.A year and a half ago, Western Digital acquired the Hitachi disk drive business. Will Hitachi drives continue their excellent performance? Will Western Digital bring some of the Hitachi reliability into their consumer-grade drives?At Backblaze, we will continue to monitor and share the performance of a wide variety of disk drive models. What has your experience been?Please see the source for the full tables:http://blog.backblaze.com/2014/01/21/what-hard-drive-should-i-buy Quote Link to comment Share on other sites More sharing options...
mike.mt Posted January 22, 2014 Share Posted January 22, 2014 A very interesting and informative post for all,users concerned about reliable data-management on a small to large scale.. Thank you Quote Link to comment Share on other sites More sharing options...
truemate Posted January 22, 2014 Share Posted January 22, 2014 hitachi is awesome Quote Link to comment Share on other sites More sharing options...
zonar2 Posted January 22, 2014 Share Posted January 22, 2014 interesting, thanks! Quote Link to comment Share on other sites More sharing options...
robo Posted January 22, 2014 Share Posted January 22, 2014 Great information. thank you very much Quote Link to comment Share on other sites More sharing options...
212eta Posted January 22, 2014 Share Posted January 22, 2014 I've used Hitachi HDs for about one year.So far, so good... :yes: Quote Link to comment Share on other sites More sharing options...
percuma88 Posted January 22, 2014 Share Posted January 22, 2014 Since WD acquired Hitachi disk drive business why don't they simply rebranding Hitachi HDD with WD label?This will make customers (me) happy with their money and new HDD, :D Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.