LinuxCon + CloudOpen + ContainerCon NA 2015 has ended
Back To Schedule
Wednesday, August 19 • 2:00pm - 2:50pm
When Bad Things Happen To Good Disks AKA Disks Don't Have File Descriptors - Erik Riedel, EMC

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

This talk outlines some of the complexity challenges faced by devs (at their desks) and ops personnel (in the data centers, 6 months later) when trying to design for and then diagnose a widely distributed storage system subject to the slings & arrows of outrageous fortune. A modest sized system with 50 disks per node and 500 nodes has 25,000
disk drives; 30,000 file systems (when everything is working fine); 100 billion files; 1 million open file descriptors (when fine); 10 million hourly log messages (when fine, 1 billion when not). The layering in the Linux storage stack (sata, sas, ses, sg, sd, dm, lvm, fs, etc) is great when trying to find a creative solution to a single-node storage setup, but can be a real pain when trying to diagnose what is going wrong at these scales. We'll outline how we've attacked the problem so far, and where we still daily feel the pain.

avatar for Erik Riedel

Erik Riedel

Sr Director, Engineering, Dell EMC
Erik Riedel is Senior Director, Technology & Architecture for Dell EMC, responsible for the hardware & platform software scale-out object storage. Erik has been involved in scalable object storage and open source since graduate school. Before Dell EMC (8 yrs), Erik worked at Seagate... Read More →

Wednesday August 19, 2015 2:00pm - 2:50pm PDT

Attendees (0)