Ceph: a scalable, high-performance distributed file system

Keywords

Computer science, Metadata, File system, Distributed File System, Scalability

References

• Managing Scalability in Object Storage Systems for HPC Linux ClustersBrent Welch, Garth A. Gibson — 2004
• A next-generation parallel file system for Linux cluster.Robert Latham, Nancy E. Miller, Randy Ross — 2004
• The Design and Implementation of AQuA: An Adaptive Quality of Service Aware Object-Based Storage DeviceJoel C. Wu, Scott Brandt — 2006
• Dynamic Metadata Management for Petabyte-Scale File SystemsSimone Weil, K.T. Pollack, Scott Brandt — 2004
• The HP AutoRAID hierarchical storage systemJohn Wilkes, Richard Golding, Carl Staelin — 1995
• IBM Storage Tank - A heterogeneous scalable SAN file systemJ. Menon, David Pease, Robert M. Rees — 2003
• The Vesta parallel file systemPeter Corbett, Dror G. Feitelson — 1996
• Replication in the harp file systemBarbara Liskov, Sanjay Ghemawat, Robert Gruber — 1991
• A principle for resilient sharing of distributed resourcesPeter A. Alsberg, John Day — 1976
• OceanStore: an architecture for global-scale persistent storageJohn Kubiatowicz, David Bindel, Yan Chen — 2000
• FAB: building distributed enterprise disk arrays from commodity componentsYasushi Saitō, Svend Frølund, Alistair Veitch — 2004
• CRUSH: Controlled, Scalable, Decentralized Placement of Replicated DataSage A. Weil, Scott Brandt, Ethan L. Miller — 2006
• Secure capabilities for a petabyte-scale object-based distributed file systemChristopher Olson, Ethan L. Miller — 2005
• Scalable security for large, high performance storage systemsAndrew W. Leung, Ethan L. Miller — 2006
• The Google file systemSanjay Ghemawat, Howard Gobioff, Shun-Tak A. Leung — 2003
• A Self-Organizing Storage Cluster for Parallel Data-Intensive ApplicationsHong Tang, A. Gulbeden, Jingyu Zhou — 2004
• D-SPTF: decentralized request distribution in brick-based storage systemsChristopher R. Lumb, Richard Golding — 2004
• Replication under scalable hashing: a family of algorithms for scalable decentralized data distributionR.J. Honicky, Ethan L. Miller — 2004
• zFS - a scalable distributed file system using object disksOhad Rodeh, Avi Teperman — 2003
• A cost-effective, high-bandwidth storage architectureGarth A. Gibson, David F. Nagle, Khalil Amiri — 1998

Cited by

• Design and Implementation of an OSD System and Prefetching ModelsRiyaz Shiraguppi — 2008
• HYDRAstor: A Scalable Secondary StorageCezary Dubnicki, Leszek Gryz, Lukasz Heldt — 2009
• Providing Flexible File-Level Data Filtering for Big Data AnalyticsLei Xu, Ziling Huang, Hong Jiang — 2014
• Data Analysis ChallengesD. Meiron, S. Cazares, P. Dimotakis — 2008
• Freiheitsgrade beim Einsatz Verteilter DisksB. Lemke — 2008
• VSFS: A Versatile Searchable File System for HPC AnalyticsLei Xu, Ziling Huang, Hong Jiang — 2013
• Diagnosing Performance Problems in Parallel File SystemsMichael P. Kasick — 2009
• Active Storage and SSD Caching in an Object Storage EnvironmentMichael T. Runde — 2012
• Virtualization services: scalable methods for virtualizing multicore systemsKarsten Schwan, Himanshu Raj — 2008
• Resource management in IaaS-cloudsΚωνσταντίνος Τσακαλώζος — 2012
• Étude des problèmes d'ordonnancement sur des plates-formes hétérogènes en modèle multi-port. (Study of Scheduling Problems Under the MultiPort Model on Heterogeneous Platforms)Hejer Rejeb — 2011
• Towards a provenance-aware distributed filesystemChen Shou, Dongfang Zhao, Tanu Malik — 2013
• A highly reliable gpu-based raid systemAnthony Skjellum, Matthew Leon Curry — 2010
• Advanced I/O for large-scale scientific applications.Scott Klasky, Karsten Schwan, Ron Oldfield — 2010
• Spyglass: Fast, Scalable Metadata Search for Large-Scale Storage SystemsAndrew W. Leung, Minglong Shao, Timothy Bisson — 2009
• A multi-tier cached I/O architecture for massively parallel supercomputersGarcía Blas, Francisco Javier — 2011
• GIGA+: scalable directories for shared file systemsSwapnil Patil, Garth A. Gibson — 2007
• Efficient big data system in the cloud : resource provisioning and schedulingYiheng Yuan — 2014
• A strategy for cost efficient distributed data storage for in-memory OLAPOlga Mordvinova, Oleksandr Shepil, Thomas Ludwig — 2009
• Moneta: A Storage System for Fast Non-Volatile MemoriesAdrian M. Caulfield — 2013

Related papers

• MapReduce: simplified data processing on large clustersJay B. Dean, Sanjay Ghemawat — 2008
• Dynamo: amazon's highly available key-value storeGiuseppe DeCandia, Deniz Hastorun, Madan Jampani — 2007
• The Panasas ActiveScale Storage Cluster - Delivering Scalable High Bandwidth StorageDavid Nagle, Denis Serenyi, Abbie Matthews — 2004
• A cost-effective, high-bandwidth storage architectureGarth A. Gibson, David F. Nagle, Khalil Amiri — 1998
• Scalable Performance of the Panasas Parallel File SystemBrent Welch, Marc Unangst, Zainul Abbasi — 2008
• GPFS: A Shared-Disk File System for Large Computing ClustersFrank Schmuck, Roger Haskin — 2002
• FarsiteAtul Adya, William J. Bolosky, Miguel Castro — 2002
• The Hadoop Distributed File SystemKonstantin V. Shvachko, Hairong Kuang, Sanjay Radia — 2010
• The Google file systemSanjay Ghemawat, Howard Gobioff, Shun-Tak A. Leung — 2003
• PVFS: A Parallel File System for Linux ClustersPhilip Carns, W.B. Ligon, Robert Ross — 2000