Enabling Concurrent Failure Recovery for Regenerating-Coding-Based Storage Systems: From Theory to Practice

Keywords

Computer science, Erasure code, Distributed data store, Testbed, Distributed computing

References

• An XOR-based erasure-resilient coding schemeJohannes Blömer, Malik Kalfane, Richard M. Karp — 1995
• Total Recall: System Support for Automated Availability ManagementRanjita Bhagwan, Kiran Tati, Yuchung Cheng — 2004
• A Performance Evaluation and Examination of Open-Source Erasure Coding Libraries for StorageJames S. Plank, Jianqiang Luo, Catherine D. Schuman — 2009
• Erasure Coding in Windows Azure StorageCheng Huang, Huseyin Simitci, Yikang Xu — 2012
• NCCloud: applying network coding for the storage repair in a cloud-of-cloudsYuchong Hu, Henry C.H. Chen, Patrick P. C. Lee — 2012
• Mean Time to Meaningless: MTTDL, Markov Models, and Storage System ReliabilityKevin M. Greenan, James S. Plank, Jay J. Wylie — 2010
• Rethinking erasure codes for cloud file systems: minimizing I/O for recovery and degraded readsOsama Khan, Randal Burns, James S. Plank — 2012
• Availability in Globally Distributed Storage SystemsDaniel Alexander Ford, François Labelle, Florentina I. Popovici — 2010
• Subtleties in Tolerating Correlated Failures in Wide-area Storage SystemsSuman Nath, Haifeng Yu, Phillip B. Gibbons — 2006
• Efficient Replica Maintenance for Distributed Storage SystemsByung-Gon Chun, Frank Dabek, Andreas Haeberlen — 2006
• Explicit codes minimizing repair bandwidth for distributed storageNihar B. Shah, K. V. Rashmi, P. Vijay Kumar — 2009
• A Hybrid Approach to Failed Disk Recovery Using RAID-6 Codes: Algorithms and Performance EvaluationLiping Xiang, Yinlong Xu, John C. S. Lui — 2011
• Regenerating Codes: A System PerspectiveSteve Jiekak, Anne-Marie Kermarrec, Nicolas Le Scouarnec — 2012
• Windows Azure Storage: a highly available cloud storage service with strong consistencyBrad Calder, Wang Ju, Aaron Ogus — 2011
• Reducing Repair Traffic in P2P Backup Systems: Exact Regenerating Codes on Hierarchical CodesZhen Huang, Ernst W. Biersack, Yuxing Peng — 2011
• Interference Alignment in Regenerating Codes for Distributed Storage: Necessity and Code ConstructionsNihar B. Shah, K. V. Rashmi, P. Vijay Kumar — 2010
• A piggybacking design framework for read-and download-efficient distributed storage codesK. V. Rashmi, Nihar B. Shah, Kannan Ramchandran — 2013
• Zigzag Codes: MDS Array Codes With Optimal RebuildingItzhak Tamo, Zhiying Wang, Jehoshua Bruck — 2011
• Lazy Means Smart: Reducing Repair Bandwidth Costs in Erasure-coded Distributed StorageMark Silberstein, Lakshmi Ganesh, Yang Wang — 2014
• CORE: Cross-object redundancy for efficient data repair in storage systemsKyumars Sheykh Esmaili, Lluís Pàmies-Juàrez, Anwitaman Datta — 2013

Cited by

• Enabling Efficient and Reliable Transition from Replication to Erasure Coding for Clustered File SystemsRunhui Li, Yuchong Hu, Patrick P. C. Lee — 2015
• Making mapreduce scheduling effective in erasure-coded storage clustersRunhui Li, Patrick P. C. Lee — 2015
• Optimal Rebuilding of Multiple Erasures in MDS CodesZhiying Wang, Itzhak Tamo, Jehoshua Bruck — 2016
• QoS‐aware indiscriminate volume storage cloudBowei Yang, Guanghua Song, Yining Chen — 2017
• Concurrent Regenerating Codes and Scalable Application in Network StorageHuayu Zhang, Hui Li, Hanxu Hou — 2016
• Cooperative repair of multiple node failures in distributed storage systemsKenneth W. Shum, Junyu Chen — 2016
• HashTag Erasure Codes: From Theory to PracticeKatina Kralevska, Danilo Gligoroski, Rune E. Jensen — 2016
• Efficient routing for cooperative data regeneration in heterogeneous storage networksZhirong Shen, Patrick P. C. Lee, Jiwu Shu — 2016
• Applied Erasure Coding in Networks and Distributed StorageKatina Kralevska — 2018
• Replicated convolutional codes: A design framework for repair-efficient distributed storage codesBing Zhu, Xin Li, Hui Li — 2016
• Enabling Efficient and Reliable Transition from Replication to Erasure Coding for Clustered File SystemsRunhui Li, Yuchong Hu, Patrick P. C. Lee — 2017
• Optimal Repair Layering for Erasure-Coded Data CentersYuchong Hu, Xiaolu Li, Mi Zhang — 2017
• Proxy-Assisted Regenerating Codes With Uncoded Repair for Distributed Storage SystemsYuchong Hu, Patrick P. C. Lee, Kenneth W. Shum — 2018
• TA-Update: An Adaptive Update Scheme with Tree-Structured Transmission in Erasure-Coded Storage SystemsYijie Wang, Xiaoqiang Pei, Xingkong Ma — 2018
• Repairing multiple failures for scalar MDS codesBurak Bartan, Mary Wootters — 2017
• ASSER: An Efficient, Reliable, and Cost-Effective Storage Scheme for Object-Based Cloud Storage SystemsJianwei Yin, Yan Tang, Shuiguang Deng — 2017
• Centralized multi-node repair for minimum storage regenerating codesMarwen Zorgui, Zhiying Wang — 2017
• Repairing Multiple Failures for Scalar MDS CodesJay Mardia, Burak Bartan, Mary Wootters — 2019
• A Reliability Model for Dependent and Distributed MDS Disk Array UnitsŞuayb S. Arslan — 2018
• OpenEC: Toward Unified and Configurable Erasure Coding Management in Distributed Storage SystemsXiaolu Li, Runhui Li, Patrick P. C. Lee — 2019

Related papers

• LEC-PR: Proactive Recovery Method in Erasure-Coded StorageYing Song, Mingjie Yang, Bo Wang — 2022
• Deterministic Data Distribution for Efficient Recovery in Erasure-Coded Storage SystemsLiangliang Xu, Min Lyu, Zhipeng Li — 2020
• ESet: Placing Data Towards Efficient Recovery for Large-Scale Erasure-Coded Storage SystemsChengjian Liu, Xiaowen Chu, Hai Liu — 2016
• Topology-Aware Data Placement Strategy for Fault-Tolerant Storage SystemsJunxu Xia, Deke Guo, Lailong Luo — 2020
• SA-RSR: a read-optimal data recovery strategy for XOR-coded distributed storage systemsXingjun Zhang, Ningjing Liang, Yunfei Liu — 2022
• Lifetime and availability of data stored on a P2P system: Evaluation of recovery schemesAbdulhalim Dandoush, Sara Alouf, Philippe Nain — 2010