R&D: DCStore De-Dupe-Based Cloud-of-Clouds Storage Service

IEEE Explore has published , in 2019 IEEE International Conference on Web Services (ICWS) proceedings, an article written by Bo An, Yan Li, Junming Ma, Gang Huang, Xiangqun Chen, and Donggang Cao, Peking University, China.

Abstract: “The increasing popularity of cloud storage is leading many organizations to move their data into the cloud. However, putting all data in one cloud causes problems such as vendor lock-in, increased service costs, and data availability. In this paper, we introduce DCStore, a Cloud-of-Clouds storage service designed for an organization to outsource their data into the clouds. To achieve the goal of cost-efficient and high-available, we combine three key techniques. First, DCStore eliminates the redundant data at client-side to save storage cost via application-aware chunking method. Second, DCStore uses an inner-chunk based erasure coding scheme to distribute unique chunks across multiple clouds for high availability. Finally, a container-based share management strategy is used for performance optimization. Our experimental evaluations show that DCStore can improve the performance and cost efficiency significantly, compared with existing Cloud-of-Clouds storage systems.“