Ceph: A Scalable Object-Based Storage System

Technical report · UCSC-SSRC-06-01 · University of California, Santa Cruz

March 2006View full paper

Abstract

The data storage needs of large high-performance and general-purpose computing environments are generally best served by distributed storage systems. Traditional solutions, exemplified by NFS, provide a simple distributed storage system model, but cannot meet the demands of high-performance computing environments where a single server may become a bottleneck, nor do they scale well due to the need to manually partition (or repartition) the data among the servers. Object-based storage promises to address these needs through a simple networked data storage unit, the Object Storage Device (OSD) that manages all local storage issues and exports a simple read/write data interface. Despite this simple concept, many challenges remain, including efficient object storage, centralized metadata management, data and metadata replication, and data and metadata reliability. We describe Ceph, a distributed object-based storage system that meets these challenges, providing high-performance file storage that scales directly with the number of OSDs and Metadata servers.

BibTeX

@techreport{weil-ssrctr06,
  author       = {Sage A. Weil and Feng Wang and Qin Xin and Scott A. Brandt and Ethan L. Miller and Darrell D. E. Long and Carlos Maltzahn},
  title        = {Ceph: A Scalable Object-Based Storage System},
  institution  = {University of California, Santa Cruz},
  number       = {UCSC-SSRC-06-01},
  month        = mar,
  year         = {2006}
}
View full paper