Kubernetes Rook Ceph

From Sagar Nangare, digital strategist, Calsoft Inc.

This article was originally published on TheNewStack. It is re-publishing it here by Sagar Nangare.

Kubernetes, since its inception, has emerged as an application orchestration framework for any data center; from private, public cloud to far edge sites.

Enterprises are demonstrating Kubernetes for orchestrating containers deployed at the edge, and also handling a variety of workloads.

Kubernetes has been initially used to manage containers in which application can be hosted along with a minimal amount of storage. In this manner, the first containerized applications followed the micro-service design pattern.

As it matures, Kubernetes is graduating to hosting more challenging stateful workloads. The new trend is to orchestrate storage workloads in pods to extend portability as well as cloud native benefits to storage for applications. It makes easy for IT admins to take along the storage for certain applications while moving to another data center, or another public cloud vendor. That is important from the perspective of the CIO.

Download our ebook (registration required) – A Deep-Dive on Kubernetes for Edge – focuses on current scenarios of adoption of Kubernetes for edge use cases, latest Kubernetes+edge case studies, deployment approaches, commercial solutions and efforts by open communities.

Ceph is a used SDS system providing multi-modal (object, block and file storage) data access on networked servers. It has its deployment and operational complexities, which operators are currently managing themselves. These stem from Ceph’s flexibility typical of an open source project: Ceph exposes a large number of tunable settings and expert operators revel in tuning their clusters in detail.

As Kubernetes adoption becomes widespread, it will become obvious to design data centers, keeping in mind the hosting needs of diverse types of data and the orchestration of this data in a dynamic manner. Also, in the world of containerized micro-services, the requirement for data and application portability will require a simple point solution that utilizes the power of flexible data center tools like Kubernetes and Ceph.

Rook: Merging Power of Kubernetes and Ceph
Here comes Rook, which ties the Red Hat-managed open-source Ceph scale-out storage platform and Kubernetes to deliver a dynamic storage environment for performance and dynamically scaling storage workloads. It is a storage orchestrator for cloud-native environments.

Along with the utilization of storage systems like Ceph, Rook eliminates Kubernetes storage challenges like dependency on local storage, cloud providers vendor lock-in and day-2 operations within the infrastructure.

Rook is a Kubernetes storage operator that can help deploy and manage Ceph clusters and monitors those clusters for compliance with the desired runtime configuration. Operator is a new Kubernetes buzzword, bringing home the sense that admins only declare the desired state of Ceph cluster and Rook watches changes in state and health, analyses differences in state, and applies the configuration instructions mentioned in state.

Rook Architecture

Rook brings orchestration benefits to Ceph storage clusters like simplified deployment, bootstrapping, configuration, provisioning, scaling (up and down), upgrading, migration, monitoring and resource management.

Normally, Ceph is used to automate the storage management and Rook can sit on top of Kubernetes clusters to automate administrator-facing operations, offloading the storage team from the need to run day-to-day operations.

Summary
Kubernetes has enabled applications to be cloud native, but application storage has not been enabled with cloud native features from the start. Rook bridges that big gap by making storage cloud native in conjunction with Ceph and other storage systems. What benefits Kubernetes brought to applications deployed in containers, in the same way Rook has done for storage, bringing dynamic storage orchestration features to modern data centers. Rook also looks promising with its ability to reduce the effort required of a data center’s storage team Increased use of Rook in data center design promises to free storage from lock-in as Kubernetes has done for compute.

For more technical details, refer presentations by Sean Cohen, Federico Lucifredi and Sébastien Han, at OpenStack Summit 2019 and KubeCon 2019.

Calsoft Inc. is ISV product engineering services partner in IoT, big data, ML, AI, and cloud domains, its solution accelerators and frameworks expedites clients go-to-market product launches and accomplish their business goals.

Read also:
Calsoft Delves Deeper Into IoT and Data Management Segments
Introducing digital transformation solutions for technology companies as well as enterprises promising agility and engineering innovation
July 26, 2019 | Press Release