K8sES: Optimizing Kubernetes with Enhanced Storage Service-Level Objectives

Hao Wen; Zhichao Cao; Bingzhe Li; David H.C. Du; Ayman Abouelwafa; Doug Voigt; Shiyong Liu; Jim Diehl; Fenggang Wu

doi:10.1109/ICCD58817.2023.00041

K8sES: Optimizing Kubernetes with Enhanced Storage Service-Level Objectives

Hao Wen, Zhichao Cao, Bingzhe Li, David H.C. Du, Ayman Abouelwafa, Doug Voigt, Shiyong Liu, Jim Diehl, Fenggang Wu

Computer Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Kubernetes (k8s) is a system for managing containerized applications across multiple hosts. It offers automatic deployment, maintenance, scaling, and resource management for applications. Applications in k8s usually have different storage requirements in the form of service-level objectives (SLOs). However, the current k8s storage management has several limitations which cause explicit performance and cost overhead. K8s administrators have to configure storage in advance manually, and users must know configurations and capabilities of provided storage. Users' storage SLOs can be easily violated in k8s.In this paper, we design and implement k8s Enhanced Storage (k8sES) which efficiently supports applications with various storage SLOs along with all other requirements in the Kubernetes environment. We design and incorporate storage scheduling as part of the node scheduling process in k8s. Applications will be scheduled onto the correct nodes and storage without intervention from either users or administrators. Proper storage resources will be dynamically carved based on users' storage SLOs. In addition, we provide a tool to monitor the I/O activities of both applications and storage devices in k8sES. The evaluation shows that k8sES can better meet users' storage SLOs along with other requirements. Also, k8sES can achieve higher resource utilization efficiency with overhead similar to that of the current k8s.

Original language	English (US)
Title of host publication	Proceedings - 2023 IEEE 41st International Conference on Computer Design, ICCD 2023
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	214-222
Number of pages	9
ISBN (Electronic)	9798350342918
DOIs	https://doi.org/10.1109/ICCD58817.2023.00041
State	Published - 2023
Event	41st IEEE International Conference on Computer Design, ICCD 2023 - Washington, United States Duration: Nov 6 2023 → Nov 8 2023

Publication series

Name	Proceedings - IEEE International Conference on Computer Design: VLSI in Computers and Processors
ISSN (Print)	1063-6404

Conference

Conference	41st IEEE International Conference on Computer Design, ICCD 2023
Country/Territory	United States
City	Washington
Period	11/6/23 → 11/8/23

Bibliographical note

Publisher Copyright:
© 2023 IEEE.

Keywords

Cloud Native
Containers
Kubernetes
Storage

Access

10.1109/ICCD58817.2023.00041

OpenUrl availability

Full text

Cite this

Wen, H., Cao, Z., Li, B., Du, D. H. C., Abouelwafa, A., Voigt, D., Liu, S., Diehl, J., & Wu, F. (2023). K8sES: Optimizing Kubernetes with Enhanced Storage Service-Level Objectives. In Proceedings - 2023 IEEE 41st International Conference on Computer Design, ICCD 2023 (pp. 214-222). (Proceedings - IEEE International Conference on Computer Design: VLSI in Computers and Processors). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICCD58817.2023.00041

K8sES: Optimizing Kubernetes with Enhanced Storage Service-Level Objectives. / Wen, Hao; Cao, Zhichao; Li, Bingzhe et al.
Proceedings - 2023 IEEE 41st International Conference on Computer Design, ICCD 2023. Institute of Electrical and Electronics Engineers Inc., 2023. p. 214-222 (Proceedings - IEEE International Conference on Computer Design: VLSI in Computers and Processors).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Wen, H, Cao, Z, Li, B, Du, DHC, Abouelwafa, A, Voigt, D, Liu, S, Diehl, J & Wu, F 2023, K8sES: Optimizing Kubernetes with Enhanced Storage Service-Level Objectives. in Proceedings - 2023 IEEE 41st International Conference on Computer Design, ICCD 2023. Proceedings - IEEE International Conference on Computer Design: VLSI in Computers and Processors, Institute of Electrical and Electronics Engineers Inc., pp. 214-222, 41st IEEE International Conference on Computer Design, ICCD 2023, Washington, United States, 11/6/23. https://doi.org/10.1109/ICCD58817.2023.00041

Wen H, Cao Z, Li B, Du DHC, Abouelwafa A, Voigt D et al. K8sES: Optimizing Kubernetes with Enhanced Storage Service-Level Objectives. In Proceedings - 2023 IEEE 41st International Conference on Computer Design, ICCD 2023. Institute of Electrical and Electronics Engineers Inc. 2023. p. 214-222. (Proceedings - IEEE International Conference on Computer Design: VLSI in Computers and Processors). doi: 10.1109/ICCD58817.2023.00041

Wen, Hao ; Cao, Zhichao ; Li, Bingzhe et al. / K8sES : Optimizing Kubernetes with Enhanced Storage Service-Level Objectives. Proceedings - 2023 IEEE 41st International Conference on Computer Design, ICCD 2023. Institute of Electrical and Electronics Engineers Inc., 2023. pp. 214-222 (Proceedings - IEEE International Conference on Computer Design: VLSI in Computers and Processors).

@inproceedings{d9217928b5d5454cb114363cc3bfd585,

title = "K8sES: Optimizing Kubernetes with Enhanced Storage Service-Level Objectives",

abstract = "Kubernetes (k8s) is a system for managing containerized applications across multiple hosts. It offers automatic deployment, maintenance, scaling, and resource management for applications. Applications in k8s usually have different storage requirements in the form of service-level objectives (SLOs). However, the current k8s storage management has several limitations which cause explicit performance and cost overhead. K8s administrators have to configure storage in advance manually, and users must know configurations and capabilities of provided storage. Users' storage SLOs can be easily violated in k8s.In this paper, we design and implement k8s Enhanced Storage (k8sES) which efficiently supports applications with various storage SLOs along with all other requirements in the Kubernetes environment. We design and incorporate storage scheduling as part of the node scheduling process in k8s. Applications will be scheduled onto the correct nodes and storage without intervention from either users or administrators. Proper storage resources will be dynamically carved based on users' storage SLOs. In addition, we provide a tool to monitor the I/O activities of both applications and storage devices in k8sES. The evaluation shows that k8sES can better meet users' storage SLOs along with other requirements. Also, k8sES can achieve higher resource utilization efficiency with overhead similar to that of the current k8s.",

keywords = "Cloud Native, Containers, Kubernetes, Storage",

author = "Hao Wen and Zhichao Cao and Bingzhe Li and Du, {David H.C.} and Ayman Abouelwafa and Doug Voigt and Shiyong Liu and Jim Diehl and Fenggang Wu",

note = "Publisher Copyright: {\textcopyright} 2023 IEEE.; 41st IEEE International Conference on Computer Design, ICCD 2023 ; Conference date: 06-11-2023 Through 08-11-2023",

year = "2023",

doi = "10.1109/ICCD58817.2023.00041",

language = "English (US)",

series = "Proceedings - IEEE International Conference on Computer Design: VLSI in Computers and Processors",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "214--222",

booktitle = "Proceedings - 2023 IEEE 41st International Conference on Computer Design, ICCD 2023",

}

TY - GEN

T1 - K8sES

T2 - 41st IEEE International Conference on Computer Design, ICCD 2023

AU - Wen, Hao

AU - Cao, Zhichao

AU - Li, Bingzhe

AU - Du, David H.C.

AU - Abouelwafa, Ayman

AU - Voigt, Doug

AU - Liu, Shiyong

AU - Diehl, Jim

AU - Wu, Fenggang

PY - 2023

Y1 - 2023

N2 - Kubernetes (k8s) is a system for managing containerized applications across multiple hosts. It offers automatic deployment, maintenance, scaling, and resource management for applications. Applications in k8s usually have different storage requirements in the form of service-level objectives (SLOs). However, the current k8s storage management has several limitations which cause explicit performance and cost overhead. K8s administrators have to configure storage in advance manually, and users must know configurations and capabilities of provided storage. Users' storage SLOs can be easily violated in k8s.In this paper, we design and implement k8s Enhanced Storage (k8sES) which efficiently supports applications with various storage SLOs along with all other requirements in the Kubernetes environment. We design and incorporate storage scheduling as part of the node scheduling process in k8s. Applications will be scheduled onto the correct nodes and storage without intervention from either users or administrators. Proper storage resources will be dynamically carved based on users' storage SLOs. In addition, we provide a tool to monitor the I/O activities of both applications and storage devices in k8sES. The evaluation shows that k8sES can better meet users' storage SLOs along with other requirements. Also, k8sES can achieve higher resource utilization efficiency with overhead similar to that of the current k8s.

AB - Kubernetes (k8s) is a system for managing containerized applications across multiple hosts. It offers automatic deployment, maintenance, scaling, and resource management for applications. Applications in k8s usually have different storage requirements in the form of service-level objectives (SLOs). However, the current k8s storage management has several limitations which cause explicit performance and cost overhead. K8s administrators have to configure storage in advance manually, and users must know configurations and capabilities of provided storage. Users' storage SLOs can be easily violated in k8s.In this paper, we design and implement k8s Enhanced Storage (k8sES) which efficiently supports applications with various storage SLOs along with all other requirements in the Kubernetes environment. We design and incorporate storage scheduling as part of the node scheduling process in k8s. Applications will be scheduled onto the correct nodes and storage without intervention from either users or administrators. Proper storage resources will be dynamically carved based on users' storage SLOs. In addition, we provide a tool to monitor the I/O activities of both applications and storage devices in k8sES. The evaluation shows that k8sES can better meet users' storage SLOs along with other requirements. Also, k8sES can achieve higher resource utilization efficiency with overhead similar to that of the current k8s.

KW - Cloud Native

KW - Containers

KW - Kubernetes

KW - Storage

UR - http://www.scopus.com/inward/record.url?scp=85182344446&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85182344446&partnerID=8YFLogxK

U2 - 10.1109/ICCD58817.2023.00041

DO - 10.1109/ICCD58817.2023.00041

M3 - Conference contribution

AN - SCOPUS:85182344446

T3 - Proceedings - IEEE International Conference on Computer Design: VLSI in Computers and Processors

SP - 214

EP - 222

BT - Proceedings - 2023 IEEE 41st International Conference on Computer Design, ICCD 2023

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 6 November 2023 through 8 November 2023

ER -

K8sES: Optimizing Kubernetes with Enhanced Storage Service-Level Objectives

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access

OpenUrl availability

Other files and links

Fingerprint

Cite this