ZoneTier: A zone-based storage tiering and caching co-design to integrate SSDs with SMR drives

Xuchao Xie; Liquan Xiao; David H.C. Du

doi:10.1145/3335548

ZoneTier: A zone-based storage tiering and caching co-design to integrate SSDs with SMR drives

Xuchao Xie, Liquan Xiao, David H.C. Du

Computer Science and Engineering

Research output: Contribution to journal › Article › peer-review

8 Scopus citations

Abstract

Integrating solid-state drives (SSDs) and host-aware shingled magnetic recording (HA-SMR) drives can potentially build a cost-effective high-performance storage system. However, existing SSD tiering and caching designs in such a hybrid system are not fully matched with the intrinsic properties of HA-SMR drives due to their lacking consideration of how to handle non-sequential writes (NSWs). We propose ZoneTier, a zonebased storage tiering and caching co-design, to effectively control all the NSWs by leveraging the host-aware property of HA-SMR drives. ZoneTier exploits real-time data layout of SMR zones to optimize zone placement, reshapes NSWs generated from zone demotions to SMR preferred sequential writes, and transforms the inevitable NSWs to cleaning-friendly write traffics for SMR zones. ZoneTier can be easily extended to match host-managed SMR drives using proactive cleaning policy. We implemented a prototype of ZoneTier with user space data management algorithms and real SSD and HA-SMR drives, which are manipulated by the functions provided by libzbc and libaio. Our experiments show that ZoneTier can reduce zone relocation overhead by 29.41% on average, shorten performance recovery time of HA-SMR drives from cleaning by up to 33.37%, and improve performance by up to 32.31% than existing hybrid storage designs.

Original language	English (US)
Article number	A19
Journal	ACM Transactions on Storage
Volume	15
Issue number	3
DOIs	https://doi.org/10.1145/3335548
State	Published - Aug 2019

Bibliographical note

Funding Information:
This work has been supported by NSF Awards No. 1439622, No. 152567, and No. 1812537. Xuchao Xie was supported by the China Scholarship Council. Authors’ addresses: X. Xie and L. Xiao, National University of Defense Technology, College of Computer, Changsha, Hunan, 410073, China; emails: {xiexuchao, xiaoliquan}@nudt.edu.cn; D. H.C. Du, University of Minnesota-Twin Cities, Department of Computer Science, Minneapolis, MN, 55455; email: du@umn.edu. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from permissions@acm.org. © 2019 Association for Computing Machinery. 1553-3077/2019/07-ART19 $15.00 https://doi.org/10.1145/3335548

Publisher Copyright:
© 2019 Association for Computing Machinery.

Keywords

Host-aware
Shingled magnetic recording (SMR)
Tiering and caching co-design
ZoneTier

Access

10.1145/3335548

OpenUrl availability

Full text

Cite this

@article{d5cebce50c3c4b92b27c29978e39b7f1,

title = "ZoneTier: A zone-based storage tiering and caching co-design to integrate SSDs with SMR drives",

abstract = "Integrating solid-state drives (SSDs) and host-aware shingled magnetic recording (HA-SMR) drives can potentially build a cost-effective high-performance storage system. However, existing SSD tiering and caching designs in such a hybrid system are not fully matched with the intrinsic properties of HA-SMR drives due to their lacking consideration of how to handle non-sequential writes (NSWs). We propose ZoneTier, a zonebased storage tiering and caching co-design, to effectively control all the NSWs by leveraging the host-aware property of HA-SMR drives. ZoneTier exploits real-time data layout of SMR zones to optimize zone placement, reshapes NSWs generated from zone demotions to SMR preferred sequential writes, and transforms the inevitable NSWs to cleaning-friendly write traffics for SMR zones. ZoneTier can be easily extended to match host-managed SMR drives using proactive cleaning policy. We implemented a prototype of ZoneTier with user space data management algorithms and real SSD and HA-SMR drives, which are manipulated by the functions provided by libzbc and libaio. Our experiments show that ZoneTier can reduce zone relocation overhead by 29.41% on average, shorten performance recovery time of HA-SMR drives from cleaning by up to 33.37%, and improve performance by up to 32.31% than existing hybrid storage designs.",

keywords = "Host-aware, Shingled magnetic recording (SMR), Tiering and caching co-design, ZoneTier",

author = "Xuchao Xie and Liquan Xiao and Du, {David H.C.}",

note = "Funding Information: This work has been supported by NSF Awards No. 1439622, No. 152567, and No. 1812537. Xuchao Xie was supported by the China Scholarship Council. Authors{\textquoteright} addresses: X. Xie and L. Xiao, National University of Defense Technology, College of Computer, Changsha, Hunan, 410073, China; emails: {xiexuchao, xiaoliquan}@nudt.edu.cn; D. H.C. Du, University of Minnesota-Twin Cities, Department of Computer Science, Minneapolis, MN, 55455; email: du@umn.edu. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from permissions@acm.org. {\textcopyright} 2019 Association for Computing Machinery. 1553-3077/2019/07-ART19 $15.00 https://doi.org/10.1145/3335548 Publisher Copyright: {\textcopyright} 2019 Association for Computing Machinery.",

year = "2019",

month = aug,

doi = "10.1145/3335548",

language = "English (US)",

volume = "15",

journal = "ACM Transactions on Storage",

issn = "1553-3077",

publisher = "Association for Computing Machinery (ACM)",

number = "3",

}

TY - JOUR

T1 - ZoneTier

T2 - A zone-based storage tiering and caching co-design to integrate SSDs with SMR drives

AU - Xie, Xuchao

AU - Xiao, Liquan

AU - Du, David H.C.

N1 - Funding Information: This work has been supported by NSF Awards No. 1439622, No. 152567, and No. 1812537. Xuchao Xie was supported by the China Scholarship Council. Authors’ addresses: X. Xie and L. Xiao, National University of Defense Technology, College of Computer, Changsha, Hunan, 410073, China; emails: {xiexuchao, xiaoliquan}@nudt.edu.cn; D. H.C. Du, University of Minnesota-Twin Cities, Department of Computer Science, Minneapolis, MN, 55455; email: du@umn.edu. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from permissions@acm.org. © 2019 Association for Computing Machinery. 1553-3077/2019/07-ART19 $15.00 https://doi.org/10.1145/3335548 Publisher Copyright: © 2019 Association for Computing Machinery.

PY - 2019/8

Y1 - 2019/8

N2 - Integrating solid-state drives (SSDs) and host-aware shingled magnetic recording (HA-SMR) drives can potentially build a cost-effective high-performance storage system. However, existing SSD tiering and caching designs in such a hybrid system are not fully matched with the intrinsic properties of HA-SMR drives due to their lacking consideration of how to handle non-sequential writes (NSWs). We propose ZoneTier, a zonebased storage tiering and caching co-design, to effectively control all the NSWs by leveraging the host-aware property of HA-SMR drives. ZoneTier exploits real-time data layout of SMR zones to optimize zone placement, reshapes NSWs generated from zone demotions to SMR preferred sequential writes, and transforms the inevitable NSWs to cleaning-friendly write traffics for SMR zones. ZoneTier can be easily extended to match host-managed SMR drives using proactive cleaning policy. We implemented a prototype of ZoneTier with user space data management algorithms and real SSD and HA-SMR drives, which are manipulated by the functions provided by libzbc and libaio. Our experiments show that ZoneTier can reduce zone relocation overhead by 29.41% on average, shorten performance recovery time of HA-SMR drives from cleaning by up to 33.37%, and improve performance by up to 32.31% than existing hybrid storage designs.

AB - Integrating solid-state drives (SSDs) and host-aware shingled magnetic recording (HA-SMR) drives can potentially build a cost-effective high-performance storage system. However, existing SSD tiering and caching designs in such a hybrid system are not fully matched with the intrinsic properties of HA-SMR drives due to their lacking consideration of how to handle non-sequential writes (NSWs). We propose ZoneTier, a zonebased storage tiering and caching co-design, to effectively control all the NSWs by leveraging the host-aware property of HA-SMR drives. ZoneTier exploits real-time data layout of SMR zones to optimize zone placement, reshapes NSWs generated from zone demotions to SMR preferred sequential writes, and transforms the inevitable NSWs to cleaning-friendly write traffics for SMR zones. ZoneTier can be easily extended to match host-managed SMR drives using proactive cleaning policy. We implemented a prototype of ZoneTier with user space data management algorithms and real SSD and HA-SMR drives, which are manipulated by the functions provided by libzbc and libaio. Our experiments show that ZoneTier can reduce zone relocation overhead by 29.41% on average, shorten performance recovery time of HA-SMR drives from cleaning by up to 33.37%, and improve performance by up to 32.31% than existing hybrid storage designs.

KW - Host-aware

KW - Shingled magnetic recording (SMR)

KW - Tiering and caching co-design

KW - ZoneTier

UR - http://www.scopus.com/inward/record.url?scp=85074816079&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85074816079&partnerID=8YFLogxK

U2 - 10.1145/3335548

DO - 10.1145/3335548

M3 - Article

AN - SCOPUS:85074816079

SN - 1553-3077

VL - 15

JO - ACM Transactions on Storage

JF - ACM Transactions on Storage

IS - 3

M1 - A19

ER -

ZoneTier: A zone-based storage tiering and caching co-design to integrate SSDs with SMR drives

Abstract

Bibliographical note

Keywords

Access

OpenUrl availability

Other files and links

Fingerprint

Cite this