NVLSM: A Persistent Memory Key-Value Store Using Log-Structured Merge Tree with Accumulative Compaction

Baoquan Zhang, David H.C. Du

Research output: Contribution to journalArticlepeer-review

10 Scopus citations

Abstract

Computer systems utilizing byte-addressable Non-Volatile Memory (NVM) as memory/storage can provide low-latency data persistence. The widely used key-value stores using Log-Structured Merge Tree (LSM-Tree) are still beneficial for NVM systems in aspects of the space and write efficiency. However, the significant write amplification introduced by the leveled compaction of LSM-Tree degrades the write performance of the key-value store and shortens the lifetime of the NVM devices. The existing studies propose new compaction methods to reduce write amplification. Unfortunately, they result in a relatively large read amplification. In this article, we propose NVLSM, a key-value store for NVM systems using LSM-Tree with new accumulative compaction. By fully utilizing the byte-addressability of NVM, accumulative compaction uses pointers to accumulate data into multiple floors in a logically sorted run to reduce the number of compactions required. We have also proposed a cascading searching scheme for reads among the multiple floors to reduce read amplification. Therefore, NVLSM reduces write amplification with small increases in read amplification. We compare NVLSM with key-value stores using LSM-Tree with two other compaction methods: leveled compaction and fragmented compaction. Our evaluations show that NVLSM reduces write amplification by up to 67% compared with LSM-Tree using leveled compaction without significantly increasing the read amplification. In write-intensive workloads, NVLSM reduces the average latency by 15.73%-41.2% compared to other key-value stores.

Original languageEnglish (US)
Article number23
JournalACM Transactions on Storage
Volume17
Issue number3
DOIs
StatePublished - Aug 2021

Bibliographical note

Funding Information:
This work was partially supported by NSF I/UCRC Center Research in Intelligent Storage and NSF awards 1439622, 1525617, and 1812537. Authors’ addresses: B. Zhang and D. H. C. Du, University of Minnesota–Twin Cities, 319-15th Avenue S.E., Minneapolis, MN 55455; emails: zhan4281@umn.edu, du@umn.edu. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from permissions@acm.org. © 2021 Association for Computing Machinery. 1553-3077/2021/08-ART23 $15.00 https://doi.org/10.1145/3453300

Publisher Copyright:
© 2021 Association for Computing Machinery.

Keywords

  • Non-volatile memory
  • key-value store
  • log-structured merge tree

Fingerprint

Dive into the research topics of 'NVLSM: A Persistent Memory Key-Value Store Using Log-Structured Merge Tree with Accumulative Compaction'. Together they form a unique fingerprint.

Cite this