Skip to main content
SHARE
Publication

DENOVA: Deduplication Extended NOVA File System...

by Awais Khan
Publication Type
Conference Paper
Book Title
2022 IEEE International Parallel and Distributed Processing Symposium (IPDPS)
Publication Date
Page Numbers
1360 to 1371
Publisher Location
New Jersey, United States of America
Conference Name
IEEE International Processing and Distributed Processing Symposium (IPDPS'22)
Conference Location
Ecole Normale Supérieure de Lyon
Lyon, France, France
Conference Sponsor
IEEE
Conference Date
-

This paper shows mathematically and experimentally that inline deduplication is not suitable for file systems on ultra-low latency Intel Optane DC PM devices in terms of performance, and proposes DeNova, an offline deduplication specially designed for log-structured NVM file systems such as NOVA. DeNova offers high-performance and low-latency I/O processing and executes deduplication in the background without interfering with foreground I/Os. DeNova employs DRAM-free persistent deduplication metadata, favoring CPU cache line, and ensures failure consistency on any system failure. We implement DeNova in the NOVA file system. Evaluation with DeNova confirms a negligible performance drop of baseline NOVA of less than 1%, while gaining high storage space savings. Extensive experiments show DeNova is failure consistent in all failure scenario cases.