Skip to main content
SHARE
Publication

Analyzing File Access Patterns on Large-Scale HPC Systems: Opportunities for File Prefetching

by Ahmad Maroof Karimi, Arnab Paul, Jong Youl Choi, Lipeng Wan, Feiyi Wang
Publication Type
Conference Paper
Book Title
2023 31st International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS)
Publication Date
Page Number
1
Publisher Location
New Jersey, United States of America

This paper explores the potential opportunities for implementing file prefetching techniques on large-scale high-performance computing (HPC) systems. Specifically, we investigate the file access patterns of various applications across multiple scientific domains using two years' worth of Darshan I/O traces obtained from the Summit supercomputer. We identify recurring trends and patterns which indicate that prefetching can be effectively leveraged to improve data access performance on HPC systems. This study serves as a valuable reference for system architects and developers in the HPC community, providing insights into the opportunities and challenges associated with enabling file prefetching on large-scale HPC systems.