Skip to main content
SHARE
Publication

MAPredict: Static Analysis Driven Memory Access Prediction Framework for Modern CPUs...

by Mohammad Alaul Haque Monil, Seyong Lee, Jeffrey S Vetter, Allen Malony
Publication Type
Conference Paper
Book Title
ISC High Performance: International Conference on High Performance Computing
Publication Date
Page Numbers
233 to 255
Publisher Location
Cham, Switzerland
Conference Name
ISC High Performance: International Conference on High Performance Computing
Conference Location
Hamburg, Germany
Conference Sponsor
INTEL, NVIDIA, HPE, Lenovo, AtoS, WEKA
Conference Date
-

Application memory access patterns are crucial in deciding how much traffic is served by the cache and forwarded to the dynamic random-access memory (DRAM). However, predicting such memory traffic is difficult because of the interplay of prefetchers, compilers, parallel execution, and innovations in manufacturer-specific micro-architectures. This research introduced MAPredict, a static analysis-driven framework that addresses these challenges to predict last-level cache (LLC)-DRAM traffic. By exploring and analyzing the behavior of modern Intel processors, MAPredict formulates cache-aware analytical models. MAPredict invokes these models to predict LLC-DRAM traffic by combining the application model, machine model, and user-provided hints to capture dynamic information. MAPredict successfully predicts LLC-DRAM traffic for different regular access patterns and provides the means to combine static and empirical observations for irregular access patterns. Evaluating 130 workloads from six applications on recent Intel micro-architectures, MAPredict yielded an average accuracy of 99% for streaming, 91% for strided, and 92% for stencil patterns. By coupling static and empirical methods, up to 97% average accuracy was obtained for random access patterns on different micro-architectures.