Region-Based Prefetch Techniques for Software Distributed Shared Memory Systems

Date

2010

Authors

Cai, Jie
Strazdins, Peter
Rendell, Alistair

Journal Title

Journal ISSN

Volume Title

Publisher

IEEE Computer Society

Abstract

Although shared memory programming models show good programmability compared to message passing programming models, their implementation by page-based software distributed shared memory systems usually suffers from high memory consistency costs. The major part of these costs is internode data transfer for keeping virtual shared memory consistent. A good prefetch strategy can reduce this cost. We develop two prefetch techniques, TReP and HReP, which are based on the execution history of each parallel region. These techniques are evaluated using offline simulations with the NAS Parallel Benchmarks and the LINPACK benchmark. On average, TReP achieves an efficiency (ratio of pages prefetched that were subsequently accessed) of 96% and a coverage (ratio of access faults avoided by prefetches) of 65%. HReP achieves an efficiency of 91% but has a coverage of 79%. Treating the cost of an incorrectly prefetched page to be equivalent to that of a miss, these techniques have an effective page miss rate of 63% and 71% respectively. Additionally, these two techniques are compared with two well-known software distributed shared memory (sDSM) prefetch techniques, Adaptive++ and TODFCM. TReP effectively reduces page miss rate by 53% and 34% more, and HReP effectively reduces page miss rate by 62% and 43% more, compared to Adaptive++ and TODFCM respectively. As for Adaptive++, these techniques also permit bulk prefetching for pages predicted using temporal locality, amortizing network communication costs and permitting bandwidth improvement from multi-rail network interfaces.

Description

Keywords

Keywords: Linpack benchmark; Memory consistency; Miss-rate; NAS parallel benchmarks; Network communications; Off-line simulations; Prefetch strategy; Prefetches; Prefetching; Programmability; Programming models; Rail networks; Region-based; Shared-memory programmin

Citation

Source

Proceedings 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing (CCGRID 2010)

Type

Conference paper

Book Title

Entity type

Access Statement

License Rights

Restricted until

2037-12-31