Visualizing process composition and load balance in parallel coupled models
Date
2011
Authors
Larson, Jay
Journal Title
Journal ISSN
Volume Title
Publisher
Elsevier
Abstract
Coupled model development presents a set of challenges broadly called the coupling problem; message-passing parallelism complicates matters, resulting in the parallel coupling problem. Performance tuning of parallel coupled systems is complex and performed largely in an ad hoc fashion; from the domain scientist's perspective the figure of merit is throughput, which is the amount of simulation achieved per unit of wall-clock time. Achieving high throughput for parallel coupled models requires high scalability for each subsystem and compatible combinations of the subsystems' respective resource allocations (e.g., MPI processes) to minimize idle time surrounding coupling events. Scaling parallel coupled models up to million-way parallelism highlights the need for practical methods for describing and evaluating these systems. I present a set of complementary tools to analyze and visualize process composition and load balance for coupled models. I state five basic process compositions found in coupled models. Two are the irreducible, well-known sequential and parallel compositions found in common process algebras. I define three new derived process compositions that appear in coupled systems. I define a dynamic load balance hierarchy. I propose a simple graph-based schema for diagramming process composition in coupled models that is capable of expressing dynamic load balance relationships, and I present simple examples illustrating its use. I apply the graphical schema to Version 4 of the Community Climate System Model to estimate the complexity of the process composition and load balance problem for this system.
Description
Keywords
Keywords: Common process; Community climate system model; Complementary tools; Coupled models; Coupled systems; Coupling problem; Dynamic load balance; Graph-based; High scalabilities; High throughput; Idle time; Load balance; MPI process; Multi-scale Modeling; Mul Computational complexity; Load balance; Multiphysics modeling; Multiscale modeling; Process composition
Citation
Collections
Source
Block-Entropy Analysis of Climate Data
Type
Conference paper
Book Title
Entity type
Access Statement
License Rights
Restricted until
2037-12-31
Downloads
File
Description