Dissertation
OPTIMIZING PERFORMANCE ON MASSIVELY PARALLEL COMPUTERS USING A REMOTE MEMORY ACCESS PROGRAMMING MODEL
Doctor of Philosophy (PhD), Washington State University
01/2010
Handle:
https://hdl.handle.net/2376/2811
Abstract
Parallel programming models are of paramount importance because they affect both the performance delivered by massively parallel systems and the productivity of the programmer seeking that performance. Advancements in networks, multicore chips, and related technology continue to improve the efficiency of modern supercomputers. However, the average application efficiency is a small fraction of the peak system efficiency.
This research proposes techniques for optimizing application performance on supercomputers using remote memory access (RMA)
parallel programming model. The growing gaps between CPU-network and CPU-memory timescales are fundamental problems that require attention in the design of communication models as well as scalable parallel algorithms. This research validates the RMA model because of its simplicity, its good hardware support on modern networks, and its posession of certain characteristics important for reducing the performance gap between system peak and application performance.
The effectiveness of these optimizations is evaluated in the context
of parallel linear algebra kernels. The current approach differs from
the other linear algebra algorithms by the explicit use of shared
memory and remote memory access communication rather than message passing. It is suitable for clusters and scalable shared memory
systems. The experimental results on large scale systems
(Linux-Infiniband cluster, Cray XT) demonstrate consistent performance
advantages over the ScaLAPACK suite, the leading implementation of
parallel linear algebra algorithms used today.
Metrics
6 File views/ downloads
24 Record Views
Details
- Title
- OPTIMIZING PERFORMANCE ON MASSIVELY PARALLEL COMPUTERS USING A REMOTE MEMORY ACCESS PROGRAMMING MODEL
- Creators
- Manojkumar Krishnan
- Contributors
- Robert R Lewis (Advisor)John Miller (Committee Member)Diane Cook (Committee Member)Kevin Glass (Committee Member)
- Awarding Institution
- Washington State University
- Academic Unit
- Electrical Engineering and Computer Science, School of
- Theses and Dissertations
- Doctor of Philosophy (PhD), Washington State University
- Number of pages
- 100
- Identifiers
- 99900581549601842
- Language
- English
- Resource Type
- Dissertation