Adaptive load-balancing for force-decomposition based 3-body molecular dynamics simulations in a heterogeneous distributed environment with variable number of processors

J. V. Sumanth, David R. Swanson, Hong Jiang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

Molecular Dynamics (MD), a computationally intensive problem, is used by researchers in various fields. The computational parallelism inherent in this application can be exploited in parallel and distributed environments. However, in heterogeneous distributed environments such as the Grid, the available resources, namely the network and computational power, are continually changing with respect to every available node. To optimally utilize these dynamic resources, a scheduler should be able to continually adapt to the changes and suitably vary the number of interactions scheduled to each node. We propose one such scheduling algorithm in this paper. MD simulations based on the spatial-decomposition (for short-range potentials) technique assuming heterogeneous compute power and homogeneous links exist in the literature. To the best of our knowledge, this paper is the first to perform a block-level decomposition of the force-matrix for three-body potentials in a distributed environment with heterogeneous compute power with heterogeneous network links while exploiting the symmetries that exist in a three-body force matrix. Our previous work [24] targeted MD simulations using the Atom-Decomposition Method (Slice level decomposition of the force-matrix) in a heterogeneous environment. The proposed scheduling algorithm builds and continually updates a model of the distributed system, which it then uses to make decisions about how to optimally redistribute the load in the system at every time step of the MD simulation. The scheduling algorithm can additionally handle dynamic changes in the number of nodes available for computation at runtime. We implement our algorithm and evaluate its effectiveness by measuring the idle fraction which is a measure of the idle time experienced by all compute clients at every time-step. This idle fraction is a load-balance optimality measure that indicates how close the load balancing is to the theoretical optimal of 0%. We find that under most typical conditions, it is roughly 6%. We also determine potential enhancements to improve the idle fraction further.

Original languageEnglish (US)
Title of host publication2007 International Conference on Parallel Processing, ICPP
DOIs
StatePublished - 2007
Event36th International Conference on Parallel Processing in Xi'an, ICPP - Xi'an, China
Duration: Sep 10 2007Sep 14 2007

Publication series

NameProceedings of the International Conference on Parallel Processing
ISSN (Print)0190-3918

Conference

Conference36th International Conference on Parallel Processing in Xi'an, ICPP
CountryChina
CityXi'an
Period9/10/079/14/07

ASJC Scopus subject areas

  • Hardware and Architecture
  • Engineering(all)

Fingerprint Dive into the research topics of 'Adaptive load-balancing for force-decomposition based 3-body molecular dynamics simulations in a heterogeneous distributed environment with variable number of processors'. Together they form a unique fingerprint.

  • Cite this

    Sumanth, J. V., Swanson, D. R., & Jiang, H. (2007). Adaptive load-balancing for force-decomposition based 3-body molecular dynamics simulations in a heterogeneous distributed environment with variable number of processors. In 2007 International Conference on Parallel Processing, ICPP [4343831] (Proceedings of the International Conference on Parallel Processing). https://doi.org/10.1109/ICPP.2007.11