A Capabilities-Aware Framework for Using Computational Accelerators in Data-Intensive Computing

M. Mustafa Rafique, Ali R. Butt, Dimitrios S. Nikolopoulos

Research output: Contribution to journalArticlepeer-review

16 Citations (Scopus)
9 Downloads (Pure)

Abstract

Multicore computational accelerators such as GPUs are now commodity components for highperformance computing at scale. While such accelerators have been studied in some detail as stand-alone computational engines, their integration in large-scale distributed systems raises new challenges and trade-offs. In this paper, we present an exploration of resource management alternatives for building asymmetric accelerator-based distributed systems. We present these alternatives in the context of a capabilities-aware framework for data-intensive computing, which uses an enhanced implementation of the MapReduce programming model for accelerator-based clusters, compared to the state of the art. The framework can transparently utilize heterogeneous accelerators for deriving high performance with low programming effort. Our work is the first to compare heterogeneous types of accelerators, GPUs and a Cell processors, in the same environment and the first to explore the trade-offs between compute-efficient and control-efficient accelerators on data-intensive systems. Our investigation shows that our framework scales well with the number of different compute nodes. Furthermore, it runs simultaneously on two different types of accelerators, successfully adapts to the resource capabilities, and performs 26.9% better on average than a static execution approach.
Original languageEnglish
Pages (from-to)185-197
Number of pages13
JournalJournal of Parallel and Distributed Computing
Volume71
Issue number2
DOIs
Publication statusPublished - Feb 2011

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Networks and Communications
  • Hardware and Architecture
  • Software
  • Theoretical Computer Science

Fingerprint

Dive into the research topics of 'A Capabilities-Aware Framework for Using Computational Accelerators in Data-Intensive Computing'. Together they form a unique fingerprint.

Cite this