The VINEYARD integrated framework for hardware accelerators in the cloud

Christoforos Kachris; Dimitrios Soudris; Stelios Mavridis; Manolis Pavlidakis; Christi Symeonidou; Christos Kozanitis; Angelos Bilas; Damon Fenacci; Sharatchandra Varma Bogaraju; Hans Vandierendonck; Dimitrios S. Nikolopoulos

doi:10.1145/3229631.3236093

The VINEYARD integrated framework for hardware accelerators in the cloud

Christoforos Kachris, Dimitrios Soudris, Stelios Mavridis, Manolis Pavlidakis, Christi Symeonidou, Christos Kozanitis, Angelos Bilas, Damon Fenacci, Sharatchandra Varma Bogaraju, Hans Vandierendonck, Dimitrios S. Nikolopoulos

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Emerging cloud applications like machine learning, AI and big data analytics required high performance computing systems that can sustain the increased amount of data processing without consuming excessive power. Towards this end, many cloud operators have started deploying hardware accelerators, like FPGAs, to increase the performance of computational intensive tasks but increasing the programming complexity to utilize these accelerators. VINEYARD has developed an efficient framework that allows the seamless deployment and utilization of hardware accelerators in the cloud without increasing the programming complexity and offering the flexibility of software packages. This paper presents the main components that have been developed in this framework such as the runtime system, the virtualization and the central acceleratorsŹ repository. The proposed platform has been demonstrated into 2 real use cases; neurocomputing applications and machine learning algorithms. The performance evaluation shows that the proposed scheme can achieve up to 25x speedup without increasing the programming complexity of these applications and it also demonstrates how it can be used for large suite of applications.

Original language	English
Title of host publication	Proceedings - 2018 International Conference on Embedded Computer Systems
Subtitle of host publication	Architectures, Modeling and Simulation, SAMOS 2018
Editors	Trevor Mudge, Dionisios N. Pnevmatikatos
Publisher	Association for Computing Machinery
Pages	236-243
Number of pages	8
ISBN (Electronic)	9781450364942
DOIs	https://doi.org/10.1145/3229631.3236093
Publication status	Published - 15 Jul 2018
Externally published	Yes
Event	18th Annual International conference on Embedded Computer Systems: Architectures, MOdeling and Simulation, SAMOS 2018 - Samos, Greece Duration: 15 Jul 2018 → 19 Jul 2018

Conference

Conference	18th Annual International conference on Embedded Computer Systems: Architectures, MOdeling and Simulation, SAMOS 2018
Country/Territory	Greece
City	Samos
Period	15/07/2018 → 19/07/2018

Keywords

Cloud computing
FPGAs
Hardware accelerators
Machine learning
Reconfigurable computing

ASJC Scopus subject areas

Human-Computer Interaction
Computer Networks and Communications
Computer Vision and Pattern Recognition
Software

Access to Document

10.1145/3229631.3236093

Cite this

Kachris, C., Soudris, D., Mavridis, S., Pavlidakis, M., Symeonidou, C., Kozanitis, C., Bilas, A., Fenacci, D., Bogaraju, S. V., Vandierendonck, H., & Nikolopoulos, D. S. (2018). The VINEYARD integrated framework for hardware accelerators in the cloud. In T. Mudge, & D. N. Pnevmatikatos (Eds.), Proceedings - 2018 International Conference on Embedded Computer Systems: Architectures, Modeling and Simulation, SAMOS 2018 (pp. 236-243). Association for Computing Machinery. https://doi.org/10.1145/3229631.3236093

Kachris, Christoforos ; Soudris, Dimitrios ; Mavridis, Stelios et al. / The VINEYARD integrated framework for hardware accelerators in the cloud. Proceedings - 2018 International Conference on Embedded Computer Systems: Architectures, Modeling and Simulation, SAMOS 2018. editor / Trevor Mudge ; Dionisios N. Pnevmatikatos. Association for Computing Machinery, 2018. pp. 236-243

@inproceedings{89eaa1bb3bb540fa83a330fae10ad81b,

title = "The VINEYARD integrated framework for hardware accelerators in the cloud",

abstract = "Emerging cloud applications like machine learning, AI and big data analytics required high performance computing systems that can sustain the increased amount of data processing without consuming excessive power. Towards this end, many cloud operators have started deploying hardware accelerators, like FPGAs, to increase the performance of computational intensive tasks but increasing the programming complexity to utilize these accelerators. VINEYARD has developed an efficient framework that allows the seamless deployment and utilization of hardware accelerators in the cloud without increasing the programming complexity and offering the flexibility of software packages. This paper presents the main components that have been developed in this framework such as the runtime system, the virtualization and the central accelerators{\'Z} repository. The proposed platform has been demonstrated into 2 real use cases; neurocomputing applications and machine learning algorithms. The performance evaluation shows that the proposed scheme can achieve up to 25x speedup without increasing the programming complexity of these applications and it also demonstrates how it can be used for large suite of applications.",

keywords = "Cloud computing, FPGAs, Hardware accelerators, Machine learning, Reconfigurable computing",

author = "Christoforos Kachris and Dimitrios Soudris and Stelios Mavridis and Manolis Pavlidakis and Christi Symeonidou and Christos Kozanitis and Angelos Bilas and Damon Fenacci and Bogaraju, {Sharatchandra Varma} and Hans Vandierendonck and Nikolopoulos, {Dimitrios S.}",

year = "2018",

month = jul,

day = "15",

doi = "10.1145/3229631.3236093",

language = "English",

pages = "236--243",

editor = "Trevor Mudge and Pnevmatikatos, {Dionisios N.}",

booktitle = "Proceedings - 2018 International Conference on Embedded Computer Systems",

publisher = "Association for Computing Machinery",

address = "United States",

note = "18th Annual International conference on Embedded Computer Systems: Architectures, MOdeling and Simulation, SAMOS 2018 ; Conference date: 15-07-2018 Through 19-07-2018",

}

Kachris, C, Soudris, D, Mavridis, S, Pavlidakis, M, Symeonidou, C, Kozanitis, C, Bilas, A, Fenacci, D, Bogaraju, SV, Vandierendonck, H & Nikolopoulos, DS 2018, The VINEYARD integrated framework for hardware accelerators in the cloud. in T Mudge & DN Pnevmatikatos (eds), Proceedings - 2018 International Conference on Embedded Computer Systems: Architectures, Modeling and Simulation, SAMOS 2018. Association for Computing Machinery, pp. 236-243, 18th Annual International conference on Embedded Computer Systems: Architectures, MOdeling and Simulation, SAMOS 2018, Samos, Greece, 15/07/2018. https://doi.org/10.1145/3229631.3236093

The VINEYARD integrated framework for hardware accelerators in the cloud. / Kachris, Christoforos; Soudris, Dimitrios; Mavridis, Stelios et al.
Proceedings - 2018 International Conference on Embedded Computer Systems: Architectures, Modeling and Simulation, SAMOS 2018. ed. / Trevor Mudge; Dionisios N. Pnevmatikatos. Association for Computing Machinery, 2018. p. 236-243.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - The VINEYARD integrated framework for hardware accelerators in the cloud

AU - Kachris, Christoforos

AU - Soudris, Dimitrios

AU - Mavridis, Stelios

AU - Pavlidakis, Manolis

AU - Symeonidou, Christi

AU - Kozanitis, Christos

AU - Bilas, Angelos

AU - Fenacci, Damon

AU - Bogaraju, Sharatchandra Varma

AU - Vandierendonck, Hans

AU - Nikolopoulos, Dimitrios S.

PY - 2018/7/15

Y1 - 2018/7/15

N2 - Emerging cloud applications like machine learning, AI and big data analytics required high performance computing systems that can sustain the increased amount of data processing without consuming excessive power. Towards this end, many cloud operators have started deploying hardware accelerators, like FPGAs, to increase the performance of computational intensive tasks but increasing the programming complexity to utilize these accelerators. VINEYARD has developed an efficient framework that allows the seamless deployment and utilization of hardware accelerators in the cloud without increasing the programming complexity and offering the flexibility of software packages. This paper presents the main components that have been developed in this framework such as the runtime system, the virtualization and the central acceleratorsŹ repository. The proposed platform has been demonstrated into 2 real use cases; neurocomputing applications and machine learning algorithms. The performance evaluation shows that the proposed scheme can achieve up to 25x speedup without increasing the programming complexity of these applications and it also demonstrates how it can be used for large suite of applications.

AB - Emerging cloud applications like machine learning, AI and big data analytics required high performance computing systems that can sustain the increased amount of data processing without consuming excessive power. Towards this end, many cloud operators have started deploying hardware accelerators, like FPGAs, to increase the performance of computational intensive tasks but increasing the programming complexity to utilize these accelerators. VINEYARD has developed an efficient framework that allows the seamless deployment and utilization of hardware accelerators in the cloud without increasing the programming complexity and offering the flexibility of software packages. This paper presents the main components that have been developed in this framework such as the runtime system, the virtualization and the central acceleratorsŹ repository. The proposed platform has been demonstrated into 2 real use cases; neurocomputing applications and machine learning algorithms. The performance evaluation shows that the proposed scheme can achieve up to 25x speedup without increasing the programming complexity of these applications and it also demonstrates how it can be used for large suite of applications.

KW - Cloud computing

KW - FPGAs

KW - Hardware accelerators

KW - Machine learning

KW - Reconfigurable computing

UR - http://www.scopus.com/inward/record.url?scp=85061010301&partnerID=8YFLogxK

U2 - 10.1145/3229631.3236093

DO - 10.1145/3229631.3236093

M3 - Conference contribution

AN - SCOPUS:85061010301

SP - 236

EP - 243

BT - Proceedings - 2018 International Conference on Embedded Computer Systems

A2 - Mudge, Trevor

A2 - Pnevmatikatos, Dionisios N.

PB - Association for Computing Machinery

T2 - 18th Annual International conference on Embedded Computer Systems: Architectures, MOdeling and Simulation, SAMOS 2018

Y2 - 15 July 2018 through 19 July 2018

ER -

Kachris C, Soudris D, Mavridis S, Pavlidakis M, Symeonidou C, Kozanitis C et al. The VINEYARD integrated framework for hardware accelerators in the cloud. In Mudge T, Pnevmatikatos DN, editors, Proceedings - 2018 International Conference on Embedded Computer Systems: Architectures, Modeling and Simulation, SAMOS 2018. Association for Computing Machinery. 2018. p. 236-243 doi: 10.1145/3229631.3236093

The VINEYARD integrated framework for hardware accelerators in the cloud

Abstract

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this