DocLite: A Docker-Based Lightweight Cloud Benchmarking Tool

Blesson Varghese, Lawan Thamsuhang Subba, Long Thai, Adam Barker

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Citations (Scopus)
528 Downloads (Pure)


Existing benchmarking methods are time consuming processes as they typically benchmark the entire Virtual Machine (VM) in order to generate accurate performance data, making them less suitable for real-time analytics. The research in this paper is aimed to surmount the above challenge by presenting DocLite - Docker Container-based Lightweight benchmarking tool. DocLite explores lightweight cloud benchmarking methods for rapidly executing benchmarks in near real-time. DocLite is built on the Docker container technology, which allows a user-defined memory size and number of CPU cores of the VM to be benchmarked. The tool incorporates two benchmarking methods - the first referred to as the native method employs containers to benchmark a small portion of the VM and generate performance ranks, and the second uses historic benchmark data along with the native method as a hybrid to generate VM ranks. The proposed methods are evaluated on three use-cases and are observed to be up to 91 times faster than benchmarking the entire VM. In both methods, small containers provide the same quality of rankings as a large container. The native method generates ranks with over 90% and 86% accuracy for sequential and parallel execution of an application compared against benchmarking the whole VM. The hybrid method did not improve the quality of the rankings significantly.
Original languageEnglish
Title of host publication16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), 2016. Acceptance Rate: 20%
Place of PublicationCartagena, Colombia
PublisherInstitute of Electrical and Electronics Engineers Inc.
Number of pages10
Publication statusPublished - 21 Jul 2016
Event16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing - Cartagena, Colombia
Duration: 16 May 201619 May 2016


Conference16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing

Bibliographical note

Acceptance rate: 20%


Dive into the research topics of 'DocLite: A Docker-Based Lightweight Cloud Benchmarking Tool'. Together they form a unique fingerprint.

Cite this