DESK: distributed observability framework for edge-based containerized microservices

Muhammad Usman*, Simone Ferlin*, Anna Brunstrom*, Javid Taheri*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Modern information technology (IT) infrastructures are becoming more complex to meet the diverse demands of emerging technology paradigms such as 5G/6G networks, edge, and internet of things (IoT). The intricacy of these infrastructures grows further when hosting containerized workloads as microservices, resulting in the challenge to detect and troubleshoot performance issues, incidents or even outages of critical use cases like industrial automation processes. Thus, fine-grained measurements and associated visualization are essential for operation observability of these IT infrastructures. However, most existing observability tools operate independently without systematically covering the entire data workflow. This paper presents an integrated design for multi-stage observability workflows, denoted as DistributEd obServability frameworK (DESK). The proposed framework aims to improve observability workflows for measurement, collection, fusion, storage, visualization, and notification. As a proof of concept, we deployed the framework in a Kubernetes-based testbed to demonstrate the successful integration of various components and usability of collected observability data. We also conducted a comprehensive study to determine the caused overhead by DESK agents at the reasonably powerful edge node hardware, which shows on average a CPU and memory overhead of around 2.5 % of total available hardware resource.

Original languageEnglish
Title of host publicationProceedings of the 2023 Joint European Conference on Networks and Communications and 6G Summit
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages617-622
Number of pages6
ISBN (Electronic)9798350311020
ISBN (Print)9798350311037
DOIs
Publication statusPublished - 26 Jul 2023
Externally publishedYes
EventJoint European Conference on Networks and Communications and 6G Summit 2023 - Gothenburg, Sweden
Duration: 06 Jun 202309 Jun 2023

Publication series

NameEuropean Conference on Networks and Communications: proceedings
ISSN (Print)2475-6490
ISSN (Electronic)2575-4912

Conference

ConferenceJoint European Conference on Networks and Communications and 6G Summit 2023
Abbreviated titleEuCNC/6G Summit 2023
Country/TerritorySweden
CityGothenburg
Period06/06/202309/06/2023

Keywords

  • 5G/6G
  • Edge Computing
  • Internet of Things (IoT)
  • Microservices
  • Monitoring
  • Observability

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications
  • Hardware and Architecture
  • Signal Processing
  • Safety, Risk, Reliability and Quality
  • Instrumentation

Fingerprint

Dive into the research topics of 'DESK: distributed observability framework for edge-based containerized microservices'. Together they form a unique fingerprint.

Cite this