Long live the image: container-native data persistence in production

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)
17 Downloads (Pure)

Abstract

Containerization plays a crucial role in the de facto technology stack for implementing microservices architecture (each microservice has its own database in most cases). Nevertheless, there are still fierce debates on containerizing production databases, mainly due to the data persistence issues and concerns. Driven by a project of refactoring an Automated Machine Learning system, this research proposes the container-native data persistence as a conditional solution to running database containers in production. In essence, the proposed solution distinguishes the stateless data access (i.e. reading) from the stateful data processing (i.e. creating, updating, and deleting) in databases. A master database handles the stateful data processing and dumps database copies for building container images, while the database containers will keep stateless at runtime, based on the preloaded dump in the image. Although there are delays in the state/image update propagation, this solution is particularly suitable for the read-only, the eventual consistency, and the asynchronous processing scenarios. Moreover, with optimal tuning (e.g., disabling locking), the portability and performance gains of a read-only database container would outweigh the performance loss in accessing data across the underlying image layers.

Original languageEnglish
Title of host publicationProceedings of the 2021 IEEE 18th International Conference on Software Architecture Companion, ICSA-C 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages82-85
ISBN (Electronic)9781665439107
ISBN (Print)9780738133560
DOIs
Publication statusPublished - 10 May 2021
Externally publishedYes
Event18th IEEE International Conference on Software Architecture Companion, ICSA-C 2021 - Virtual, Stuttgart, Germany
Duration: 22 Mar 202126 Mar 2021

Publication series

NameProceedings: IEEE International Conference on Software Architecture Companion, ICSA-C

Conference

Conference18th IEEE International Conference on Software Architecture Companion, ICSA-C 2021
Country/TerritoryGermany
CityVirtual, Stuttgart
Period22/03/202126/03/2021

Keywords

  • container
  • data persistence
  • database
  • microservice
  • microservices architecture

ASJC Scopus subject areas

  • Hardware and Architecture
  • Software

Fingerprint

Dive into the research topics of 'Long live the image: container-native data persistence in production'. Together they form a unique fingerprint.

Cite this