Atomic Design for MLOps: A Modular Approach to Scalable and Reusable ML Pipelines

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The increasing complexity of machine learning pipelines presents significant challenges in terms of maintainability, scalability, and reusability. This paper explores the application of atomic design principles - widely used in software engineering - to MLOps pipelines, structuring ML workflows into modular and reusable components. By decomposing AI pipelines into hierarchical elements, such as atoms, modules, stages, templates, and pipelines, this approach aims to improve efficiency, reproducibility, and collaboration in machine learning development. We describe the conceptual framework and its implementation in time series applications, including forecasting, classification, and anomaly detection. Preliminary results demonstrate the feasibility of this methodology, highlighting its potential benefits for streamlining ML workflows and reducing development overhead.

Original languageEnglish
Title of host publication2025 10th International Conference on Smart and Sustainable Technologies, SpliTech 2025
EditorsPetar Solic, Sandro Nizetic, Joel J. P. C. Rodrigues, Joel J. P. C. Rodrigues, Joel J.P.C. Rodrigues, Diego Lopez-de-Ipina Gonzalez-de-Artaza, Toni Perkovic, Katarina Vukojevic, Luca Catarinucci, Luigi Patrono
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9789532901429
DOIs
Publication statusPublished - 2025
Event10th International Conference on Smart and Sustainable Technologies, SpliTech 2025 - Split, Croatia
Duration: 16 Jun 202520 Jun 2025

Publication series

Name2025 10th International Conference on Smart and Sustainable Technologies, SpliTech 2025

Conference

Conference10th International Conference on Smart and Sustainable Technologies, SpliTech 2025
Country/TerritoryCroatia
CitySplit
Period16/06/2520/06/25

Keywords

  • Atomic design
  • Machine Learning
  • MLOps
  • Model Deployment

Fingerprint

Dive into the research topics of 'Atomic Design for MLOps: A Modular Approach to Scalable and Reusable ML Pipelines'. Together they form a unique fingerprint.

Cite this