TOWARDS THE AUTOMATION OF DATA SPACE PRODUCTS THROUGH QUALITY DATA PIPELINES

As data becomes a valuable asset for organizations, the challenge is no longer gathering vast amounts of information but refining and managing it to generate value. To this end, there is a growing importance of transforming raw data into high-quality data products within Data Spaces, which are critical components of modern digital ecosystems. The complexity lies not only in the diversity of data sources, formats, and systems but also in the need for data products to remain adaptable and interoperable across various environments. On top of this, Data Spaces often require strict adherence to specific syntaxes and structures. In addition, poor data quality undermines trust and decision-making, and the lack of clear frameworks for processing and consuming data products within these spaces adds technical overhead. The main contribution of this manuscript is a reference architecture designed to facilitate the creation of high-quality, interoperable data products within Data Spaces. Additional contributions include an analysis of the required data types to ensure compatibility with real-world use cases, as well as addressing issues related to data quality, interoperability, and technical integration. The paper concludes with a discussion of future works and potential improvements.