Modular Adaptive Processing Infrastructure (MAPI): a blueprint for interconnecting generic workflows with modern interfaces

模块化自适应处理基础设施 (MAPI):将通用工作流程与现代接口互连的蓝图

阅读:1

Abstract

In this paper, we introduce the Modular Adaptive Processing Infrastructure (MAPI), a comprehensive software suite and approach designed to streamline and enhance data analysis workflows in scientific research laboratories. MAPI selects and integrates multiple frameworks and toolkits into a web-based platform, offering a highly modular and adaptable solution for diverse data analysis requirements. By design, MAPI supports distributed processing across heterogeneous backends (edge workstations, on-premises servers, high-performance computing and public cloud), making it suitable for various beamlines and data-processing labs. This blueprint, or `recipe', provides a flexible infrastructure that can be tailored to specific experimental needs. We showcase MAPI's application through its successful implementation on the X-ray computed tomography (CT) beamline, resulting in a system for tomographic processing (STP3). The case study demonstrates MAPI's effectiveness in meeting complex computational demands, highlighting its potential for widespread adoption in scientific research environments. Most of the results reported in the paper are from a production deployment on Elettra's SYRMEP beamline using two on-premises GPU servers, but two additional ongoing deployments on different beamlines are discussed.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。