General Data Management Workflow to Process Tabular Data in Automated and High throughput Heterogeneous Catalysis Research

01 November 2024, Version 1
This content is a preprint and has not undergone peer review at the time of posting.

Abstract

Data management and processing are crucial steps to implement streamlined and standardized data workflows for automated and high-throughput laboratories. Electronic laboratory notebooks (ELNs) have proven to be effective to manage data in combination with a laboratory information management system (LIMS) to connect data and inventory. However, streamlined data processing does still pose a challenge on an ELN especially with large data. Herein we present a Python library that allows to streamline and automate data management of tabular data generated within a data-driven, automated high-throughput laboratory with a focus on heterogeneous catalysis R&D. This approach speeds up data processing and avoids errors introduced by manual data processing. Through the Python library, raw data from individual instruments related to a project are downloaded from an ELN, merged in a relational database fashion, processed and re-uploaded back to the ELN. Straightforward data merging is especially important, since information stemming from multiple devices needs to be processed together. By providing a configuration file that contain all the data management information, data merging and processing of individual data sources is executed. Having established streamlined data management workflows allows to standardize data handling and contributes to the implementation and use of open research data following Findable, Accessible, Interoperable and Reusable (FAIR) principles in the field of heterogeneous catalysis.

Keywords

Open Research Data
Data Management
Heterogeneous Catalysis
Data Processing

Supplementary materials

Title
Description
Actions
Title
Supporting Information
Description
Additional Information and Figures
Actions
Title
Code Library
Description
Python Code Library for Data Management
Actions
Title
Watcher Script
Description
Python Scripts for Automated Data Upload for Selected Instruments
Actions
Title
Tableau Workbook
Description
Workbook Containing Interactive Visualization Figures
Actions

Comments

Comments are not moderated before they are posted, but they can be removed by the site moderators if they are found to be in contravention of our Commenting Policy [opens in a new tab] - please read this policy before you post. Comments should be used for scholarly discussion of the content in question. You can find more information about how to use the commenting feature here [opens in a new tab] .
This site is protected by reCAPTCHA and the Google Privacy Policy [opens in a new tab] and Terms of Service [opens in a new tab] apply.