A systematic and general machine learning approach to build a consistent data set from different experiments: application to the thermal conductivity of methane

18 December 2024, Version 2
This content is a preprint and has not undergone peer review at the time of posting.

Abstract

Experimental data from different sources present challenges due to variability and noise from various experimental conditions, apparatuses, and environmental factors. In this work, we propose a general method to address these challenges to build a consistent data set. As a case study, we analyze experimental data sets of methane’s thermal conductivity across the liquid, vapor, and supercritical phases. The method is based on machine learning (ML) techniques, which consistently integrate data from various experimental sources compiled by the National Institute of Standards and Technology (NIST) database. Different ML algorithms are used for this purpose. Our findings indicate that ML models yield predictions closer to the NIST’s processed data than to the original raw experimental data used to train the models. This demonstrates the models’ generalization ability from heterogeneous, noisy, and untreated data sets. While our approach does not eliminate preprocessing, it suggests that ML can autonomously handle noisy data, providing a faster and cost-effective alternative to traditional pre- and postprocessing methods. By guiding the refinement of labor-intensive methods, ML proves adaptable for real-time data, enabling immediate adjustments and revolutionizing industrial and scientific optimizations. Therefore, the proposed ML approach is general and efficient in handling complex and heterogeneous data to deliver reliable predictions without extensive preprocessing.

Keywords

Machine Learning
Experimental data sets
Systematic data sets
NIST
Thermal conductivity
Methane

Supplementary materials

Title
Description
Actions
Title
Evaluation of multiple ML models for all physical phases
Description
Supporting information contains the evaluation of multiple ML models for all physical phases. It includes performance metrics for the ML models in the liquid, vapor, and supercritical phases, as well as scatter plots comparing the experimental data with our ML models and NIST data.
Actions

Comments

Comments are not moderated before they are posted, but they can be removed by the site moderators if they are found to be in contravention of our Commenting Policy [opens in a new tab] - please read this policy before you post. Comments should be used for scholarly discussion of the content in question. You can find more information about how to use the commenting feature here [opens in a new tab] .
This site is protected by reCAPTCHA and the Google Privacy Policy [opens in a new tab] and Terms of Service [opens in a new tab] apply.