Hierarchical Transfer Learning: An Agile and Equitable Strategy for Machine-Learning Interatomic Models

22 May 2024, Version 1
This content is a preprint and has not undergone peer review at the time of posting.


Machine-learned interatomic models have growing in popularity due to their ability to afford near quantum-accurate predictions for complex phenomena, with orders-of-magnitude greater computational efficiency. However, these models struggle when applied to systems of many element types due to the near exponential increase in number of parameters that must be determined. To mitigate this challenge, we present a new hierarchical transfer learning approach that allows the fitting problem to be decomposed into smaller independent and reusable parameter blocks that enable development of explicitly chemically extensible ML- IAM. Application of this strategy is demonstrated for C and N mixtures under conditions ranging from nominally ambient to approximately 10,000 K and 200 GPa, and compositions from 0 to 100 % N. Ultimately, this strategy makes model generation for chemically complex systems more tractable and efficient, facilitates comprehensive model validation, and makes ML-IAM development for problems of this nature more accessible to users with limited access to extreme computing infrastructure.


machine learning
interatomic potential
transfer learning

Supplementary materials

Supplementary Information
Additional validation for the models developed in this work


Comments are not moderated before they are posted, but they can be removed by the site moderators if they are found to be in contravention of our Commenting Policy [opens in a new tab] - please read this policy before you post. Comments should be used for scholarly discussion of the content in question. You can find more information about how to use the commenting feature here [opens in a new tab] .
This site is protected by reCAPTCHA and the Google Privacy Policy [opens in a new tab] and Terms of Service [opens in a new tab] apply.