The Rise of the AI Scientist: Unleashing the Potential of Chat-GPT Powered Avatars in Virtual Reality Digital-twin Laboratories

28 November 2023, Version 1
This content is a preprint and has not undergone peer review at the time of posting.


Digital twin laboratories, accessible via the use of low-cost and portable virtual reality (VR) headsets, have emerged as an immensely powerful tool for chemical education and research collaboration. Having an immersive environment identical to that of a laboratory can provide scientists with a unique platform in which to plan future experiments, conduct laboratory tours, and train on specialist equipment. However, what digital twin laboratories currently lack is on-hand support of co-workers to assist with tasks such as locating chemicals, aiding with machine set-up, and issuing reminders regarding local laboratory health and safety rules Here we show how this key gap can be overcome with the use of knowledge-loaded Chat-GPT avatars in VR. We trained three different chat avatars to perform specialist functions crucial to working in a laboratory and obtained accurate and useful responses in up to 95% of cases, using a range of evaluation metrics including Human Evaluation, Set-Based F1 Scoring, and BERTScore. Our findings demonstrate the vast potential of this technology in harnessing the capabilities of AI assistants for scientists and enhancing immersive digital twin environments within VR settings.


digital twin
virtual reality

Supplementary materials

Supplementary information VR and AI paper
This paper covers the relative scoring and details of the AI responses

Supplementary weblinks


Comments are not moderated before they are posted, but they can be removed by the site moderators if they are found to be in contravention of our Commenting Policy [opens in a new tab] - please read this policy before you post. Comments should be used for scholarly discussion of the content in question. You can find more information about how to use the commenting feature here [opens in a new tab] .
This site is protected by reCAPTCHA and the Google Privacy Policy [opens in a new tab] and Terms of Service [opens in a new tab] apply.