MatteriX

Towards a Digital Twin for Robotics-Assisted Chemistry Lab Automation

Kourosh Darvish1,2,3,*, Arjun Sohal1, Abhijoy Mandal1, Hatem Fakhruldeen4, Nikola Radulov4, Zhengxue Zhou4, Satheeshkumar Veeramani4, Joshua Choi1, Sijie Han1, Brayden Zhang1, Jeeyeoun Chae1, Alex Wright4, Yijie Wang1,2, Hossein Darvish5, Yuchi Zhao1,3, Gary Tom1,3, Han Hao1,2, Miroslav Bogdanovic1,3, Gabriella Pizzuto4, Andrew I. Cooper4, Alán Aspuru Guzik1,2,3,6,7, Florian Shkurti1,3, Animesh Garg8
1University of Toronto   2Acceleration Consortium   3Vector Institute   4University of Liverpool   5University of Salento   6NVIDIA   7Canadian Institute for Advanced Research   8Georgia Institute of Technology
*kourosh.darvish@utoronto.ca

Overview

Accelerated materials discovery is critical for addressing global challenges. However, developing new laboratory workflows relies heavily on real-world experimental trials, and this can hinder scalability because of the need for numerous physical make-and-test iterations. Here, we present MatteriX, a multi-scale, GPU-accelerated robotic simulation framework designed to create high-fidelity digital twins of chemistry labs, thus accelerating workflow development. This multi-scale digital twin simulates robotic physical manipulation, powder and liquid dynamics, device functionalities, heat transfer, and basic chemical reaction kinetics. This is enabled by integrating realistic physics simulation and photorealistic rendering with a modular GPU-accelerated semantics engine, which models logical states and continuous behaviors to simulate chemistry workflows across different levels of abstraction. MatteriX streamlines the creation of digital twin environments through open-source asset libraries and interfaces, while enabling flexible workflow design via hierarchical plan definition and a modular skill library that incorporates learning-based methods. Our approach demonstrates sim-to-real transfer in robotic chemistry setups, reducing reliance on costly real-world experiments and enabling the testing of hypothetical automated workflows in silico.

MatteriX architecture and components overview

Key Features

Multi-Scale Simulation

Extends NVIDIA Isaac Sim's physics engine with a semantics engine for multi-scale workflow simulation. Includes heat transfer and chemical kinetics, with extensible architecture for other domains.

GPU-Parallelized Semantics Engine

Models logical states and continuous behaviors across abstraction levels, running on GPU for efficient parallelization with physics integration.

Particle-Based Simulation

Vectorized simulation of powder and liquid dynamics for realistic modeling of granular materials.

Hierarchical Workflow Design

Build workflows using hierarchical state machines and a skill library combining learning-based and classical methods, vectorized for long-horizon training.

Easy Environment Creation

Library of photorealistic lab assets with support for generating environments from real labs via 3D scanning.

Sim-to-Real Transfer

Demonstrated deployment of robots and automated platforms from simulation to real laboratory settings.

Sim-to-Real Demonstrations

MatteriX enables direct transfer from simulation to real laboratory settings.

Two-Step Reduction-Oxidation Chemistry Experiment (Real and Digital Twin)

Liquid Handling Station with OT-2 and Franka Research 3

Liquid Pouring — Simulation and Real Experiment

Liquid and Powder Handling

Simulating liquid and powder dynamics, pipetting workflows, and teleoperated handling in constrained environments.

Bimanual Teleoperation for Liquid and Powder Handling in a Glovebox

Liquid Handling Station

OT-2 Liquid Handling Functionalities

Liquid Pouring by OT-2 Robot

Robotic Manipulation & Navigation

Robotic arm and mobile robot capabilities for lab automation tasks.

Mobile Robot Transferring Beaker Between Two Stations

Drying Rack with Robot and Beaker

Vial Insertion to a Rack with a Robot

cuRobo Motion Planner — Beaker in Fume Hood

Getting Started

Installation

git clone https://github.com/AccelerationConsortium/Matterix.git
cd Matterix
# Follow installation instructions in README

Quick Example

# Run a basic simulation after installation
python scripts/random_agent.py --task Matterix-Test-Beakers-Franka-v1 --num_envs 1

Citation

@article{darvish2025matterix,
  title={MatteriX: towards a digital twin for robotics-assisted chemistry lab automation},
  author={Darvish, Kourosh and Sohal, Arjun and Mandal, Abhijoy and Fakhruldeen, Hatem and
          Radulov, Nikola and Zhou, Zhengxue and Veeramani, Satheeshkumar and Choi, Joshua and
          Han, Sijie and Zhang, Brayden and Chae, Jeeyeoun and Wright, Alex and Wang, Yijie and
          Darvish, Hossein and Zhao, Yuchi and Tom, Gary and Hao, Han and Bogdanovic, Miroslav and
          Pizzuto, Gabriella and Cooper, Andrew I. and Aspuru-Guzik, Al{\'a}n and
          Shkurti, Florian and Garg, Animesh},
  journal={Nature Computational Science},
  year={2025},
  doi={10.1038/s43588-025-00924-4},
  url={https://www.nature.com/articles/s43588-025-00924-4}
}