RealDex UMI

RealDex UMI is a wearable manipulation interface that records human hand and wrist demonstrations using hardware matched to the deployed robot end effector. In-hand cameras, fingertip tactile sensors and pose tracking capture visual, contact and movement information during physical tasks.

The matched collection and robot hardware reduce the geometric gap between the demonstration and deployed system. Data are used for imitation-learning policies across grasping, tool use and contact-rich manipulation. BeingBeyond supplies the interface, matched hardware and software workflow for research and data collection.