AIRoA-0: Long-Horizon, Precise, Cross-Embodiment Manipulation from Handheld Data
Abstract
AIRoA-0 (A-0) is a bimanual manipulation system learned from 16,151 hours of handheld demonstrations, with no robot data collected at any stage. The demonstrations are recorded with YUBI, our open-source handheld gripper, which lets people record manipulation data anywhere with no robot present. From a single instruction, A-0 sorts more than a dozen small parts into their numbered cells and changes the mop pads and brush of a robot vacuum; among other tasks, it unzips a pencil case and folds a towel. It performs these tasks using only a camera on each wrist, with no head or scene camera, at a site where none of its training data was recorded. Across the ten tasks of our evaluation, it averages a success rate of 78%, against 27% for the strongest of four other vision-language-action models post-trained on the same task demonstrations. We collect no teleoperation data and use no reinforcement learning or on-robot corrections, and the robot appears only at test time. The system learns which regions of each wrist view matter for the task, predicts the stage the task has reached, and decodes actions as a continuous stream. A-0 is embodiment-agnostic: it runs on robots that mount the YUBI gripper, such as a bimanual Franka, TX-G2, OpenArm and UR. We are releasing the dataset, to our knowledge the largest open dataset of handheld-gripper demonstrations with task and subtask instructions, together with the pre-trained weights and the post-training recipe. Videos of A-0 on every task are on the project page, https://a-0.airoa.io. Anyone can build the gripper, record a task of their own and post-train the model on it in under four hours on a single node of eight H200 GPUs.
The following analysis is generated by AI and may contain errors. It is separate from the authors’ abstract and is not peer review.
Research summary
The paper presents AIRoA-0, a bimanual manipulation system trained exclusively on 16,151 hours of handheld gripper data, achieving state-of-the-art performance on long-horizon tasks with high generalization to unseen sites and robot embodiments, thereby validating the scalability and effectiveness of human-centric data collection for robotic learning.
Methodology
The paper introduces AIRoA-0 (A-0), a bimanual manipulation system that leverages a large-scale dataset of handheld gripper demonstrations (YUBI) to train a vision-language-action model without any robot-specific data. The methodology is robust, utilizing a "See Less, Specify More" (S2) objective with a visual evidence budget gate to focus attention on relevant regions of the wrist camera views. Key innovations include the use of anchored actions relative to the gripper pose to ensure embodiment agnosticism, a stage prediction head to handle long-horizon task ambiguity, and a non-uniform streaming decoding scheme for continuous, low-latency action generation. The integration of proprioceptive memory and the specific handling of language at both task and subtask levels are well-designed components that address the challenges of learning from human-centric data.
Results & evaluation
The experimental evaluation is strong, demonstrating a 78% success rate on ten complex bimanual tasks, significantly outperforming four other state-of-the-art VLA models (27% average). The evaluation is conducted at a site where no training data was recorded, highlighting the system's generalization capabilities. The paper also demonstrates embodiment agnosticism by running the same weights on four different robot platforms (Franka, TX-G2, OpenArm, UR). The inclusion of scaling laws for pre-training data and the robustness to scene disturbances (e.g., moving bins) further strengthens the empirical claims.
Reproducibility
The paper claims high reproducibility by releasing the full dataset (16,151 hours), pre-trained weights, post-training recipe, and the open-source YUBI gripper design. The claim that post-training can be done in under four hours on a single node of eight H200 GPUs is a significant contribution to accessibility. However, the specific hardware requirements for data collection and the exact implementation details of the "visual evidence budget" gate are described at a high level, which may pose challenges for full replication without the provided code.
Limitations
The system relies heavily on the specific YUBI gripper for data collection and deployment, which may limit immediate adoption by labs without access to this hardware. The evaluation, while strong, is limited to ten specific tasks, and the generalization to completely novel task categories or objects outside the training distribution is not extensively explored. The reliance on wrist cameras only, while a strength for embodiment agnosticism, limits the field of view and may struggle with tasks requiring global scene understanding.
Broader impact
This work has significant broader impact by demonstrating that large-scale, high-quality manipulation data can be collected without robots, lowering the barrier to entry for training advanced manipulation policies. The release of the dataset and tools could accelerate research in robotic manipulation and embodied AI. The embodiment-agnostic nature of the system suggests potential for widespread deployment across different robot platforms, promoting standardization in the field. The paper presents AIRoA-0, a bimanual manipulation system trained exclusively on 16,151 hours of handheld gripper data, achieving state-of-the-art performance on long-horizon tasks with high generalization to unseen sites and robot embodiments, thereby validating the scalability and effectiveness of human-centric data collection for robotic learning.
Author of this paper? Send a correction.