Ropedia W0: Scaling Loco-Manipulation World Models across Embodiments with Human Experience
Abstract
World models enable embodied agents to anticipate action consequences, yet jointly modeling locomotion and manipulation across diverse embodiments remains challenging due to heterogeneous action spaces and limited multimodal supervision. We present Ropedia W0, the first egocentric loco-manipulation world foundation model spanning humans and robots with diverse embodiments. We curate Xp-Data, comprising 10k hours of egocentric human data and 3k hours of robot data with unified multimodal annotations and systematic quality control. A unified kinematic representation encodes locomotion through camera poses and manipulation through projected skeletons, with robot skeletons combining embodiment-specific forward kinematics with extensive manual keypoint annotation and correction. We also introduce Xp-Teleop, a long-horizon loco-manipulation benchmark based on high-quality dexterous humanoid teleoperation data. Evaluations demonstrate state-of-the-art performance across five cross-embodiment benchmarks (DreamDojo, $Ψ_0$, $ω$-HOME, Xp-Teleop, and AgiBot) and on held-out human egocentric video, from zero-shot inference to few-shot and full-data post-training. Scaling human pre-training data improves performance on both human and robot evaluations. After distillation, our model supports real-time, minute-long rollouts, enabling live VR interaction. Applications in policy evaluation, model-based planning, and world-action modeling further demonstrate the model's utility for embodied decision-making.
The following analysis is generated by AI and may contain errors. It is separate from the authors’ abstract and is not peer review.
Research summary
Ropedia W0 introduces a cross-embodiment world foundation model that unifies human and robot loco-manipulation through a shared kinematic representation, demonstrating that scaling human egocentric data significantly improves robot world model performance. The paper makes a substantial contribution by addressing the heterogeneity of action spaces in embodied AI, providing a rigorous evaluation across multiple benchmarks, and introducing a new long-horizon teleoperation benchmark, thereby establishing a new paradigm for leveraging human data in robotic world modeling.
Methodology
The paper proposes Ropedia W0, a world foundation model for loco-manipulation. The core methodological contribution is the unification of heterogeneous action spaces (human locomotion vs. robot manipulation) into a single kinematic representation. Specifically, it encodes locomotion via camera poses and manipulation via projected skeletons. For robots, this involves combining embodiment-specific forward kinematics with manual keypoint annotation. The model is trained on Xp-Data, a massive dataset of 10k hours of human and 3k hours of robot egocentric video. The approach leverages the abundance of human data to pre-train the world model, hypothesizing that human loco-manipulation dynamics transfer to robots. This is a significant architectural and data-engineering choice, moving away from purely robot-centric world models to a cross-embodiment paradigm.
Results & evaluation
The experimental section is extensive, evaluating the model on five cross-embodiment benchmarks: DreamDojo, $\Psi_0$, $\omega$-HOME, Xp-Teleop (a new benchmark introduced in the paper), and AgiBot. The paper demonstrates state-of-the-art performance in video prediction quality. Crucially, it validates the scaling hypothesis: increasing human pre-training data improves performance on both human and robot evaluations. The introduction of Xp-Teleop, a long-horizon benchmark based on dexterous humanoid teleoperation, is a valuable contribution to the field. The model's ability to support real-time, minute-long rollouts after distillation is a strong practical result, enabling live VR interaction.
Reproducibility
Reproducibility is likely limited due to the scale of the data (13k hours of video) and the complexity of the manual annotation pipeline for robot skeletons. While the project page is provided, the specific details of the "systematic quality control" and the exact architecture of the world model (e.g., transformer variants, latent space dimensions) would need to be in the full text/appendix to be fully reproducible by smaller labs. The reliance on proprietary or large-scale in-house data makes independent verification difficult.
Limitations
The primary limitation is the heavy reliance on manual keypoint annotation and correction for robot skeletons, which is labor-intensive and may not scale easily to new embodiments without significant human effort. The model's performance on out-of-distribution embodiments or tasks not covered by the 13k hours of data is not fully explored. Additionally, the "unified kinematic representation" may struggle with highly dexterous or non-rigid manipulations that are difficult to capture with standard skeletons.
Broader impact
This work has high potential impact on the field of embodied AI and robotics. By demonstrating that human video can effectively pre-train robot world models, it offers a pathway to overcome the data scarcity problem in robotics. The introduction of a cross-embodiment benchmark (Xp-Teleop) and a scalable world model architecture could accelerate research in model-based planning and policy evaluation. The real-time capability opens doors for interactive simulation and VR-based robot training. Ropedia W0 introduces a cross-embodiment world foundation model that unifies human and robot loco-manipulation through a shared kinematic representation, demonstrating that scaling human egocentric data significantly improves robot world model performance. The paper makes a substantial contribution by addressing the heterogeneity of action spaces in embodied AI, providing a rigorous evaluation across multiple benchmarks, and introducing a new long-horizon teleoperation benchmark, thereby establishing a new paradigm for leveraging human data in robotic world modeling.
Author of this paper? Send a correction.