Humanoid Mobility via Attention-based Contacts
Abstract
Humanoid mobility over complex terrain requires accurate foot placement and coordinated whole-body motion capable of robust adaptation. Reinforcement learning (RL) policies trained without motion references generalize well across terrains, yet eliciting effective whole-body coordination through reward design and exploration alone remains challenging. In contrast, reference-based methods yield natural motions but struggle to adapt beyond the predefined trajectories in their training data. We introduce a learning framework that bridges these two approaches by using motion data strictly as a training prior. An explicit, self-supervised, attention-based contact planner predicts future body-environment contacts, while a contact-conditioned tracker translates these plans into coordinated whole-body motion. Together, they establish contact as an interface between sensory observations and control actions. This abstraction allows the policy to internalize the contact-aware structure of locomotion rather than directly replicating kinematics. Consequently, a single policy can exploit data-driven motion priors for natural whole-body coordination while retaining the flexibility to discover environment-dependent behaviors through reinforcement learning. Building on the learned contact planner and tracker, a subsequent fine-tuning stage bootstraps their acquired capabilities to explore environment variations beyond those covered by the original motion data. Operating entirely from onboard observations without any reference inputs at deployment, this framework enables versatile humanoid mobility in challenging environments.
The following analysis is generated by AI and may contain errors. It is separate from the authors’ abstract and is not peer review.
Research summary
The paper introduces a contact-centric framework for humanoid mobility that uses attention-based planning to predict body-environment interactions, enabling a single policy to generalize across diverse terrains and skills without reference motions at deployment. This represents a significant step forward in humanoid control by decoupling contact planning from whole-body execution, allowing for more robust and adaptable behaviors in complex environments.
Methodology
The paper proposes a novel framework for humanoid mobility that decouples the "what" (contact planning) from the "how" (whole-body tracking). The core innovation is the use of an attention-based mechanism to predict explicit contact locations on a terrain map, serving as an intermediate representation between perception and control. This is a significant conceptual shift from prior work that either relies on full-body trajectory tracking (which lacks generalization) or pure RL (which struggles with complex reward shaping for whole-body coordination). The three-stage training pipeline (Tracker Pretraining, Planner Supervision, RL Fine-tuning) is well-structured and logically sound, effectively leveraging motion data as a prior without binding the deployment policy to specific trajectories. The use of FiLM modulation for body-specific attention queries is a clever architectural choice that allows a single network to handle multiple contact points.
Results & evaluation
The experimental evaluation is robust and comprehensive. The authors conduct extensive real-world experiments on the Unitree G1 robot, demonstrating a wide variety of skills including ladder climbing, crawling, vaulting, and failure recovery. The simulation-based ablations are rigorous, isolating the contributions of the contact representation, the attention mechanism, and the RL fine-tuning stage. The comparison with MGMT (a strong baseline using diffusion-based motion generation) shows clear advantages in success rates and contact placement accuracy, particularly on sparse terrains. The qualitative comparisons with other methods (PHP, LLP) are fair and highlight the unique capabilities of the proposed approach. The inclusion of failure recovery experiments is a strong point, demonstrating the robustness of the learned policy.
Reproducibility
The paper provides detailed descriptions of the network architectures, training procedures, and reward functions. The use of standard components (MLP trackers, attention planners, PD control) makes the method relatively accessible to reproduce. However, the specific details of the motion retargeting pipeline and the LiDAR mapping framework are described at a high level, which might make exact reproduction challenging without access to the code. The lack of a public code repository at the time of review (arXiv preprint) is a minor drawback, but the methodological details are sufficient for a skilled researcher to implement a similar system.
Limitations
The paper acknowledges several limitations. The current perception is limited to 2.5D terrain maps, which restricts the system's ability to handle overhead contacts or complex 3D manipulation. The system is designed for local goal-conditioned locomotion and does not address global navigation. The contact representation cannot distinguish between motions with identical contact sequences but different kinematics (e.g., backflip vs. vertical jump). These are reasonable limitations for the current scope, but they highlight areas for future work.
Broader impact
This paper has significant potential impact on the field of humanoid robotics. By establishing contact as a general interface for mobility, it provides a scalable framework for adding new skills to humanoid robots without requiring exhaustive manual augmentation of motion datasets. The approach bridges the gap between data-driven imitation and reward-driven exploration, offering a path toward more versatile and robust humanoid control. The insights gained from this work could be applied to other robotic systems that require complex whole-body coordination, such as quadrupeds or manipulators. The paper introduces a contact-centric framework for humanoid mobility that uses attention-based planning to predict body-environment interactions, enabling a single policy to generalize across diverse terrains and skills without reference motions at deployment. This represents a significant step forward in humanoid control by decoupling contact planning from whole-body execution, allowing for more robust and adaptable behaviors in complex environments.
Author of this paper? Send a correction.