PointWalker: Mapless Quadruped Locomotion Directly From Raw LiDAR Point Clouds
Abstract
Quadruped robots deployed for inspection and field missions must cross heterogeneous terrain, from stairs, slopes, and gaps to high platforms, stepping stones, and balance beams, where safe support is sparse or see-through. Existing methods interpose a terrain map or a depth image between sensing and control. Maps are costly to maintain, corrupted by odometry drift and outliers, and misled by see-through gratings, while depth cameras degrade with lighting and surface material. In this paper, we present PointWalker, a mapless framework whose single reinforcement learning policy directly consumes raw point clouds from four light detection and ranging (LiDAR) sensors. Voxelized points are encoded by linear self-attention and fused with proprioception through cross-attention, so terrain geometry reaches the policy without maps or foothold estimation. One proximal policy optimization (PPO) run, with terrain-aware rewards and dual-channel simulation of see-through gratings, yields one policy for all seven terrain classes with a 90.1% mean success rate in simulation. Deployed zero-shot on a Deep Robotics X30 at 50 Hz onboard, it crosses 0.8-m gaps, climbs 0.8-m platforms and 45° steel-grating stairs, carries a 50-kg payload, and completes a 2.5-km mountain route.
The following analysis is generated by AI and may contain errors. It is separate from the authors’ abstract and is not peer review.
Research summary
PointWalker introduces a mapless quadruped locomotion framework that directly consumes raw LiDAR point clouds via linear self-attention and cross-attention fusion, achieving robust zero-shot traversal of heterogeneous and see-through terrains. The paper demonstrates that removing intermediate terrain representations like elevation maps significantly improves performance on sparse and transparent surfaces, validated through rigorous simulation ablations and extensive real-world hardware testing on the Deep Robotics X30.
Methodology
The paper proposes PointWalker, a reinforcement learning framework that eliminates intermediate terrain representations (like elevation maps or depth images) by directly processing raw LiDAR point clouds. The core architectural contribution is the use of linear self-attention to encode voxelized points into tokens, followed by cross-attention with proprioceptive history to fuse terrain geometry with robot state. This allows the policy to attend to specific relevant points (e.g., gap edges, grating bars) without quadratic computational cost. The training methodology employs a single PPO run across seven terrain classes using a curriculum, with a dual-channel simulation setup where the physics engine sees solid support while the perception channel sees sparse, see-through structures (like steel gratings). This effectively teaches the robot to distinguish between visual clutter and actual support surfaces.
Results & evaluation
The experimental evaluation is robust, featuring extensive simulation ablations comparing the proposed method against height-map encoders, depth-image encoders, and blind policies. The results show significant performance gains on sparse and see-through terrains where intermediate representations fail. Hardware validation on the Deep Robotics X30 is strong, demonstrating zero-shot transfer to complex real-world scenarios including 0.8m gaps, 45-degree steel-grating stairs, and a 2.5km mountain route. The inclusion of ablation studies on hardware (e.g., removing dual-channel simulation or foot-edge penalties) provides clear causal evidence for the necessity of specific design choices.
Reproducibility
The paper provides detailed hyperparameters, network architectures, and simulation configurations (Isaac Lab). The use of standard RL algorithms (PPO) and well-documented domain randomization strategies enhances reproducibility. However, the specific implementation of the dual-channel simulation and the precise LiDAR noise models may require significant effort to replicate exactly. The code is not explicitly linked in the text provided, though a video is available.
Limitations
The method relies on four LiDARs, which is a significant hardware cost compared to depth cameras. The perception range is limited to the local vicinity of the robot, meaning it cannot plan long-range paths or anticipate obstacles far ahead. The paper acknowledges that porting to other robot platforms with different sensor layouts is untested. Additionally, the method is reactive to local geometry and does not handle dynamic moving obstacles or support surfaces effectively.
Broader impact
This work advances the state-of-the-art in legged robot perception by demonstrating that raw point clouds can be effectively used for high-frequency control without intermediate maps. It addresses a critical gap in industrial inspection robots that must traverse heterogeneous, see-through terrain. The approach could inspire similar direct-perception methods in other robotic domains, such as manipulation or aerial robotics, where intermediate representations may lose critical geometric details. PointWalker introduces a mapless quadruped locomotion framework that directly consumes raw LiDAR point clouds via linear self-attention and cross-attention fusion, achieving robust zero-shot traversal of heterogeneous and see-through terrains. The paper demonstrates that removing intermediate terrain representations like elevation maps significantly improves performance on sparse and transparent surfaces, validated through rigorous simulation ablations and extensive real-world hardware testing on the Deep Robotics X30.
Author of this paper? Send a correction.