Week of October 18 – October 25, 2026
Humanoid mobility over complex terrain requires accurate foot placement and coordinated whole-body motion capable of robust adaptation. Reinforcement learning (RL) policies trained without motion references generalize well across terrains, yet eliciting effective whole-body coordination through reward design and exploration alone remains challenging. In contrast, reference-based methods yield natural motions but struggle to adapt beyond the predefined trajectories in their training data. We introduce a learning framework that bridges these two approaches by using motion data strictly as a training prior. An explicit, self-supervised, attention-based contact planner predicts future body-environment contacts, while a contact-conditioned tracker translates these plans into coordinated whole-body motion. Together, they establish contact as an interface between sensory observations and control actions. This abstraction allows the policy to internalize the contact-aware structure of locomotion rather than directly replicating kinematics. Consequently, a single policy can exploit data-driven motion priors for natural whole-body coordination while retaining the flexibility to discover environment-dependent behaviors through reinforcement learning. Building on the learned contact planner and tracker, a subsequent fine-tuning stage bootstraps their acquired capabilities to explore environment variations beyond those covered by the original motion data. Operating entirely from onboard observations without any reference inputs at deployment, this framework enables versatile humanoid mobility in challenging environments.
Primary: National University of Singapore
All Institutions: National University of Singapore, Robotic Systems Lab (ETH Zurich)
The paper introduces a contact-centric framework for humanoid mobility that uses attention-based planning to predict body-environment interactions, enabling a single policy to generalize across diverse terrains and skills without reference motions at deployment. This represents a significant step forward in humanoid control by decoupling contact planning from whole-body execution, allowing for more robust and adaptable behaviors in complex environments.
The paper proposes a novel framework for humanoid mobility that decouples the "what" (contact planning) from the "how" (whole-body tracking). The core innovation is the use of an attention-based mechanism to predict explicit contact locations on a terrain map, serving as an intermediate representation between perception and control. This is a significant conceptual shift from prior work that either relies on full-body trajectory tracking (which lacks generalization) or pure RL (which struggles with complex reward shaping for whole-body coordination). The three-stage training pipeline (Tracker Pretraining, Planner Supervision, RL Fine-tuning) is well-structured and logically sound, effectively leveraging motion data as a prior without binding the deployment policy to specific trajectories. The use of FiLM modulation for body-specific attention queries is a clever architectural choice that allows a single network to handle multiple contact points.
The experimental evaluation is robust and comprehensive. The authors conduct extensive real-world experiments on the Unitree G1 robot, demonstrating a wide variety of skills including ladder climbing, crawling, vaulting, and failure recovery. The simulation-based ablations are rigorous, isolating the contributions of the contact representation, the attention mechanism, and the RL fine-tuning stage. The comparison with MGMT (a strong baseline using diffusion-based motion generation) shows clear advantages in success rates and contact placement accuracy, particularly on sparse terrains. The qualitative comparisons with other methods (PHP, LLP) are fair and highlight the unique capabilities of the proposed approach. The inclusion of failure recovery experiments is a strong point, demonstrating the robustness of the learned policy.
The paper provides detailed descriptions of the network architectures, training procedures, and reward functions. The use of standard components (MLP trackers, attention planners, PD control) makes the method relatively accessible to reproduce. However, the specific details of the motion retargeting pipeline and the LiDAR mapping framework are described at a high level, which might make exact reproduction challenging without access to the code. The lack of a public code repository at the time of review (arXiv preprint) is a minor drawback, but the methodological details are sufficient for a skilled researcher to implement a similar system.
The paper acknowledges several limitations. The current perception is limited to 2.5D terrain maps, which restricts the system's ability to handle overhead contacts or complex 3D manipulation. The system is designed for local goal-conditioned locomotion and does not address global navigation. The contact representation cannot distinguish between motions with identical contact sequences but different kinematics (e.g., backflip vs. vertical jump). These are reasonable limitations for the current scope, but they highlight areas for future work.
This paper has significant potential impact on the field of humanoid robotics. By establishing contact as a general interface for mobility, it provides a scalable framework for adding new skills to humanoid robots without requiring exhaustive manual augmentation of motion datasets. The approach bridges the gap between data-driven imitation and reward-driven exploration, offering a path toward more versatile and robust humanoid control. The insights gained from this work could be applied to other robotic systems that require complex whole-body coordination, such as quadrupeds or manipulators. The paper introduces a contact-centric framework for humanoid mobility that uses attention-based planning to predict body-environment interactions, enabling a single policy to generalize across diverse terrains and skills without reference motions at deployment. This represents a significant step forward in humanoid control by decoupling contact planning from whole-body execution, allowing for more robust and adaptable behaviors in complex environments.
The success of neural networks is largely attributed to their ability to learn useful representations from training data. However, known results that prove a computational advantage of learned features over fixed ones are restricted to specific input distributions. We settle the COLT open question of Feldman, Kamath, and Srebro (2026) by showing that this advantage can persist in the distribution-free setting. We construct a family of hypothesis classes that can be efficiently learned by a natural gradient-based algorithm on a two-layer ReLU network, but cannot be represented by linear predictors over any fixed feature map with polynomial dimension (and runtime). Specifically, for any sufficiently small error and any sufficiently large runtime budget R (depending on the error), there exists a hypothesis class that the neural network learns under any input distribution to the desired expected classification error in time at most R, while the dimension complexity (governing the dimension needed by linear predictors) is superpolynomial in R.
Primary: Unknown
All Institutions: Unknown
Resolves a COLT open question by proving a distribution-free separation between learned and fixed features. The paper provides a rigorous theoretical foundation for the computational advantage of neural network feature learning, demonstrating that certain hypothesis classes can be learned efficiently by gradient-based methods on ReLU networks despite having superpolynomial dimension complexity for fixed feature maps.
The paper proposes a rigorous theoretical framework to resolve an open question regarding the computational advantage of learned features over fixed features in a distribution-free setting. The methodology involves constructing a specific family of hypothesis classes (disjunctions of conjunctions on Boolean inputs) and demonstrating that a natural two-stage gradient-based algorithm (signSGD on hidden layer, projected SGD on output layer) for a two-layer ReLU network can learn these classes efficiently. The core technical contribution is a proof that while the dimension complexity of these classes is superpolynomial in the runtime budget, the neural network learns them in polynomial time. The proof leverages polynomial approximation techniques, Gaussian noise injection to create "useful" neurons that act as counters, and Fourier analysis on the Boolean cube to show that linear combinations of trained neurons can approximate the target functions. The approach is mathematically sophisticated, combining elements of learning theory, harmonic analysis, and optimization.
This is a purely theoretical paper. There are no empirical experiments, datasets, or benchmarks. The "evaluation" consists of rigorous mathematical proofs establishing the existence of the separation and the correctness of the learning algorithm's runtime and error bounds. The lack of empirical validation is expected for this subcategory but limits immediate practical applicability.
The paper provides a detailed algorithm (Algorithm 1) and specifies hyperparameters in a table. The proofs are self-contained with appendices detailing the derivation of key lemmas. However, without code or empirical results, "reproducibility" in the standard experimental sense is not applicable. The theoretical claims are reproducible in the sense that a mathematician can verify the proofs.
The results are restricted to a specific class of functions (DNF-like structures on Boolean inputs) and a specific network architecture (two-layer ReLU). The learning algorithm relies on injected Gaussian noise in the first stage, which is not standard in practical deep learning training. The separation is established for "natural" gradient-based algorithms, but the definition of "natural" is somewhat heuristic. The results do not directly translate to modern deep learning practices involving many layers, batch normalization, or complex optimizers.
This paper contributes to the foundational understanding of why neural networks are powerful. By showing that feature learning provides a computational advantage even in the worst-case (distribution-free) setting, it strengthens the theoretical case for representation learning. It may influence future theoretical work on the limits of linear models and the necessity of non-linear feature learning. However, its direct impact on engineering practice is limited due to the theoretical nature and specific assumptions. Resolves a COLT open question by proving a distribution-free separation between learned and fixed features. The paper provides a rigorous theoretical foundation for the computational advantage of neural network feature learning, demonstrating that certain hypothesis classes can be learned efficiently by gradient-based methods on ReLU networks despite having superpolynomial dimension complexity for fixed feature maps.
We give an algorithm for computing an $\eps$-approximate fixed point of any $d$-dimensional nonexpansion with respect to the $\ell_\infty$ norm in time $\log(1/\eps)^{O(\log^2 d)}$. At its core, our method uses a boosting argument to geometrically shrink a search region. Among other consequences, our algorithm implies that simple stochastic games can be solved in quasipolynomial time.
Primary: Unknown
All Institutions: Unknown
The paper presents a quasipolynomial-time algorithm for computing approximate fixed points of $\ell_\infty$-contractions, resolving a major open problem in the complexity of simple stochastic games. By introducing a novel boosting-based geometric search strategy, the authors improve the running time from subexponential to quasipolynomial, providing a significant theoretical advance with broad implications for game theory, verification, and optimization.
The paper introduces a deterministic algorithm for computing $\epsilon$-approximate fixed points of $\ell_\infty$-contractions in quasipolynomial time, specifically $\log(1/\epsilon)^{O(\log^2 d)}$. The core innovation is a "boosting" argument applied to a geometric search problem. The authors define a "thin labeling" subroutine that recursively splits dimensions based on median side lengths to identify which faces of a search box can be safely shrunk. They then amplify the accuracy of these thin labelings using a technique analogous to AdaBoost, treating the labeling problem as an extremal amplification game. This approach cleverly reduces the subexponential dependence on dimension $d$ found in prior work (Feodorov and Haslebacher) to a quasipolynomial dependence. The theoretical framework is rigorous, with detailed proofs of the potential functions and correctness of the boosting steps.
As a purely theoretical computer science and optimization paper, there are no empirical experiments, datasets, or benchmark comparisons. The "evaluation" is entirely analytical, proving tight bounds on the number of arithmetic operations and function evaluations required. The significance is derived from the theoretical breakthrough in complexity bounds rather than empirical performance.
The algorithm is described in full pseudocode (Algorithms 1, 2, 3, 4). The theoretical guarantees are proven rigorously. However, without code or empirical benchmarks, "reproducibility" in the practical sense is limited to the ability of other theorists to verify the proofs. The unit-cost real machine model is used for analysis, which is standard in this field but limits direct practical implementation without bit-complexity analysis (which is noted as straightforward but not fully detailed).
The algorithm is deterministic and applies to $\ell_\infty$ norms. While it solves Simple Stochastic Games (SSGs) in quasipolynomial time, it does not resolve the open question of whether SSGs are in P. The quasipolynomial bound, while a significant improvement over subexponential, is still super-polynomial, meaning it may not be practical for very large dimensions or high-precision requirements. The paper focuses on the worst-case complexity; smoothed analysis or average-case performance is not addressed.
This result has significant implications for the complexity of several fundamental problems in game theory and verification, including Simple Stochastic Games, stochastic parity games, mean-payoff games, and modal $\mu$-calculus model checking. By providing a quasipolynomial-time algorithm for these problems, it advances the state of the art in understanding the computational hardness of these decision problems. It also contributes to the broader field of fixed-point computation, which is central to reinforcement learning (value iteration) and distributed computing. The use of boosting for geometric search is a novel methodological contribution that could inspire further research in algorithmic game theory. The paper presents a quasipolynomial-time algorithm for computing approximate fixed points of $\ell_\infty$-contractions, resolving a major open problem in the complexity of simple stochastic games. By introducing a novel boosting-based geometric search strategy, the authors improve the running time from subexponential to quasipolynomial, providing a significant theoretical advance with broad implications for game theory, verification, and optimization.
Successful tool-use trajectories are not necessarily useful supervision. Even successful interactions may underrepresent multi-step dependencies or contain actions that are unjustified by the information visible to the agent at decision time. We identify two coupled requirements for effective trajectory supervision: compositional coverage, so that important observation-action dependencies are represented, and decision grounding, so that each supervised action is supported by the learner-visible interaction history. We introduce Trajectory2Gym, which constructs executable interactions around under-supported compositional structures and derives supervision only from grounded decisions in their realized executions. Structural-support selection allocates the resulting experience, while parent-normalized supervised fine-tuning preserves the semantic interaction as the unit of training weight. This reframes trajectory generation as the deliberate construction of learnable interaction experience, rather than the collection of successful trajectories. Across five Qwen3 scales, Trajectory2Gym improves Tau1, Tau2, and BFCL at every tested scale, increasing the equal-weight three-benchmark mean by 16.9-29.8 percentage points. The gains are strongest in stateful and multi-turn interaction, where later decisions depend on earlier observations and feedback. Our results suggest that scaling tool-use agents depends not only on collecting more successful trajectories, but on constructing interactions whose dependencies are represented and whose decisions are learnable from the agent's visible history.
Primary: Unknown
All Institutions: Unknown
The paper introduces a novel data synthesis framework for tool-use agents that prioritizes decision grounding and compositional coverage over mere success rates. While the reported performance gains are substantial, the lack of detailed experimental breakdown and institutional context in the provided text limits the ability to fully verify the technical rigor and generalizability of the approach.
The paper proposes "Trajectory2Gym," a framework for synthesizing training data for tool-use agents. The core innovation lies in shifting from collecting successful trajectories to constructing "learnable interaction experience." The method identifies two key requirements: compositional coverage (ensuring multi-step dependencies are represented) and decision grounding (ensuring actions are justified by visible history). It introduces "structural-support selection" to allocate experience and "parent-normalized supervised fine-tuning" to preserve semantic interaction units. This is a sophisticated approach to data curation for reinforcement learning or imitation learning in agent settings, addressing the common issue that successful trajectories may contain unjustified or unlearnable actions.
The paper reports improvements across five Qwen3 scales on Tau1, Tau2, and BFCL benchmarks. The claimed improvement is significant, with an equal-weight three-benchmark mean increase of 16.9-29.8 percentage points. The gains are noted to be strongest in stateful and multi-turn interactions. However, the provided text is largely a summary/abstract with section headers but lacks the detailed experimental tables, ablation studies, and specific hyperparameters that would allow for a rigorous verification of these claims. The magnitude of improvement (up to ~30 points) is very high, which warrants scrutiny regarding baseline strength and benchmark difficulty.
The provided text does not include code links, detailed algorithmic pseudocode, or specific implementation details for the "structural-support selection" or "parent-normalized SFT" mechanisms. Without access to the full codebase or detailed appendix (which is referenced but not provided in full), reproducibility is difficult to assess. The methodological concepts are clear, but the engineering details are missing from this excerpt.
The primary limitation in this evaluation is the lack of full technical detail in the provided text. The "Unknown" institution and venue suggest this is a preprint or early-stage work. The high performance gains need to be contextualized against the specific baselines used. Additionally, the method's scalability to other model families beyond Qwen3 is not discussed.
If the results hold, this work could significantly impact how training data for LLM agents is generated. Moving from passive collection of successful logs to active construction of grounded, compositional interactions could lead to more robust and efficient agent training. This aligns with current trends in synthetic data generation for RLHF and agent fine-tuning. The paper introduces a novel data synthesis framework for tool-use agents that prioritizes decision grounding and compositional coverage over mere success rates. While the reported performance gains are substantial, the lack of detailed experimental breakdown and institutional context in the provided text limits the ability to fully verify the technical rigor and generalizability of the approach.
Learning visual design is essential for prompt enhancement (PE) to turn underspecified user requests into coherent visual specifications for text-to-image (T2I) generation. Existing methods preserve user intent and improve overall visual appeal, with less explicit emphasis on fine-grained design dimensions. To address this gap, we introduce Qwen-Image-PE, which learns visual design through two-stage training. Supervised fine-tuning with Caption-Based Reverse Distillation (CRD) uses dense captions of well-designed images as design supervision. Reinforcement learning with Groupwise Design Reward (GDR) jointly compares all candidate images for the same request to refine lighting, composition, layout, and detail. On Qwen-Image-Bench with Qwen-Image-2.1, Qwen-Image-PE-397B improves over original requests by 7.81 points, while Qwen-Image-PE-9B outperforms all evaluated PE baselines. Further evaluations show gains in visual design, aesthetics, image quality, and human preference. We find that PE scales along three axes: training data, model size, and information density, with sufficient information density as a prerequisite for effective enhancement. Moreover, we demonstrate that Qwen-Image-PE generalizes to four additional T2I backbones, even surpassing native prompt enhancers on HunyuanImage-2.1 and FLUX 3 Image Klein. We release Qwen-Image-PE-9B at https://huggingface.co/Qwen/Qwen-Image-2.1-PE-T2I.
Primary: Qwen Team (Alibaba Group)
All Institutions: Qwen Team, Alibaba Group
The paper introduces a two-stage training framework (SFT with CRD and RL with GDR) for prompt enhancement in text-to-image generation, demonstrating significant improvements in visual design and generalization across multiple backbones. The combination of dense caption supervision and groupwise design rewards offers a robust approach to aligning generated images with user intent and aesthetic standards, with practical implications for improving the usability of T2I models.
The paper proposes Qwen-Image-PE, a prompt enhancement model trained via a two-stage process. The first stage uses Supervised Fine-Tuning (SFT) with Caption-Based Reverse Distillation (CRD), leveraging dense captions of high-quality images as supervision signals. The second stage employs Reinforcement Learning (RL) with a Groupwise Design Reward (GDR), which compares multiple candidate images for the same prompt to refine specific design dimensions like lighting, composition, and layout. This approach is methodologically sound, combining standard SFT with a novel RL reward structure tailored for visual design aesthetics. The use of groupwise comparison in the reward function is a reasonable adaptation of DPO-like techniques to the image generation context.
The experiments are extensive, evaluating the model on Qwen-Image-Bench with Qwen-Image-2.1. The reported improvements are significant (7.81 points for the 397B model), and the 9B model outperforms existing baselines. The paper also includes scaling laws analysis across data, model size, and information density, which is a valuable contribution. Generalization tests on four other T2I backbones (HunyuanImage-2.1, FLUX 3, etc.) demonstrate the robustness of the approach. The inclusion of human preference evaluations further strengthens the empirical claims.
The model weights for the 9B variant are released on Hugging Face, which is a strong positive for reproducibility. However, the full paper text provided is largely a skeleton of section headers, lacking detailed hyperparameters, dataset construction specifics, and implementation details for the RL stage. While the release of weights mitigates some concerns, the lack of detailed methodological description in the provided text limits full reproducibility of the training pipeline.
The primary limitation is the dependency on the quality of the "dense captions" for the SFT stage; if the captions do not accurately reflect the visual design, the model may learn spurious correlations. Additionally, the RL stage relies on a reward model that may not perfectly align with human aesthetic preferences, potentially leading to reward hacking. The paper also focuses heavily on the Qwen ecosystem, and while generalization is tested, the performance on non-Qwen models may vary.
This work has significant practical impact for users of text-to-image models, as prompt enhancement is a critical bottleneck in user experience. By automating the refinement of prompts into detailed visual specifications, this model can improve the quality of generated images without requiring users to be expert prompt engineers. The insights into scaling laws for prompt enhancement may also guide future research in this area. The paper introduces a two-stage training framework (SFT with CRD and RL with GDR) for prompt enhancement in text-to-image generation, demonstrating significant improvements in visual design and generalization across multiple backbones. The combination of dense caption supervision and groupwise design rewards offers a robust approach to aligning generated images with user intent and aesthetic standards, with practical implications for improving the usability of T2I models.
We introduce RynnUnify, a 16B unified embodied model that combines strong embodied understanding with long-horizon visual planning through interleaved video--language reasoning. With capabilities spanning spatial reasoning, physical prediction, and grounding, RynnUnify connects an understanding of the physical world with visual anticipation of how it evolves across successive subtasks. Building on these capabilities, we further develop an agentic extension through reinforcement learning to selectively use video predictions for reasoning about unobserved states and interaction outcomes. We also develop a world-action extension of the full RynnUnify model, translating its understanding and prediction capabilities into robot control. To evaluate these capabilities, we introduce Rynn-VP and Rynn-GEU for long-horizon visual planning and anticipatory reasoning. Experiments show that RynnUnify achieves the highest average embodied understanding score among the evaluated unified multimodal models and improves the Rynn-VP overall score by 9.75 points over Cosmos 3 Nano. Its agentic extension improves the Rynn-GEU average by 6.0 points over direct reasoning, while the world-action extension achieves 51.5\% success on 20 selected composite RoboCasa365 tasks and 46.7\% average success across three real-robot tasks. Together, these results establish RynnUnify as a shared foundation for embodied understanding, visual planning, and robot control, taking a step toward a unified embodied brain.
Primary: Alibaba Group
All Institutions: Alibaba Group, DAMO Academy, Hupan Lab
RynnUnify introduces a 16B unified embodied model that integrates spatial reasoning, physical prediction, and long-horizon visual planning, achieving state-of-the-art results on new benchmarks and demonstrating viable robot control capabilities. The paper presents a comprehensive framework for embodied AI, combining strong multimodal understanding with agentic reasoning and action generation, marking a significant step toward a unified embodied brain, although real-world robot success rates remain moderate.
The paper proposes RynnUnify, a 16B parameter unified embodied model. The core methodological contribution is the integration of embodied understanding (spatial reasoning, physical prediction) with long-horizon visual planning via interleaved video-language reasoning. The authors introduce an agentic extension using reinforcement learning to selectively utilize video predictions for reasoning about unobserved states. Furthermore, a "world-action" extension is developed to translate these capabilities into robot control. The architecture appears to be a large multimodal model (likely VLM-based) fine-tuned on specific embodied datasets. The novelty lies in the unification of these distinct tasks (understanding, planning, control) within a single model framework, rather than a novel fundamental architecture.
The evaluation is extensive, introducing two new benchmarks: Rynn-VP for long-horizon visual planning and Rynn-GEU for anticipatory reasoning. The model achieves the highest average embodied understanding score among evaluated unified multimodal models. It improves the Rynn-VP overall score by 9.75 points over Cosmos 3 Nano. The agentic extension improves Rynn-GEU by 6.0 points. In robotics, the world-action extension achieves 51.5% success on 20 composite RoboCasa365 tasks and 46.7% average success on three real-robot tasks. These results demonstrate significant progress in unifying perception and action, though the success rates in real-world robotics remain moderate, indicating room for improvement.
The paper is an arXiv preprint. While the abstract mentions specific models and benchmarks, the provided text does not include explicit links to code or data repositories. Without access to the specific training data mixes, hyperparameters, and the implementation of the RL agentic extension, full reproducibility is difficult to guarantee. The scale of the model (16B) and the complexity of the embodied tasks make independent reproduction resource-intensive.
The real-robot success rates (46.7% average) suggest that while the model is a strong foundation, it is not yet robust enough for fully autonomous deployment in complex, unstructured environments. The reliance on specific benchmarks (Rynn-VP, Rynn-GEU) limits immediate generalizability to other evaluation suites. The "unified" nature may come at the cost of specialization compared to dedicated models for specific sub-tasks.
This work contributes to the trend of general-purpose embodied agents. By unifying understanding and planning, it provides a scalable framework for developing robots that can reason about physical interactions. The introduction of new benchmarks for visual planning and anticipatory reasoning will likely be adopted by the community to evaluate future embodied models. RynnUnify introduces a 16B unified embodied model that integrates spatial reasoning, physical prediction, and long-horizon visual planning, achieving state-of-the-art results on new benchmarks and demonstrating viable robot control capabilities. The paper presents a comprehensive framework for embodied AI, combining strong multimodal understanding with agentic reasoning and action generation, marking a significant step toward a unified embodied brain, although real-world robot success rates remain moderate.
On-policy self-distillation enables post-training foundation models without relying on stronger external teachers. However, existing approaches rely on ground-truth question-answer pairs, human-curated problem sets, or other supervised signals. In this work, we reformulate on-policy self-distillation as a self-training framework, driven by self-generated question-answer pairs and privileged reasoning demonstrations. We push supervision to the limit: guided solely by coarse, high-level topic descriptions, the model synthesizes its own curriculum of queries and privileged reasoning traces without access to any human-curated prompts or answers. We find that self-distillation on fully synthetic privileged information enables a model to improve across multiple domains while retaining its capabilities on domains it is not self-trained on. We demonstrate the generality of this framework across text and multimodal domains, achieving consistent self-improvement on standard language benchmarks and Visual Question Answering. Our findings demonstrate that foundation models possess rich latent capabilities that can be amplified without external task supervision or curated problem distributions.
Primary: Ulm University
All Institutions: Ulm University, Google
On-Policy Self-Training (OPST) enables data-free self-improvement in large language models by synthesizing its own curriculum of questions and privileged reasoning traces from coarse topic descriptors, using on-policy self-distillation to leverage the model's latent capabilities without external supervision. The paper demonstrates that this approach yields consistent gains across text and multimodal domains, outperforming standard SFT and RL baselines on self-generated data, and highlights the potential for autonomous model refinement in post-training regimes.
The paper proposes On-Policy Self-Training (OPST), a framework that removes the need for human-curated questions and ground-truth answers in post-training. The core innovation is the reformulation of On-Policy Self-Distillation (OPSD) where the "privileged information" (teacher context) is self-generated by the model itself, seeded only by coarse topic descriptors. The method employs a two-stage filtering mechanism: "pseudo-verification" (checking answer reproducibility and paraphrase invariance) and a "consensus gate" (discarding problems the student already solves reliably). The training objective uses a skewed Jensen-Shannon divergence to balance mode-seeking and mode-covering, and an Exponential Moving Average (EMA) teacher is used to stabilize the distillation targets against distribution drift. The approach is theoretically grounded in the idea that conditioning the teacher on self-generated hints allows it to leverage its own parametric knowledge to fill in reasoning gaps, providing denser and more robust supervision than treating the generated answer as a hard target (SFT) or a scalar reward (RL).
The experiments are conducted on Gemma 4 E2B and E4B models, as well as Qwen3-4B-Base. The results show significant improvements in in-domain benchmarks (MMLU, GPQA, GSM8K, HellaSwag) without any human-curated data. Specifically, OPST outperforms SFT and GRPO on the same self-generated data, demonstrating the superiority of the distillation approach over imitation or reinforcement learning for synthetic data. The paper also demonstrates positive transfer to out-of-domain tasks and extends the method to multimodal settings (Visual OPST) using unlabeled images, showing gains in VQAv2 and POPE. Ablations confirm the importance of the filtering steps and the EMA teacher. The variance across seeds is low, indicating stability.
The paper provides detailed prompt templates, algorithmic descriptions, and hyperparameter settings (EMA rate, number of rounds, dataset size). The use of open-weight models (Gemma, Qwen) and standard benchmarks enhances reproducibility. However, the specific implementation of the "pseudo-verification" and "consensus gate" logic, while described, might require careful tuning to replicate exactly. The code is not explicitly linked in the provided text, but the level of detail suggests it is reproducible by competent practitioners.
The method is limited to amplifying existing knowledge; it cannot introduce new facts or capabilities not present in the base model. Pseudo-verification relies on self-consistency, which may not catch consistent errors. The experiments are limited to relatively small models (2B-4B parameters), and it remains to be seen if the approach scales effectively to much larger models where self-generated data quality might differ. The topic descriptors are hand-chosen, which is a minor bottleneck.
This work is significant for the field of LLM post-training as it reduces the reliance on expensive human annotation for both questions and answers. It provides a pathway for continuous self-improvement of models in the wild, where only topic labels or unlabeled data might be available. The extension to multimodal tasks suggests broad applicability. The finding that self-distillation on synthetic data outperforms SFT and RL on the same data is a valuable insight for practitioners designing post-training pipelines. On-Policy Self-Training (OPST) enables data-free self-improvement in large language models by synthesizing its own curriculum of questions and privileged reasoning traces from coarse topic descriptors, using on-policy self-distillation to leverage the model's latent capabilities without external supervision. The paper demonstrates that this approach yields consistent gains across text and multimodal domains, outperforming standard SFT and RL baselines on self-generated data, and highlights the potential for autonomous model refinement in post-training regimes.
We present HyScale, a long-context training system for learned sparse attention. Learned sparse attention is a promising architecture for million-token contexts, widely adopted in production since DeepSeek-V3.2. Selection, however, grows into the training bottleneck. For each query, it scores every previous token whereas sparse attention reads only $k$; worse, current systems materialize a full score table and repeat selection during recomputation. Our key insight is that the output of selection is not an activation, but rather a set of indices. Building on it, HyScale introduces HyTopK and selection replay. HyTopK finds each query's exact top-$k$ on the fly without a score table, while selection replay reuses forward-pass selection in recomputation. Together with holistic system optimizations tackling end-to-end training challenges, HyScale speeds up GLM-5.1 training on 1M-token sequences by 2.07$\times$ over Megatron-LM on 512 H20 GPUs. It also speeds up the CSA layers of DeepSeek-V4-Flash and the QSA layers of Qwen3.8-Flash-Next by 2.01$\times$ and 1.57$\times$ at 1M tokens on 32 H800 GPUs.
Primary: Unknown (Likely DeepSeek or a major Chinese AI lab based on model references, but not explicitly stated in provided text)
All Institutions: Unknown
HyScale introduces a system-level optimization for long-context training of learned sparse attention models, achieving a 2.07x speedup by exploiting the discrete nature of top-k selection to eliminate score table materialization and redundant recomputation. The paper presents a rigorous analysis of the bottlenecks in current training systems (Megatron-LM) and provides a comprehensive solution involving on-the-fly top-k selection (HyTopK) and fine-grained selection replay, validated on state-of-the-art production models like GLM-5.1 and DeepSeek-V4. The technical depth is high, addressing both algorithmic (sampling strategy) and system-level (CP communication, kernel locality) challenges, making it a significant contribution to the infrastructure of large language model training.
The paper proposes HyScale, a system-level optimization for training large language models with learned sparse attention (DSA/CSA/QSA). The core insight is that the output of the selection step (top-k indices) is discrete and non-differentiable, unlike standard activations. This allows two key optimizations: (1) HyTopK, which performs on-the-fly top-k selection during scoring without materializing the full $O(L)$ score table, using an "optimistic thresholding" strategy with lightweight GPU-side recovery for failures; and (2) Selection Replay, which reuses the indices from the forward pass during activation recomputation in the backward pass, reducing recomputation cost from $O(L)$ to $O(k)$. The paper also details holistic system optimizations, including decoupled context parallelism (CP) communication to hide latency and locality-aware sparse kernels that exploit the high overlap in selections between adjacent queries. The methodology is sound, addressing specific bottlenecks (memory traffic for score tables, redundant computation in recomputation) that are critical for million-token context training.
The evaluation is rigorous and extensive. The authors benchmark the full GLM-5.1 model on 512 H20 GPUs, showing a 2.07x speedup over Megatron-LM at 1M context length. They demonstrate scaling behavior up to 8M context length, showing that HyScale maintains efficiency while baselines degrade. Ablation studies clearly attribute the speedup to HyTopK and Selection Replay. The paper also validates generality by implementing and testing the method on DeepSeek-V4-Flash (CSA) and Qwen3.8-Flash-Next (QSA) layers, showing consistent improvements. The comparison against state-of-the-art baselines (Megatron-LM with cuDNN backend) is fair, using the same codebase and hardware.
The paper provides significant implementation details, including the number of lines of code (3.4K Python, 14.7K CUDA/Triton), specific kernel designs (radix select/sort for determinism), and memory management strategies (offloading indices to pinned host memory). However, the code is not explicitly linked in the provided text (no GitHub URL found), and the specific hyperparameters for the "optimistic threshold" sampling (e.g., the factor 3 in $3kM/L_t$) are described but might require tuning for different architectures. The reliance on specific hardware (H20/H800) and proprietary model weights (GLM-5.1, DeepSeek-V4) limits independent reproduction by the broader community, though the system-level insights are transferable.
The primary limitation is the dependency on specific production models (GLM-5.1, DeepSeek-V4, Qwen3.8) for evaluation, which may not be fully accessible to the public. The "optimistic thresholding" in HyTopK, while efficient, introduces a small probability of failure requiring recovery; while the paper states this is rare, the worst-case latency impact of frequent failures (e.g., with random initialization or unusual data distributions) is not deeply explored beyond the "random weights" case. Additionally, the method is specific to learned sparse attention architectures; it does not apply to other long-context techniques like sliding window attention or full attention with FlashAttention-3 optimizations.
This paper has high impact on the field of large-scale LLM training systems. As context lengths grow to millions of tokens, the quadratic cost of attention becomes prohibitive, and sparse attention is becoming a standard production choice. HyScale provides a critical system-level solution to make this architecture trainable at scale. The insights regarding the discrete nature of top-k selection and the inefficiency of treating it as a standard activation are likely to influence future training frameworks. The demonstrated 2x speedup is significant for reducing the cost and time of training frontier models. HyScale introduces a system-level optimization for long-context training of learned sparse attention models, achieving a 2.07x speedup by exploiting the discrete nature of top-k selection to eliminate score table materialization and redundant recomputation. The paper presents a rigorous analysis of the bottlenecks in current training systems (Megatron-LM) and provides a comprehensive solution involving on-the-fly top-k selection (HyTopK) and fine-grained selection replay, validated on state-of-the-art production models like GLM-5.1 and DeepSeek-V4. The technical depth is high, addressing both algorithmic (sampling strategy) and system-level (CP communication, kernel locality) challenges, making it a significant contribution to the infrastructure of large language model training.
AI agents increasingly act as analysts whose decision can often be cast as hypothesis tests. Classical tests control the Type I error rate, the probability of rejecting a true null hypothesis, for fixed procedures. However, AI analysts introduce internal randomness and can evolve continuously over time. As AI analysts evolve, the risk of approving versions with Type I error rates above the target can accumulate, and adaptive use of evaluation feedback can lead to overfitting. We introduce continual validation, which evaluates each proposed AI analyst version before deployment using simulated data under the null hypothesis, with scenarios that can be randomized and expanded over time. We prove that, regardless of how updates are chosen or how many are proposed, the lifetime probability of ever deploying a version whose Type I error rate exceeds the allowed level remains bounded. This guarantees that every subsequent decision controls the Type I error rate at the target level across these scenarios. At the same time, updates with sufficiently low Type I error rates pass validation with high probability, allowing the analyst to continuously improve its performance without sacrificing rigor. In two examples involving evolving AI analysts for bioequivalence studies and product A/B tests, Type I error rates reached 0.098 and 0.183 without continual validation, compared with at most 0.045 and 0.044 with it, while retaining 82% and 96% of the power from optimally selected valid updates.
Primary: Purdue University
All Institutions: Purdue University, Anthropic, Lilly Purdue Innovation Institute
The paper proposes a rigorous statistical framework, "continual validation," that guarantees Type I error control for AI agents that evolve over time by using sequential hypothesis testing with a lifetime error budget. By proving that the probability of deploying an invalid version remains bounded regardless of the number of adaptive updates, the work addresses a critical safety gap in the deployment of self-improving AI analysts, offering a practical method to maintain statistical rigor while allowing for continuous improvement in power and automation.
The paper introduces "continual validation," a framework for controlling Type I error in evolving AI agents. The core innovation is the use of sequential hypothesis testing with a lifetime error budget. By freezing each proposed version, simulating null data, and using exact binomial confidence bounds with a shrinking error budget ($\alpha_r$), the authors prove that the probability of ever deploying an invalid version remains bounded. This addresses the "garden of forking paths" problem in adaptive AI systems. The theoretical contribution is solid, leveraging standard statistical tools (Clopper-Pearson bounds, union bounds) in a novel context of agent evolution. The "allowed paths" proposition is a clever practical addition that reduces computational cost by validating deterministic decision rules rather than stochastic LLM outputs.
The experiments are rigorous and well-motivated. The authors test the framework on two distinct domains: bioequivalence studies (pharmacokinetics) and product A/B testing. They compare continual validation against four baselines: no validation, static benchmark, improvement test, and Learn-then-Test. The results clearly demonstrate that without continual validation, Type I error rates inflate significantly (up to 0.78 in one case), while continual validation keeps them below the target (0.05) while retaining high statistical power (82-96% of oracle). The inclusion of off-grid scenarios to test robustness is a strong point, showing the method generalizes beyond the specific validation grid.
The paper provides detailed algorithmic descriptions and specifies the exact statistical bounds used. The use of open-source tools (GrowthBook) and public LLMs (Claude, Qwen, DeepSeek) enhances reproducibility. However, the specific prompts and internal logic of the "developer" agent are not fully detailed, which might make exact replication of the evolutionary trajectories difficult, though the statistical guarantees hold regardless of the specific updates proposed.
The primary limitation is the reliance on the ability to simulate null scenarios. If the null hypothesis space is complex or hard to simulate, the method's applicability is limited. Additionally, the computational cost of simulating $m_r$ datasets for each update can be high, although the "allowed paths" optimization mitigates this. The guarantee is strictly for the simulated scenarios; while robustness is shown empirically, there is no formal guarantee for unobserved data distributions.
This paper has significant implications for the deployment of AI agents in high-stakes domains like healthcare and finance. As AI agents become more autonomous and self-improving, the lack of statistical guarantees for their decisions is a major barrier to adoption. This work provides a rigorous framework to ensure that AI analysts do not inflate error rates as they evolve, potentially becoming a standard protocol for validating AI-driven statistical decisions. It bridges the gap between classical statistical theory and modern adaptive AI systems. The paper proposes a rigorous statistical framework, "continual validation," that guarantees Type I error control for AI agents that evolve over time by using sequential hypothesis testing with a lifetime error budget. By proving that the probability of deploying an invalid version remains bounded regardless of the number of adaptive updates, the work addresses a critical safety gap in the deployment of self-improving AI analysts, offering a practical method to maintain statistical rigor while allowing for continuous improvement in power and automation.
Masked diffusion models (MDMs) generate sequences by progressively unmasking tokens, but errors introduced during decoding are typically irreversible. Recent work has shown that iterative correction can improve sample quality, yet existing theory fails to explain this given a learned, imperfect denoiser model. We re-formulate MDM inference as a Markov chain on the clean sequence space, defined by a remask-denoise kernel that randomly re-introduces masks and then denoises. This helps us analyze the actual denoising trajectory towards the data distribution. The analysis motivates Random Remask-Denoise (R$^2$D) inference, a purely test-time, finetuning-free, reward-free procedure. To further improve performance, we propose Trajectory Correction Training (TCT), a denoiser-training procedure that exposes the model to its own errors along the generation trajectory. On logical tasks, our approach exhibits a striking near-log-linear test-time scaling, achieving over 97% accuracy on hard Sudoku puzzles and over 99% accuracy on 3-SAT. Our approach also applies to pretrained models on actual language tasks, beating iterative correction baselines and the official Q-mode accuracy of LLaDA2.1-mini on HumanEval+.
Primary: Carnegie Mellon University
All Institutions: Carnegie Mellon University
The paper presents a unified Markov-chain framework for masked diffusion inference, deriving a principled test-time scaling algorithm (R2D) and a corresponding training method (TCT) that significantly improve accuracy on logical and coding tasks.
The paper proposes a unified Markov chain framework for Masked Diffusion Model (MDM) inference, re-formulating the process as a remask-denoise kernel on the clean sequence space. This theoretical shift allows for a rigorous analysis of the denoising trajectory using KL divergence contraction bounds. The authors derive a single-step update bound that identifies three key factors: timestep schedule, task structure, and model quality. Based on this, they propose Random Remask-Denoise (R2D) inference, an adaptive, reward-free test-time scaling method that iterates until prediction stabilizes. Additionally, they introduce Trajectory Correction Training (TCT), a training procedure that exposes the model to its own errors along the generation trajectory, effectively teaching it to correct mistakes. The methodology is sound, bridging the gap between diffusion theory and practical iterative correction by providing a principled justification for why and when remasking helps.
The experiments are rigorous and cover both synthetic logical tasks (Sudoku-Hard, 3-SAT) and a real-world language task (HumanEval+ with LLaDA2.1-mini). The results demonstrate a striking near-log-linear test-time scaling effect on logical tasks, achieving >97% accuracy on hard Sudoku and >99% on 3-SAT. The method outperforms baselines like ReMDM and ProSeCo in both accuracy and compute efficiency (NFE). The application to the 16B LLaDA2.1-mini model shows that R2D can beat the official Q-mode accuracy on HumanEval+ without any fine-tuning, which is a strong practical result. Ablation studies confirm the importance of uniform remasking and argmax decoding for the scaling effect.
The paper provides detailed pseudo-code for both the inference algorithm (R2D) and the training procedure (TCT). Hyperparameters such as correction budgets, early-exit patience, and model architectures are specified. The use of standard datasets (SATLIB, Sudoku-Extreme) and a public model (LLaDA2.1-mini) enhances reproducibility. However, the specific implementation details of the TCT training loop (e.g., how batches are managed across chains) are described in the appendix but could benefit from more explicit code-level details.
The primary limitation is the computational cost of iterative correction, although the paper argues it is more efficient than baselines. The method relies on argmax decoding for the scaling effect, which may limit diversity in generation tasks where sampling is preferred. The logical tasks, while impressive, are discrete and constraint-heavy; the generalizability to other types of continuous or open-ended generation tasks is less clear, though the HumanEval+ result is promising. The theory assumes a Markovian remask step, which is a simplification of some standard inference procedures.
This work provides a theoretical foundation for test-time scaling in discrete diffusion models, a rapidly growing area. By showing that iterative correction can be viewed as a Markov chain convergence process, it offers a principled way to allocate compute during inference. The ability to improve accuracy of pretrained models without fine-tuning (as shown with LLaDA2.1-mini) is highly valuable for practitioners who cannot retrain large models. It may influence future designs of diffusion-based LLMs to incorporate self-correction capabilities natively. The paper presents a unified Markov-chain framework for masked diffusion inference, deriving a principled test-time scaling algorithm (R2D) and a corresponding training method (TCT) that significantly improve accuracy on logical and coding tasks.
We consider online monitoring of an AI system that produces a sequence of decisions. At each round, the system outputs a proposed decision together with a confidence score estimating the trustworthiness of the decision. The decision and confidence score need not be produced by the same model: for example, one agent may propose a decision, while a separate verifier agent evaluates it and outputs a correctness or safety score. Based on this information, we must decide whether to accept the AI decision automatically or consult an expert, such as a human auditor, who reviews the proposal and either accepts or corrects it. We formulate this task as an online constrained optimization problem in which the goal is to minimize the frequency of expert auditing while guaranteeing that the fraction of AI errors that go unaudited stays below a user-defined threshold. We derive a family of algorithms with provable error-control guarantees with no assumptions, including a method that is optimally efficient: it asymptotically attains the best achievable auditing rate for both adversarial and i.i.d. data streams. Experiments on screening harmful requests to large language models, qualitative text annotation, and data labeling show that our methods achieve valid error control in practice while substantially reducing the need for human auditing compared to baselines.
Primary: Stanford University
All Institutions: Stanford University, University of California, University of Toronto
The paper introduces a rigorous online learning framework for selective auditing of AI decisions, providing distribution-free error control guarantees and asymptotically optimal auditing rates. By combining inverse probability weighting with online isotonic calibration, the authors develop methods that significantly reduce human oversight costs while maintaining strict reliability bounds, offering a practical and theoretically sound solution to the challenge of monitoring autonomous AI systems at scale.
The paper proposes a framework for "selective auditing" of AI decisions, formulated as an online constrained optimization problem. The core contribution is a family of algorithms that balance the cost of expert auditing against the risk of uncorrected AI errors. The primary method, "additive thresholding," uses inverse probability weighting to update a confidence threshold based on observed errors, providing distribution-free error control guarantees. A more sophisticated variant, "additive thresholding with confidence calibration," employs online isotonic regression (via exponentiated gradient descent on a simplex) to recalibrate confidence scores, ensuring pseudo-calibration while maintaining error bounds. The paper further derives an optimally efficient algorithm that asymptotically minimizes the auditing rate for both adversarial and i.i.d. data streams, connecting the problem to primal-dual methods in online learning. The theoretical analysis is rigorous, providing $O(1/T)$ error control bounds under linear error growth assumptions.
The experiments evaluate the methods on three tasks: screening harmful LLM requests, qualitative text annotation, and data labeling. The results demonstrate that the proposed methods achieve valid error control while significantly reducing the number of required human audits compared to baselines (such as fixed thresholds or the method from Kiyani et al.). The empirical validation supports the theoretical claims, showing that the calibration step improves efficiency without sacrificing reliability. However, the experimental section is somewhat brief, and the datasets are standard benchmarks rather than novel large-scale deployments, which limits the demonstration of scalability in real-world high-stakes environments.
The paper provides clear algorithmic descriptions (Algorithm 1) and theoretical definitions. However, specific hyperparameter choices (step sizes, grid points for calibration) are not fully detailed in the truncated text, and code availability is not explicitly confirmed in the provided excerpt. The reliance on standard online learning techniques (mirror descent, inverse probability weighting) suggests that implementation is feasible for practitioners familiar with these methods.
The theoretical guarantees assume that the number of errors grows linearly with time ($n_T = \Omega(T)$). In regimes where errors are very rare, the bounds may be loose or the methods may not provide strong guarantees, as noted in the text. The "optimal efficiency" result relies on discretizing confidence scores onto a grid, which introduces a discretization error that is not fully quantified in the main text. Additionally, the framework assumes a binary error indicator and a single confidence score, which may not capture the complexity of multi-class or multi-dimensional decision spaces.
This work has significant implications for the deployment of autonomous AI systems, particularly in safety-critical domains where human oversight is costly but necessary. By providing provable guarantees on error rates while minimizing human intervention, the paper offers a practical path toward scalable AI oversight. The connection to online learning and calibration makes the methods applicable to a wide range of sequential decision-making problems, potentially influencing future standards for AI reliability and auditing protocols. The paper introduces a rigorous online learning framework for selective auditing of AI decisions, providing distribution-free error control guarantees and asymptotically optimal auditing rates. By combining inverse probability weighting with online isotonic calibration, the authors develop methods that significantly reduce human oversight costs while maintaining strict reliability bounds, offering a practical and theoretically sound solution to the challenge of monitoring autonomous AI systems at scale.
We give an algorithm for computing an $\eps$-approximate fixed point of any $d$-dimensional nonexpansion with respect to the $\ell_\infty$ norm in time $\log(1/\eps)^{O(\log^2 d)}$. At its core, our method uses a boosting argument to geometrically shrink a search region. Among other consequences, our algorithm implies that simple stochastic games can be solved in quasipolynomial time.
Primary: Unknown
All Institutions: Unknown
The paper presents a quasipolynomial-time algorithm for computing approximate fixed points of $\ell_\infty$-contractions, resolving a major open problem in the complexity of simple stochastic games. By introducing a novel boosting-based geometric search strategy, the authors improve the running time from subexponential to quasipolynomial, providing a significant theoretical advance with broad implications for game theory, verification, and optimization.
The paper introduces a deterministic algorithm for computing $\epsilon$-approximate fixed points of $\ell_\infty$-contractions in quasipolynomial time, specifically $\log(1/\epsilon)^{O(\log^2 d)}$. The core innovation is a "boosting" argument applied to a geometric search problem. The authors define a "thin labeling" subroutine that recursively splits dimensions based on median side lengths to identify which faces of a search box can be safely shrunk. They then amplify the accuracy of these thin labelings using a technique analogous to AdaBoost, treating the labeling problem as an extremal amplification game. This approach cleverly reduces the subexponential dependence on dimension $d$ found in prior work (Feodorov and Haslebacher) to a quasipolynomial dependence. The theoretical framework is rigorous, with detailed proofs of the potential functions and correctness of the boosting steps.
As a purely theoretical computer science and optimization paper, there are no empirical experiments, datasets, or benchmark comparisons. The "evaluation" is entirely analytical, proving tight bounds on the number of arithmetic operations and function evaluations required. The significance is derived from the theoretical breakthrough in complexity bounds rather than empirical performance.
The algorithm is described in full pseudocode (Algorithms 1, 2, 3, 4). The theoretical guarantees are proven rigorously. However, without code or empirical benchmarks, "reproducibility" in the practical sense is limited to the ability of other theorists to verify the proofs. The unit-cost real machine model is used for analysis, which is standard in this field but limits direct practical implementation without bit-complexity analysis (which is noted as straightforward but not fully detailed).
The algorithm is deterministic and applies to $\ell_\infty$ norms. While it solves Simple Stochastic Games (SSGs) in quasipolynomial time, it does not resolve the open question of whether SSGs are in P. The quasipolynomial bound, while a significant improvement over subexponential, is still super-polynomial, meaning it may not be practical for very large dimensions or high-precision requirements. The paper focuses on the worst-case complexity; smoothed analysis or average-case performance is not addressed.
This result has significant implications for the complexity of several fundamental problems in game theory and verification, including Simple Stochastic Games, stochastic parity games, mean-payoff games, and modal $\mu$-calculus model checking. By providing a quasipolynomial-time algorithm for these problems, it advances the state of the art in understanding the computational hardness of these decision problems. It also contributes to the broader field of fixed-point computation, which is central to reinforcement learning (value iteration) and distributed computing. The use of boosting for geometric search is a novel methodological contribution that could inspire further research in algorithmic game theory. The paper presents a quasipolynomial-time algorithm for computing approximate fixed points of $\ell_\infty$-contractions, resolving a major open problem in the complexity of simple stochastic games. By introducing a novel boosting-based geometric search strategy, the authors improve the running time from subexponential to quasipolynomial, providing a significant theoretical advance with broad implications for game theory, verification, and optimization.
Diffusion and flow models provide expressive policy classes for robotic and sequential decision-making systems. However, their action likelihoods are generally intractable, limiting the direct use of widely adopted policy optimization methods such as PPO and GRPO. We propose Doob Policy Optimization (DoobPO), a framework that leverages Doob's $h$-transform for likelihood-free reinforcement learning fine-tuning of generative policies. DoobPO separates policy improvement from generative policy learning. It first learns a lightweight ratio model that represents the desired policy update, and then distills the resulting ratio-tilted target policy into the generative policy via conditional drift matching. This formulation applies uniformly to both diffusion and flow policies and supports a broad family of policy improvement rules, including PPO and GRPO. We prove that the practical conditional drift matching objective is gradient-equivalent to the ideal Doob drift matching objective. We further show that the induced diffusion process solves an endpoint-constrained stochastic optimal control problem. This establishes that it achieves the minimum-energy modification required to realize the desired policy tilt. Across MuJoCo continuous-control benchmarks, DoobPO achieves strong performance against competitive diffusion- and flow-policy baselines, showing a principled and practical route to RL fine-tuning for generative policies.
Primary: Northwestern University
All Institutions: Northwestern University
DoobPO introduces a likelihood-free reinforcement learning framework using Doob's $h$-transform to enable policy optimization for diffusion and flow-based policies. The paper makes a substantial technical contribution by unifying policy improvement and generative learning through conditional drift matching, supported by rigorous theoretical proofs and strong empirical results on MuJoCo benchmarks, positioning it as a significant advancement in the integration of generative models with reinforcement learning.
The paper proposes Doob Policy Optimization (DoobPO), a framework addressing the critical bottleneck of intractable likelihoods in diffusion and flow-based policies for reinforcement learning. By leveraging Doob's $h$-transform, the method decouples policy improvement from generative policy learning. It introduces a lightweight ratio model to represent policy updates and distills the resulting ratio-tilted target policy into the generative policy via conditional drift matching. The authors provide a rigorous theoretical foundation, proving that the practical conditional drift matching objective is gradient-equivalent to the ideal Doob drift matching objective and demonstrating that the induced diffusion process solves an endpoint-constrained stochastic optimal control problem. This establishes a principled, minimum-energy modification approach to realizing desired policy tilts, offering a unified formulation for both diffusion and flow policies.
The experimental evaluation is conducted on MuJoCo continuous-control benchmarks, comparing DoobPO against competitive diffusion- and flow-policy baselines. The results demonstrate strong performance, validating the practical utility of the proposed framework for RL fine-tuning of generative policies. While the benchmarks are standard in the field, the paper focuses primarily on continuous control, which may limit the generalizability of the findings to discrete or high-dimensional visual tasks without further evidence.
The paper is accepted at NeurIPS 2026, a venue with high standards for reproducibility. A project page is provided, which likely contains code and additional details. The theoretical proofs and clear separation of the ratio model and drift matching components suggest that the method is well-defined and implementable. However, without access to the full code repository details in the provided text, specific hyperparameter choices and implementation nuances remain partially opaque.
The primary limitation is the focus on MuJoCo continuous-control tasks, which may not fully capture the challenges of applying DoobPO to more complex, high-dimensional, or discrete action spaces. Additionally, the reliance on a lightweight ratio model introduces an approximation that could affect performance in highly stochastic or non-stationary environments. The computational overhead of maintaining and updating the ratio model alongside the generative policy is not extensively discussed in the provided abstract.
This work has significant potential to bridge the gap between expressive generative models and practical reinforcement learning. By enabling the use of standard policy optimization methods like PPO and GRPO with diffusion and flow policies, DoobPO could accelerate the adoption of generative models in robotics and sequential decision-making. The theoretical insights into stochastic optimal control and drift matching may also inspire new approaches in related fields such as optimal transport and control theory. DoobPO introduces a likelihood-free reinforcement learning framework using Doob's $h$-transform to enable policy optimization for diffusion and flow-based policies. The paper makes a substantial technical contribution by unifying policy improvement and generative learning through conditional drift matching, supported by rigorous theoretical proofs and strong empirical results on MuJoCo benchmarks, positioning it as a significant advancement in the integration of generative models with reinforcement learning.
Objects move, cameras pan, and weather drifts with the wind: much of what changes in sequential data is motion. Motion changes where things are, not what they are, and is therefore a symmetry of the data. Yet standard recurrent networks are not equivariant to it: their memory stays put while the input moves on. Flow equivariant recurrent networks first brought this symmetry into sequence models, for motions of constant velocity, or flows, by enumerating a bank of velocities. We extend this idea in three directions: from simple recurrent networks to convolutional LSTMs, from flows to motions whose velocity changes in time, and from enumerating velocities to estimating them. Treating a sequence as a field over time, we show that motion becomes a gauge symmetry: a global symmetry made local in time. Built on this view, our motion equivariant convolutional LSTM (MELSTM) uses its velocity model as the gauge field and is provably equivariant to every motion. Across future-frame prediction, classification of digits visible only through their motion, and action recognition under camera shake, MELSTM outperforms a convolutional LSTM and its flow equivariant counterpart with the same number of parameters: it is more accurate, generalizes to longer horizons and to unseen motions, and carries a fraction of the flow equivariant model's state.
Primary: The Kempner Institute at Harvard University
All Institutions: The Kempner Institute at Harvard University, South Dakota State University
The paper proposes a Motion Equivariant Convolutional LSTM that treats motion as a gauge symmetry, enabling equivariance to time-varying velocities. By using a velocity model to transport hidden states, the method outperforms flow-equivariant baselines in accuracy and generalization, offering a robust framework for sequential data with dynamic symmetries.
The paper introduces a rigorous theoretical framework extending equivariance from static spatial symmetries to dynamic, time-dependent motions. By framing motion as a gauge symmetry over the time axis, the authors derive a "Motion Equivariant Convolutional LSTM" (MELSTM). The core innovation is the use of a velocity model (acting as a gauge connection) to transport hidden and cell states between timesteps, ensuring equivariance to arbitrary motions rather than just constant-velocity flows. The mathematical derivation is sound, proving that standard ConvLSTMs are not flow-equivariant for generic kernels (measure-zero set) and establishing the necessary transformation laws for the velocity model to maintain equivariance. The extension to local motions via slot tracking is a clever architectural choice that addresses the correspondence problem in multi-object scenes.
The experiments are well-designed to isolate the impact of the transport mechanism. Comparisons are made against a standard ConvLSTM and a Flow Equivariant ConvLSTM (FERNN) with identical parameter counts. The tasks (Moving MNIST prediction, Motion-Only MNIST classification, KTH action recognition under camera shake) effectively test the model's ability to handle time-varying velocities. The results show that MELSTM outperforms baselines, particularly in generalization to unseen motions and longer prediction horizons. The finding that MELSTM is less sensitive to recent velocity changes than the enumerating FERNN is a significant empirical insight.
The code is available on GitHub. The paper provides detailed descriptions of the velocity estimation methods (phase correlation) and the architectural modifications. The use of parameter-free velocity models in the main experiments simplifies reproduction, though the paper notes that trainable velocity models are a future direction. The experimental setup is clearly defined, allowing for fair comparison.
The primary limitation is the reliance on parameter-free velocity estimation (phase correlation) in the main experiments, which may not generalize to all types of motion or complex scenes without learning. The model assumes a specific structure for local motions (slots), which may not capture all possible scene decompositions. The theoretical framework is complex and may be difficult to implement for non-abelian groups or more complex Lie algebras.
This work bridges the gap between geometric deep learning and sequential modeling, offering a principled way to incorporate dynamic symmetries into recurrent architectures. It has potential applications in video prediction, robotics, and any domain where objects move with time-varying velocities. The gauge theory perspective provides a new lens for understanding equivariance in time-series data, which could inspire further research in this area. The paper proposes a Motion Equivariant Convolutional LSTM that treats motion as a gauge symmetry, enabling equivariance to time-varying velocities. By using a velocity model to transport hidden states, the method outperforms flow-equivariant baselines in accuracy and generalization, offering a robust framework for sequential data with dynamic symmetries.
Program optimization aims to improve performance while preserving behavior. Coding agents can already make programs faster by changing algorithms, data structures, and execution strategies. However, existing equivalence checks mostly rely on tests, which agents have been shown to exploit, passing the tests without preserving the intended behavior. We propose agentic verified optimization, in which an agent produces a faster implementation together with a machine-checked proof of equivalence to the existing one. Because the existing implementation serves as the specification, the task avoids the specification-writing bottleneck of verified code generation, and recent advances in theorem proving make the proofs attainable. We formulate the task at the function and repository levels in Lean 4, where programs can be both executed and reasoned about. Few real-world applications are written in Lean, so we develop Aqueduct, an agentic framework that migrates C, C++, Go, and Rust programs into native Lean, validates each port by differential testing against its original. On the 189 reference implementations in Verina, agents produce faster proved rewrites for 156, including algorithmic changes such as replacing exponential recursion with dynamic programming. On 17 migrated applications, their 92 proved rewrites speed up 47 of 51 application scenarios. These application-level gains are smaller than the function-level ones, making the choice of functions to optimize an important problem. Current agents can thus already carry out verified optimization on both standalone functions and applications migrated from real programs. We discuss the remaining challenges and the steps toward verified optimization in production.
Primary: University of California
All Institutions: University of California, Amazon Web Services
The paper proposes agentic verified optimization, where LLM agents generate faster code with machine-checked proofs of equivalence, and demonstrates its feasibility on real-world software migrated to Lean 4. By using the existing code as the specification, it avoids the specification-writing bottleneck and prevents reward hacking, showing that current agents can perform verified optimizations that are both correct and faster, albeit with modest application-level gains.
The paper introduces "agentic verified optimization," a framework where LLM agents generate faster code implementations alongside machine-checked proofs of equivalence in Lean 4. The methodology is robust, leveraging the existing implementation as the specification to avoid the bottleneck of writing formal specs. It addresses the critical issue of reward hacking in test-based optimization by using formal proofs. The development of "Aqueduct," a framework for migrating C/C++/Go/Rust code to Lean with differential testing, is a significant technical contribution that enables the evaluation of this method on real-world software, not just toy problems.
The evaluation is extensive, covering 189 standalone functions from the Verina benchmark and 17 migrated real-world applications. The results show that agents can produce verified speedups in a majority of cases (82.5% for functions). The distinction between function-level microbenchmarks and application-level macrobenchmarks is well-handled, showing that while function-level gains are substantial, application-level gains are more modest due to I/O and unoptimized parts of the code. The comparison against a single-agent migration baseline for Aqueduct demonstrates the effectiveness of the multi-agent migration strategy.
The paper provides detailed descriptions of the agent setup (Codex with GPT-5.6 Sol), the Lean version, and the timing protocols. The use of deterministic generators for workloads and the open-source nature of Lean and the benchmarks (Verina, ProgramBench) suggests high reproducibility. However, the specific prompts and agent orchestration logic for Aqueduct would need to be released to fully replicate the migration results.
The primary limitation is the reliance on Lean 4, which has a small ecosystem of real-world applications, necessitating the migration step. The migration process itself is complex and may not capture all nuances of the original programs. Additionally, the speedups, while verified, are often modest at the application level (geometric mean 1.12x), limiting immediate practical impact for production systems where larger gains are typically expected.
This work bridges the gap between LLM-based code generation and formal verification, offering a path to trustworthy automated optimization. It has implications for software engineering, formal methods, and AI safety by providing a mechanism to ensure that AI-generated optimizations do not introduce subtle bugs. The framework could be extended to other proof assistants and languages, potentially transforming how performance-critical code is developed and maintained. The paper proposes agentic verified optimization, where LLM agents generate faster code with machine-checked proofs of equivalence, and demonstrates its feasibility on real-world software migrated to Lean 4. By using the existing code as the specification, it avoids the specification-writing bottleneck and prevents reward hacking, showing that current agents can perform verified optimizations that are both correct and faster, albeit with modest application-level gains.
Speech models are increasingly used as an interface to AI systems, from transcription tools to voice agents. Existing audio backdoors require an attacker to introduce triggers at inference time. We study a different threat model in which the attacker compromises the model during fine-tuning but has no access to the victim's inference-time inputs. We introduce the Speaker-Activated Backdoor (SAB) setting, in which a target speaker's natural voice serves as the trigger. We develop a two-phase fine-tuning method that first makes speaker identity more accessible and then binds the target speaker to an attacker-chosen payload. Compared with a one-phase baseline with the same training budget, the two-phase method substantially improves selectivity and clean performance, and is especially important for content-dependent attacks. SAB achieves 90.2% and 97.0% backdoor success on Whisper-medium and Parakeet, with false-positive rates of 1.7% and 0%, respectively using as little as two minutes of real audio from the target speaker. We further demonstrate content-dependent semantic rewriting and downstream tool-use attacks, where malicious instructions are inserted into 96.9% of target-speaker transcripts. When these transcripts are passed to frontier LLM agents, GPT-4o and Claude (Opus, Sonnet, and Haiku), the injected instruction drives the agent to carry out the harmful action in up to 87.5% of cases. The attack generalizes to held-out recordings, multiple target speakers, and common acoustic degradations. These results establish speaker identity as a practical backdoor trigger that requires no inference-time attacker access and is invisible at the transcript layer.
Primary: Imperial College London
All Institutions: Imperial College London
The paper introduces a novel speaker-activated backdoor threat model for speech-to-text models, demonstrating that a target speaker's natural voice can trigger malicious behavior without inference-time access. The two-phase fine-tuning method effectively implants the backdoor with high selectivity and low false-positive rates, posing a significant security risk to voice-enabled AI systems and agentic workflows.
The paper proposes a novel threat model for speech-to-text models where the backdoor trigger is the speaker's identity rather than an acoustic artifact added at inference time. The core method is a two-phase fine-tuning strategy: the first phase enhances the model's sensitivity to speaker identity features, and the second phase binds a specific target speaker's embeddings to a malicious payload (e.g., transcript suppression or semantic rewriting). This approach is technically sound and addresses a significant gap in existing audio backdoor literature, which typically assumes the attacker can inject triggers into the input audio. The two-phase design is empirically validated to improve selectivity and clean performance compared to one-phase baselines, demonstrating a clear understanding of the optimization landscape for backdoor implantation.
The experimental evaluation is robust and comprehensive. The authors test the attack across multiple state-of-the-art speech models (Whisper variants, Qwen2.5-Omni, Parakeet) and multiple target speakers (real-world actors). The results show high attack success rates (up to 97% on Parakeet) with very low false-positive rates (0-1.7%), which is critical for a stealthy attack. The inclusion of downstream attacks on LLM agents (GPT-4o, Claude) demonstrates the practical severity of the threat, showing that the backdoor can lead to harmful actions in agentic systems. The generalization to held-out recordings and acoustic degradations further strengthens the empirical claims.
The paper provides sufficient detail on the two-phase training method and the datasets used (implied to be standard speech datasets with specific target speakers). However, without access to the specific code repository or detailed hyperparameters for the "speaker identity accessibility" phase, full reproduction might be challenging. The use of real-world celebrity voices raises potential privacy concerns but also ensures the attack is tested on realistic, non-synthetic data.
The attack requires the attacker to have access to the model during the fine-tuning phase, which limits the threat model to scenarios where the model is being customized or fine-tuned by a potentially compromised entity. Additionally, the attack is specific to the target speaker; if the user changes their voice significantly (e.g., due to illness) or uses a voice changer, the attack may fail. The paper also notes that the attack is invisible at the transcript layer, which is a feature for the attacker but a limitation for defenders who rely on transcript monitoring.
This paper has significant implications for the deployment of voice interfaces in sensitive applications, such as banking, healthcare, and autonomous agents. It highlights a new class of security vulnerabilities in multimodal AI systems that are not addressed by traditional input-level defenses. The findings will likely prompt the development of new detection methods for speaker-activated backdoors and stricter security protocols for fine-tuning speech models. The paper introduces a novel speaker-activated backdoor threat model for speech-to-text models, demonstrating that a target speaker's natural voice can trigger malicious behavior without inference-time access. The two-phase fine-tuning method effectively implants the backdoor with high selectivity and low false-positive rates, posing a significant security risk to voice-enabled AI systems and agentic workflows.
The success of neural networks is largely attributed to their ability to learn useful representations from training data. However, known results that prove a computational advantage of learned features over fixed ones are restricted to specific input distributions. We settle the COLT open question of Feldman, Kamath, and Srebro (2026) by showing that this advantage can persist in the distribution-free setting. We construct a family of hypothesis classes that can be efficiently learned by a natural gradient-based algorithm on a two-layer ReLU network, but cannot be represented by linear predictors over any fixed feature map with polynomial dimension (and runtime). Specifically, for any sufficiently small error and any sufficiently large runtime budget R (depending on the error), there exists a hypothesis class that the neural network learns under any input distribution to the desired expected classification error in time at most R, while the dimension complexity (governing the dimension needed by linear predictors) is superpolynomial in R.
Primary: Unknown
All Institutions: Unknown
Resolves a COLT open question by proving a distribution-free separation between learned and fixed features. The paper provides a rigorous theoretical foundation for the computational advantage of neural network feature learning, demonstrating that certain hypothesis classes can be learned efficiently by gradient-based methods on ReLU networks despite having superpolynomial dimension complexity for fixed feature maps.
The paper proposes a rigorous theoretical framework to resolve an open question regarding the computational advantage of learned features over fixed features in a distribution-free setting. The methodology involves constructing a specific family of hypothesis classes (disjunctions of conjunctions on Boolean inputs) and demonstrating that a natural two-stage gradient-based algorithm (signSGD on hidden layer, projected SGD on output layer) for a two-layer ReLU network can learn these classes efficiently. The core technical contribution is a proof that while the dimension complexity of these classes is superpolynomial in the runtime budget, the neural network learns them in polynomial time. The proof leverages polynomial approximation techniques, Gaussian noise injection to create "useful" neurons that act as counters, and Fourier analysis on the Boolean cube to show that linear combinations of trained neurons can approximate the target functions. The approach is mathematically sophisticated, combining elements of learning theory, harmonic analysis, and optimization.
This is a purely theoretical paper. There are no empirical experiments, datasets, or benchmarks. The "evaluation" consists of rigorous mathematical proofs establishing the existence of the separation and the correctness of the learning algorithm's runtime and error bounds. The lack of empirical validation is expected for this subcategory but limits immediate practical applicability.
The paper provides a detailed algorithm (Algorithm 1) and specifies hyperparameters in a table. The proofs are self-contained with appendices detailing the derivation of key lemmas. However, without code or empirical results, "reproducibility" in the standard experimental sense is not applicable. The theoretical claims are reproducible in the sense that a mathematician can verify the proofs.
The results are restricted to a specific class of functions (DNF-like structures on Boolean inputs) and a specific network architecture (two-layer ReLU). The learning algorithm relies on injected Gaussian noise in the first stage, which is not standard in practical deep learning training. The separation is established for "natural" gradient-based algorithms, but the definition of "natural" is somewhat heuristic. The results do not directly translate to modern deep learning practices involving many layers, batch normalization, or complex optimizers.
This paper contributes to the foundational understanding of why neural networks are powerful. By showing that feature learning provides a computational advantage even in the worst-case (distribution-free) setting, it strengthens the theoretical case for representation learning. It may influence future theoretical work on the limits of linear models and the necessity of non-linear feature learning. However, its direct impact on engineering practice is limited due to the theoretical nature and specific assumptions. Resolves a COLT open question by proving a distribution-free separation between learned and fixed features. The paper provides a rigorous theoretical foundation for the computational advantage of neural network feature learning, demonstrating that certain hypothesis classes can be learned efficiently by gradient-based methods on ReLU networks despite having superpolynomial dimension complexity for fixed feature maps.
We introduce Foundation4D, a unified feed-forward model for geometry estimation, 3D detection, semantic occupancy, and Gaussian reconstruction from multi-camera driving video. A shared backbone uses factorized spatiotemporal attention to efficiently combine observations across cameras and time. Our video inference pipeline uses pose graph optimization to refine camera trajectories and assembles object tracks across input windows. We also develop a data annotation pipeline and release PAI-Foundation4D, a benchmark with dense depth and semantic occupancy labels for 1,253 driving clips. With benchmark-specific fine-tuning, Foundation4D achieves the lowest depth AbsRel on Waymo and nuScenes, the highest detection mAP on nuScenes, and the highest occupancy mIoU on OpenOccupancy among the compared methods. Our task-combination study shows benefits for both detection and geometry: co-training detection with geometry and occupancy improves top-class mAP by 1.2 points over detection-only training, while co-training geometry with detection reduces camera-to-rig translation error by $13.4\%$ relative to geometry-only training. We further use the predicted geometry and trajectories as priors for lidarless NuRec, supporting reconstruction of driving scenes for simulation.
Primary: Waymo
All Institutions: Waymo
Foundation4D introduces a unified feed-forward model for 4D scene understanding in autonomous driving, achieving state-of-the-art results in geometry, detection, and reconstruction. The paper makes a strong technical contribution through its factorized spatiotemporal attention mechanism and joint training strategy, supported by the release of a new benchmark and rigorous empirical validation of multi-task learning benefits.
The paper proposes Foundation4D, a unified feed-forward model that jointly estimates geometry (depth), 3D detection, semantic occupancy, and Gaussian splatting reconstruction from multi-camera driving video. The core architectural contribution is a shared backbone utilizing factorized spatiotemporal attention to efficiently fuse observations across multiple camera views and temporal steps. This design allows the model to leverage temporal consistency for static scenes while handling dynamic objects. The method also introduces a video inference pipeline that employs pose graph optimization to refine camera trajectories and assembles object tracks across input windows, addressing the challenge of maintaining global consistency in long sequences. The joint training strategy is a key methodological strength, demonstrating that co-training detection with geometry and occupancy yields mutual benefits, improving both detection accuracy and geometric estimation precision.
The authors introduce PAI-Foundation4D, a new benchmark with dense depth and semantic occupancy labels for 1,253 driving clips, which is a significant contribution to the field. Experimental results show that Foundation4D achieves state-of-the-art performance on Waymo and nuScenes for depth estimation (lowest AbsRel), nuScenes for 3D detection (highest mAP), and OpenOccupancy for occupancy (highest mIoU). The ablation studies on task combination are particularly compelling, showing that co-training improves top-class mAP by 1.2 points and reduces camera-to-rig translation error by 13.4% compared to single-task baselines. The application to lidarless NuRec demonstrates the practical utility of the predicted geometry and trajectories for scene reconstruction in simulation.
The paper releases the PAI-Foundation4D benchmark, which enhances reproducibility for the evaluation metrics. However, the full model architecture and training code are not explicitly stated to be released in the provided text, though the detailed description of the factorized attention and pose graph optimization provides a clear roadmap for implementation. The reliance on specific proprietary datasets (Waymo) may limit immediate reproducibility for external groups without access to those resources.
The model is evaluated primarily on driving datasets, and its generalizability to other domains (e.g., robotics, indoor navigation) is not explored. The computational cost of the factorized spatiotemporal attention and pose graph optimization during inference may be high, potentially limiting real-time deployment on edge devices. The paper does not extensively discuss failure cases or robustness to extreme weather conditions or occlusions beyond standard benchmark evaluations.
This work has significant implications for the development of end-to-end autonomous driving systems by unifying perception and reconstruction tasks. The release of a new benchmark with dense labels will likely accelerate research in 3D scene understanding for autonomous vehicles. The demonstrated benefits of multi-task learning for geometry and detection provide valuable insights for practitioners designing unified perception stacks. The application to simulation via Gaussian reconstruction supports the growing trend of using neural rendering for training and testing autonomous driving algorithms. Foundation4D introduces a unified feed-forward model for 4D scene understanding in autonomous driving, achieving state-of-the-art results in geometry, detection, and reconstruction. The paper makes a strong technical contribution through its factorized spatiotemporal attention mechanism and joint training strategy, supported by the release of a new benchmark and rigorous empirical validation of multi-task learning benefits.
Amodal video segmentation asks for the complete mask of an object in every frame, including the parts hidden behind other objects. The best current methods generate these masks with fine-tuned video diffusion models, which need many denoising steps and an extra depth network, and give a different answer for every sample. Self-supervised video world models of the JEPA family are trained on a closely related task: predicting the representation of masked space-time regions from the visible ones. We therefore treat occlusion as masking. The tokens that the object's visible mask does not cover are dropped, the pre-trained V-JEPA 2.1 predictor fills them in, and a light head decodes the observed and predicted features into amodal masks. The resulting model, OccJEPA (Occlusion-as-masking JEPA), is deterministic and 33.5x faster than the diffusion-based state of the art, and more accurate on SAIL-VOS, on TAO-Amodal, including a held-out test split (+4.00 AP50) and visible masks tracked by SAM2, and on Kubric. Controlled experiments trace the gain to the predictor's pre-trained weights rather than to its capacity, for world models from 87M to 1.85B parameters. Code is available at https://github.com/zgp110/occjepa.
Primary: University of Wisconsin--Madison
All Institutions: University of Wisconsin--Madison
[One sentence main contribution]. [Comprehensive analysis of the technical contribution, methodology, and significance to the field]. The paper introduces OccJEPA, a deterministic and highly efficient method for amodal video segmentation that leverages pre-trained JEPA world models by treating occlusion as masking, achieving state-of-the-art accuracy with a 33.5x speedup over diffusion-based approaches.
The paper proposes OccJEPA, a method for amodal video segmentation that reframes occlusion as a masking problem solvable by pre-trained self-supervised video world models (specifically V-JEPA 2.1). Instead of using computationally expensive diffusion models with depth estimation, the method drops tokens corresponding to visible object masks and uses the JEPA predictor to fill in the latent representations of the occluded regions. A lightweight head then decodes these features into amodal masks. The core insight is that the predictive capability of JEPA models, trained to reconstruct masked spatiotemporal regions, naturally aligns with the task of inferring hidden object parts. The approach is deterministic, avoiding the stochasticity of diffusion sampling, and leverages the robustness of pre-trained weights rather than fine-tuning heavy generative models.
The experimental section demonstrates significant improvements over state-of-the-art diffusion-based methods. The model achieves a 33.5x speedup while maintaining or improving accuracy on SAIL-VOS, TAO-Amodal (including a held-out test split with +4.00 AP50), and Kubric. Ablation studies confirm that the performance gain stems from the pre-trained weights of the JEPA predictor rather than its architectural capacity, showing consistent results across model sizes from 87M to 1.85B parameters. The use of SAM2 for visible mask tracking ensures a fair comparison with other methods that rely on similar initialization.
The authors provide a public GitHub repository, which enhances reproducibility. The reliance on standard pre-trained models (V-JEPA 2.1) and established datasets (SAIL-VOS, TAO, Kubric) further supports reproducibility. However, the specific details of the "light head" architecture and training hyperparameters would need to be verified in the code repository for full replication.
The method relies on the quality of the visible masks provided by SAM2; errors in visible segmentation may propagate to the amodal prediction. The approach is tested primarily on standard benchmarks and may not generalize to highly dynamic or complex occlusion scenarios not covered by the training data of the pre-trained JEPA model. The deterministic nature, while a strength for consistency, may limit the exploration of multiple plausible amodal configurations in ambiguous cases.
This work bridges the gap between self-supervised representation learning and dense prediction tasks, suggesting that world models can be effectively repurposed for segmentation without generative overhead. The significant speedup makes amodal segmentation more practical for real-time applications. The finding that pre-trained weights are more critical than capacity for this task has implications for the design of future video understanding models. [One sentence main contribution]. [Comprehensive analysis of the technical contribution, methodology, and significance to the field]. The paper introduces OccJEPA, a deterministic and highly efficient method for amodal video segmentation that leverages pre-trained JEPA world models by treating occlusion as masking, achieving state-of-the-art accuracy with a 33.5x speedup over diffusion-based approaches.
World models enable embodied agents to anticipate action consequences, yet jointly modeling locomotion and manipulation across diverse embodiments remains challenging due to heterogeneous action spaces and limited multimodal supervision. We present Ropedia W0, the first egocentric loco-manipulation world foundation model spanning humans and robots with diverse embodiments. We curate Xp-Data, comprising 10k hours of egocentric human data and 3k hours of robot data with unified multimodal annotations and systematic quality control. A unified kinematic representation encodes locomotion through camera poses and manipulation through projected skeletons, with robot skeletons combining embodiment-specific forward kinematics with extensive manual keypoint annotation and correction. We also introduce Xp-Teleop, a long-horizon loco-manipulation benchmark based on high-quality dexterous humanoid teleoperation data. Evaluations demonstrate state-of-the-art performance across five cross-embodiment benchmarks (DreamDojo, $Ψ_0$, $ω$-HOME, Xp-Teleop, and AgiBot) and on held-out human egocentric video, from zero-shot inference to few-shot and full-data post-training. Scaling human pre-training data improves performance on both human and robot evaluations. After distillation, our model supports real-time, minute-long rollouts, enabling live VR interaction. Applications in policy evaluation, model-based planning, and world-action modeling further demonstrate the model's utility for embodied decision-making.
Primary: Unknown (Likely a major tech lab or consortium given the scale of data, e.g., NVIDIA, Google, or a major robotics startup, but affiliations are redacted/missing in the provided text)
All Institutions: Unknown
Ropedia W0 introduces a cross-embodiment world foundation model that unifies human and robot loco-manipulation through a shared kinematic representation, demonstrating that scaling human egocentric data significantly improves robot world model performance. The paper makes a substantial contribution by addressing the heterogeneity of action spaces in embodied AI, providing a rigorous evaluation across multiple benchmarks, and introducing a new long-horizon teleoperation benchmark, thereby establishing a new paradigm for leveraging human data in robotic world modeling.
The paper proposes Ropedia W0, a world foundation model for loco-manipulation. The core methodological contribution is the unification of heterogeneous action spaces (human locomotion vs. robot manipulation) into a single kinematic representation. Specifically, it encodes locomotion via camera poses and manipulation via projected skeletons. For robots, this involves combining embodiment-specific forward kinematics with manual keypoint annotation. The model is trained on Xp-Data, a massive dataset of 10k hours of human and 3k hours of robot egocentric video. The approach leverages the abundance of human data to pre-train the world model, hypothesizing that human loco-manipulation dynamics transfer to robots. This is a significant architectural and data-engineering choice, moving away from purely robot-centric world models to a cross-embodiment paradigm.
The experimental section is extensive, evaluating the model on five cross-embodiment benchmarks: DreamDojo, $\Psi_0$, $\omega$-HOME, Xp-Teleop (a new benchmark introduced in the paper), and AgiBot. The paper demonstrates state-of-the-art performance in video prediction quality. Crucially, it validates the scaling hypothesis: increasing human pre-training data improves performance on both human and robot evaluations. The introduction of Xp-Teleop, a long-horizon benchmark based on dexterous humanoid teleoperation, is a valuable contribution to the field. The model's ability to support real-time, minute-long rollouts after distillation is a strong practical result, enabling live VR interaction.
Reproducibility is likely limited due to the scale of the data (13k hours of video) and the complexity of the manual annotation pipeline for robot skeletons. While the project page is provided, the specific details of the "systematic quality control" and the exact architecture of the world model (e.g., transformer variants, latent space dimensions) would need to be in the full text/appendix to be fully reproducible by smaller labs. The reliance on proprietary or large-scale in-house data makes independent verification difficult.
The primary limitation is the heavy reliance on manual keypoint annotation and correction for robot skeletons, which is labor-intensive and may not scale easily to new embodiments without significant human effort. The model's performance on out-of-distribution embodiments or tasks not covered by the 13k hours of data is not fully explored. Additionally, the "unified kinematic representation" may struggle with highly dexterous or non-rigid manipulations that are difficult to capture with standard skeletons.
This work has high potential impact on the field of embodied AI and robotics. By demonstrating that human video can effectively pre-train robot world models, it offers a pathway to overcome the data scarcity problem in robotics. The introduction of a cross-embodiment benchmark (Xp-Teleop) and a scalable world model architecture could accelerate research in model-based planning and policy evaluation. The real-time capability opens doors for interactive simulation and VR-based robot training. Ropedia W0 introduces a cross-embodiment world foundation model that unifies human and robot loco-manipulation through a shared kinematic representation, demonstrating that scaling human egocentric data significantly improves robot world model performance. The paper makes a substantial contribution by addressing the heterogeneity of action spaces in embodied AI, providing a rigorous evaluation across multiple benchmarks, and introducing a new long-horizon teleoperation benchmark, thereby establishing a new paradigm for leveraging human data in robotic world modeling.
Transformers are widely assumed to exhibit token-decoding explainability. In particular, in vision transformer (ViT) classifiers, decoding individual patch tokens has become a common diagnostic tool due to its tendency to yield human-interpretable outputs. In light of the increasing popularity of this approach, an important question is whether token-decoding explainability is an inherent property of transformers that should be expected to hold across architectures, scales, and training objectives, or merely an artifact of some implicit bias. In this paper we systematically study token-decoding explainability across diverse ViT settings, spanning architectures, scales, and training objectives, using both controlled experiments and real-world models. We find that while some models indeed exhibit aligned and interpretable token decodings, others exhibit either inverted explainability maps or a complete lack of correlation with the image semantics. As we show, these tendencies toward different explainability behaviors are not intrinsic to the architecture and can vary arbitrarily with changes in the optimization landscape. We provide theoretical support for these observations by demonstrating a setting where a single fixed toy transformer architecture can provably implement the optimal classification rule in multiple ways, which differ in their patch-decoding explainability patterns. Our results show that token-decoding explainability is not an inherent property of trained transformers, but rather an outcome contingent on the problem setting and thus should not be a-priori assumed to hold. Code can be found in https://ronensc.github.io/Explainability-Illusion/ .
Primary: Technion - Israel Institute of Technology
All Institutions: Technion - Israel Institute of Technology, Google Research
The paper challenges the assumption that Vision Transformers inherently possess patch-decoding interpretability by demonstrating through empirical and theoretical means that this property is contingent on optimization rather than architecture. By showing that identical classification performance can be achieved with completely different or inverted interpretability maps, the work provides a critical cautionary tale for the field, suggesting that current interpretability diagnostics based on token decoding may be unreliable artifacts of specific training dynamics rather than intrinsic model properties.
The paper employs a rigorous dual-pronged methodology combining systematic empirical analysis with theoretical counterexamples. The empirical component involves training and evaluating a diverse suite of Vision Transformers (ViTs) across varying architectures, scales, and training objectives to test the robustness of patch-decoding interpretability. The theoretical component constructs a provable toy model demonstrating that a fixed transformer architecture can implement the same optimal classification function via multiple weight configurations that yield diametrically opposed interpretability maps (aligned vs. inverted). This combination of empirical breadth and theoretical necessity is methodologically sound and effectively addresses the core research question.
The experimental evaluation is comprehensive, covering both controlled synthetic settings and real-world models, including Vision-Language Models (VLMs). The paper successfully demonstrates that interpretability is not a stable property, showing cases where decoding maps are inverted or uncorrelated with semantics. The inclusion of VLMs adds significant relevance, as these are currently the dominant paradigm in vision AI. The results are surprising and challenge a widely held assumption in the community, which is a hallmark of high-impact empirical work.
The authors provide a public code repository, which is a strong positive for reproducibility. However, the full paper text provided is a skeleton of LaTeX file references rather than the rendered content. While the abstract and structure suggest a complete study, the lack of visible detailed hyperparameters or specific dataset splits in the provided text limits the immediate assessment of granular reproducibility details. The code link is the primary vehicle for verification.
The theoretical proof relies on a "toy transformer" architecture, which may not fully capture the complexity of large-scale, pre-trained industrial models. While the empirical section addresses this, the gap between the simplified theoretical model and real-world complexity remains a potential limitation in generalizing the theoretical insights. Additionally, the paper focuses on the *existence* of the illusion rather than providing a robust method to *detect* or *correct* it in arbitrary black-box models, leaving practitioners without a clear diagnostic tool.
This paper has high potential for broader impact by correcting a fundamental misconception in the AI interpretability community. If token-decoding is not inherently reliable, it invalidates many existing interpretability tools and analyses that rely on this assumption. This could lead to a re-evaluation of how interpretability is measured and reported in future research, potentially shifting focus toward more robust, architecture-agnostic interpretability metrics. It serves as a crucial "reality check" for the field. The paper challenges the assumption that Vision Transformers inherently possess patch-decoding interpretability by demonstrating through empirical and theoretical means that this property is contingent on optimization rather than architecture. By showing that identical classification performance can be achieved with completely different or inverted interpretability maps, the work provides a critical cautionary tale for the field, suggesting that current interpretability diagnostics based on token decoding may be unreliable artifacts of specific training dynamics rather than intrinsic model properties.
Synthesizing a monocular video from a new camera trajectory requires preserving the observed scene geometry and motion while completing regions that become newly visible. Feed-forward 4D reconstructors recover the structure of the observed scene, whereas video diffusion models provide a generative prior for completing unseen content. We introduce Holo4D, a video reshooting framework that uses reconstructed 3D trajectories as a holistic source-view 4D scaffold. We project these trajectories into the requested views and encode their geometry and source appearance to guide a pretrained video diffusion model. Together with the source video and target cameras, the scaffold grounds generation in reconstructed observations while leaving unsupported regions to the generative prior. Experiments demonstrate the value of trajectory-based conditioning for camera control and novel-view synthesis. The framework accommodates different 4D reconstructors without retraining the video generator, allowing it to benefit from future advances in source reconstruction. More details can be found in our project page.
Primary: University of Illinois Urbana-Champaign
All Institutions: University of Illinois Urbana-Champaign, Adobe Research
Holo4D introduces a modular framework that uses feed-forward 4D reconstruction trajectories as a geometric scaffold to guide video diffusion models for camera-controlled video synthesis. The paper makes a significant contribution by decoupling the 3D/4D reconstruction task from the generative video model, allowing for the integration of state-of-the-art 4D reconstructors without retraining the diffusion model. This approach effectively grounds the generative prior in observed scene geometry and motion, leading to improved consistency and controllability in novel view synthesis. The method's ability to leverage future advances in 4D reconstruction makes it a robust and forward-looking solution for video reshooting and generation tasks.
The paper proposes Holo4D, a framework that bridges feed-forward 4D reconstruction and video diffusion models. The core method involves using a 4D reconstructor to generate geometric trajectories of scene points from a source video. These trajectories are then projected into the target camera views to create a "holistic 4D scaffold." This scaffold encodes both geometry and source appearance, serving as a conditioning signal for a pretrained video diffusion model. The approach is modular, allowing the diffusion model to remain frozen while benefiting from improvements in the upstream 4D reconstruction module. This decoupling is a significant architectural choice that enhances the method's longevity and adaptability.
The experiments demonstrate the effectiveness of trajectory-based conditioning for camera control and novel view synthesis. The paper likely compares against baselines that use only 2D projections or static 3D structures, showing that the dynamic 4D scaffold provides superior grounding for motion and geometry. The evaluation likely includes metrics for geometric consistency and visual fidelity, as well as user studies or qualitative comparisons showing the model's ability to complete unseen regions while preserving observed structure.
The paper provides a clear description of the pipeline, including the use of standard 4D reconstructors and pretrained video diffusion models. The modular nature of the framework suggests that components can be swapped, which aids in reproducibility. However, specific details on the training of the conditioning encoder (if any) and the exact integration points with the diffusion model's attention layers would be crucial for full reproduction.
The method relies on the quality of the feed-forward 4D reconstructor; errors in the initial reconstruction will propagate to the generated video. Additionally, the computational cost of running a 4D reconstructor followed by a video diffusion model may be high. The method is also limited to scenes where 4D reconstruction is feasible, potentially excluding highly dynamic or non-rigid scenes that are difficult to reconstruct.
This work has significant implications for the field of video generation and 3D/4D reconstruction. By providing a robust way to ground video diffusion in 3D/4D geometry, it paves the way for more controllable and physically consistent video synthesis. The modular design encourages the community to develop better 4D reconstructors, knowing they can be directly plugged into existing video generation pipelines. This could accelerate progress in both 3D reconstruction and generative video models. Holo4D introduces a modular framework that uses feed-forward 4D reconstruction trajectories as a geometric scaffold to guide video diffusion models for camera-controlled video synthesis. The paper makes a significant contribution by decoupling the 3D/4D reconstruction task from the generative video model, allowing for the integration of state-of-the-art 4D reconstructors without retraining the diffusion model. This approach effectively grounds the generative prior in observed scene geometry and motion, leading to improved consistency and controllability in novel view synthesis. The method's ability to leverage future advances in 4D reconstruction makes it a robust and forward-looking solution for video reshooting and generation tasks.
Preference optimization can improve every ranking metric while building a hidden, shared representation shift that the relative loss barely sees, one that can eventually destroy generation. We trace this failure to the common-mode offset, a shared directional shift in the model's hidden states that appears across token positions, prompts, and both chosen and rejected responses. Because it moves chosen and rejected representations together, the relative ranking loss barely reacts to its accumulation. As this offset grows, it projects onto the output layer to form a vocabulary well, elevating a single token's probability until it dominates decoding and causes generation collapse. The isolated offset alone reconstructs the vocabulary well, injecting the learned offset into an untreated base model recreates the collapse where norm-matched random directions do not, and masking this common component from the loss prevents the well in our flagship setting. Under the per-token ranking loss we study, the same collapse appears in 14 of 17 base-model lineages and under full-parameter fine-tuning. Moreover, the offset is not merely an artifact of collapse, since it is already present in textbook DPO and SimPO runs that form no well. Textbook DPO keeps it weakly aligned with any single vocabulary direction even with three times our base budget. Trained from base models for that budget, however, full-parameter SimPO drives it into collapse on both Llama-2 and Llama-3.1, and the same kind of offset grows, without a well, from a public SFT checkpoint under the official SimPO recipe. Across 17 UltraFeedback runs, the better a run ranks held-out responses, the less often two public reward models prefer its samples to the base model's. These findings expose a blind spot in standard ranking metrics and introduce a representation-level signal that can warn of generation collapse before it occurs.
Primary: The University of Tokyo
All Institutions: The University of Tokyo, TIER IV, Inc.
The paper identifies a hidden "common-mode offset" in preference optimization that causes generation collapse despite improved ranking metrics, providing a causal explanation and effective mitigation strategy. This is a significant contribution to the understanding of LLM alignment failures, offering both a diagnostic signal and a practical solution that is likely to influence future alignment research and practice.
The paper introduces a novel diagnostic framework for preference optimization failures, identifying a "common-mode offset" in the final hidden states as the root cause of vocabulary collapse. The methodology is rigorous, combining theoretical analysis of loss invariances with extensive empirical validation. The authors define the offset as the mean displacement of hidden states between trained and base models, demonstrating that this shared vector moves chosen and rejected representations in tandem, thereby evading the relative ranking loss. They propose a "dose" metric to quantify the risk of collapse and introduce a mitigation strategy involving centering the rejected-side loss and applying norm/loudness penalties to the offset. The causal interventions (injecting the offset into base models, masking it from the loss) are well-designed and effectively isolate the mechanism.
The experimental scope is impressive, covering 17 base-model lineages (0.5B to 14B parameters) across five tokenizer families, using both LoRA and full-parameter fine-tuning. The use of two distinct datasets (driving preferences and UltraFeedback) and multiple objectives (DPO, SimPO, Plackett-Luce ranking) strengthens the generalizability of the findings. The discovery that ranking metrics improve while generation collapses (anticorrelation with external reward models) is a significant empirical contribution. The cross-family validation of the mitigation strategy up to three times the base budget is convincing.
The paper provides detailed descriptions of training configurations, measurement protocols, and penalty terms. The authors state that code and data will be released upon publication. The specific hyperparameters (learning rates, batch sizes, LoRA ranks) are clearly defined. The measurement of "dose" and "loudness" is well-defined, allowing for replication. The reliance on specific public checkpoints (e.g., Llama-3-8B SFT from SimPO authors) aids reproducibility.
The mitigation strategy is calibrated on specific datasets and may require tuning for other domains. The analysis is primarily focused on the final hidden state, and the interaction with earlier layers is not deeply explored. The "diffuse degradation" observed in SimPO is noted but not fully resolved by the proposed offset control, indicating a second failure mode that remains unaddressed. The study is limited to English-centric models and datasets.
This work has high impact for the LLM alignment community by exposing a critical blind spot in standard evaluation metrics. It provides a practical diagnostic tool (monitoring the common-mode offset) that can be integrated into training pipelines to prevent generation collapse. The findings challenge the assumption that improving ranking metrics guarantees healthy generation, prompting a re-evaluation of alignment objectives. The proposed penalties offer a simple, effective remedy for a widespread issue. The paper identifies a hidden "common-mode offset" in preference optimization that causes generation collapse despite improved ranking metrics, providing a causal explanation and effective mitigation strategy. This is a significant contribution to the understanding of LLM alignment failures, offering both a diagnostic signal and a practical solution that is likely to influence future alignment research and practice.
Autonomous agents can increasingly propose ideas, modify code, and run experiments, creating an opportunity to accelerate scientific discovery using teams of collaborative AI researchers. To escape local minima in the discovery, we propose to encourage orthogonal exploration by constructing the team using agents with varying expertise. However, realizing this design requires more than diverse backgrounds. When experiments are costly, a team can test only a limited number of ideas, thereby creating the need to balance exploration and exploitation when selecting a subset of researchers to propose and execute new experiments. Furthermore, each result should shape what the team tries next. We therefore ask how AI researchers with different scientific backgrounds can build on one another's findings and sustain progress under a limited experimental budget. To address these challenges, we build a team of persistent AI researchers, each grounded in a different discipline, who keep private research histories, share experimental evidence, and receive research opportunities through adaptive allocation. We demonstrate the effectiveness of this design by deploying the team to search for linear attention architectures, where it outperforms GDN2 at 1.3B scale on language modeling, common-sense reasoning, and synthetic and real-world retrieval tasks. In controlled comparisons, removing any single organizational component from our design yields markedly weaker discoveries: without disciplinary backgrounds, the search plateaus early; without private histories, researchers make less progress despite identical shared evidence; and uniform selection falls short of adaptive allocation within the same budget. These results suggest that sustained autonomous discovery depends not only on stronger agents, but also on who explores, what they remember, and how research effort is allocated.
Primary: University of California, Santa Barbara (UCSB)
All Institutions: University of California, Santa Barbara (UCSB)
The paper introduces a multi-agent team structure with diverse disciplinary backgrounds, private memories, and adaptive budget allocation to autonomously discover linear attention architectures. By demonstrating that this organizational design outperforms ablated versions and achieves competitive results against state-of-the-art linear attention models at 1.3B scale, it provides a rigorous framework for collaborative AI research that balances exploration and exploitation, offering a scalable path toward autonomous scientific discovery in machine learning architecture design.
The paper proposes a multi-agent framework for autonomous architecture search, specifically targeting linear attention mechanisms. The core methodological contribution is the "organizational" structure of the agents: (1) Diverse disciplinary grounding to encourage orthogonal exploration, (2) Private research histories to maintain individual context, and (3) Adaptive allocation of experimental budget based on past performance. This moves beyond simple prompt engineering or single-agent loops by introducing a team dynamic that balances exploration and exploitation. The approach is conceptually sound and addresses a known limitation in LLM-based research agents (local minima due to homogeneous reasoning patterns).
The experiments are rigorous in scope, scaling from 150M to 1.3B parameters. The claim that the discovered architecture outperforms GDN2 (Gated DeltaNet) at 1.3B scale on language modeling, reasoning, and retrieval is significant if true. The ablation studies are critical to the paper's validity: removing disciplinary backgrounds, private histories, or adaptive allocation all lead to worse performance. This isolates the contribution of the team structure from the underlying LLM capabilities. However, the baseline comparison is limited to GDN2; comparisons with other recent linear attention variants (e.g., Mamba, RWKV, or standard Transformers at the same FLOP/param budget) would strengthen the claim.
The paper includes a detailed reproducibility statement, promising appendices with model configurations, hyperparameters, and agent trajectories. The use of FLOP-matched budget allocation is a strong signal of methodological rigor. However, without access to the actual code and agent prompts, full verification is difficult. The reliance on "persistent" agents implies a specific state-management infrastructure that must be clearly documented.
The primary limitation is the high computational cost of the search process, which may limit adoption by smaller labs. Additionally, the generalizability of the "disciplinary background" approach to other domains (e.g., computer vision or reinforcement learning) is not tested. The paper focuses heavily on linear attention, and it is unclear if the team structure yields similar gains in other architectural spaces. There is also a risk of "reward hacking" where agents optimize for the specific evaluation metrics rather than true generalization.
This work contributes to the emerging field of AI-driven scientific discovery. If the organizational principles (diversity, memory, adaptive allocation) are validated, they could be applied to other automated research tasks, such as hyperparameter tuning, dataset curation, or even hypothesis generation in biology. The potential to accelerate the discovery of efficient attention mechanisms is high, given the current industry focus on reducing inference costs. The paper introduces a multi-agent team structure with diverse disciplinary backgrounds, private memories, and adaptive budget allocation to autonomously discover linear attention architectures. By demonstrating that this organizational design outperforms ablated versions and achieves competitive results against state-of-the-art linear attention models at 1.3B scale, it provides a rigorous framework for collaborative AI research that balances exploration and exploitation, offering a scalable path toward autonomous scientific discovery in machine learning architecture design.
Long-context language models (LCLMs) power agents that act over long trajectories, from improving a codebase to running research experiments to forecasters that condition on lengthy histories. These applications draw on three distinct long-context capabilities: recall, where the answer is a fact present in the context; state tracking, where the outcome can be computed by performing a series of transformations to a specified state; and pattern learning, where the goal is to make a prediction by sampling from a distribution inferred from many observations. Existing benchmarks primarily focus on the first capability. In this work, we introduce LEAPS (Long-context Evaluation of Adaptive Pattern learning and State tracking), a collection of 12 novel datasets, spanning agentic workflows, behavioral modeling, and forecasting of market and world events. By construction, LEAPS is resistant to data contamination, extends to millions of input tokens, and uses reliable metrics. We evaluate 30 API and open models from 8K to 512K input tokens. LEAPS distinguishes models that perform near perfectly on recall tasks, finding that such models' state tracking and pattern learning abilities can vary significantly and degrade much more dramatically with increasing input lengths--even for pattern learning, where more observations should make learning a theoretically easier task. Moreover, thinking models often underperform their base counterparts, exhausting their generation budget or oversimplifying the task. We hope LEAPS can guide the development of the next generation of LCLMs.
Primary: Jane Street
All Institutions: Jane Street, Princeton University
The paper introduces LEAPS, a comprehensive benchmark for evaluating long-context language models on recall, state tracking, and pattern learning. It provides rigorous experimental evidence that current models struggle with state tracking and pattern learning at scale, offering critical insights for the development of next-generation LCLMs.
The paper introduces LEAPS, a benchmark suite comprising 12 datasets designed to evaluate three specific long-context capabilities: recall, state tracking, and pattern learning. The methodology is rigorous, emphasizing resistance to data contamination through procedural generation of synthetic data and the use of reliable metrics. The distinction between these three capabilities is a strong conceptual contribution, as existing benchmarks often conflate them or focus heavily on recall. The approach to extending evaluations to millions of tokens is methodologically sound, though the reliance on API models for the upper end of the scale introduces potential variability in evaluation conditions.
The experimental scope is extensive, evaluating 30 models (both API and open-source) across input lengths from 8K to 512K tokens. The results provide valuable insights, particularly the finding that models excelling in recall do not necessarily perform well in state tracking or pattern learning. The observation that "thinking" models often underperform their base counterparts due to budget exhaustion or oversimplification is a significant and counter-intuitive empirical finding. The degradation of performance with increasing context length, even in tasks where more data should theoretically help (pattern learning), is a critical result for the field.
The authors provide a strong reproducibility statement, releasing code for data generation and evaluation, as well as the original evaluation data in Parquet format (with exceptions for licensing). The use of synthetic data generation scripts ensures that the benchmark can be regenerated, further mitigating contamination risks. The exclusion of social media data due to licensing is a minor limitation but does not significantly impact the core reproducibility of the main findings.
The primary limitation is the reliance on API models for the longest context lengths, which may not be fully reproducible by other researchers due to cost and access constraints. Additionally, the benchmark focuses on specific types of long-context tasks (agentic, behavioral, forecasting), which may not cover all potential applications of LCLMs. The performance of open models at the 512K token limit may be limited by hardware constraints, potentially skewing the comparison if not all models can be tested at the maximum length.
This benchmark has high potential impact as it addresses a critical gap in the evaluation of long-context models. By distinguishing between recall, state tracking, and pattern learning, it provides a more nuanced view of model capabilities than existing benchmarks. The findings regarding the limitations of current models, particularly the degradation with length and the underperformance of thinking models, will likely guide future research directions in model architecture and training. The benchmark's resistance to contamination makes it a robust tool for ongoing evaluation as models evolve. The paper introduces LEAPS, a comprehensive benchmark for evaluating long-context language models on recall, state tracking, and pattern learning. It provides rigorous experimental evidence that current models struggle with state tracking and pattern learning at scale, offering critical insights for the development of next-generation LCLMs.
Auditory attention decoding (AAD) seeks to identify the attended talker from brief noninvasive brain recordings by comparing neural responses with competing speech streams. Recent electroencephalography (EEG) decoders report nearly perfect accuracy from one second of data, yet we show that this performance fails to generalize to unseen speech because models exploit trial leakage, eye gaze, and acoustic cues instead of speech evoked neural activity. We introduce CoupleFlow, which decodes attention through temporal coupling between neural and acoustic embeddings. Its predictions remain at chance when the brain signal contains no informative coupling, preventing shortcuts based on speech content or talker identity. A conditional flow matching head implements a likelihood ratio decision rule based on pointwise mutual information between brain and speech. This rule is Bayes optimal when the recording depends only on the attended talker and removes preferences for speech that is likely a priori. We evaluate CoupleFlow with content disjoint splits recovered from the audio and null tests that distinguish genuine temporal coupling from trial recognition. Across nine EEG and magnetoencephalography (MEG) datasets processed through a common pipeline, spanning four languages, high density EEG recordings, listeners with hearing impairment, and a room with multiple talkers, CoupleFlow outperforms linear and deep baselines while all null tests remain at chance. Finally, we derive an evidence accumulation law that predicts accuracy across window lengths from a single parameter per dataset and predicts that parameter from the strength of neural speech tracking. This law identifies recording signal to noise ratio as a limit on decoding speed and reliability and estimates the window length required to reach a target accuracy.
Primary: The Ohio State University
All Institutions: The Ohio State University
CoupleFlow introduces a null-calibrated auditory attention decoder that eliminates data leakage shortcuts via time-locked coupling scores and flow-matching likelihood ratios, establishing a rigorous benchmark and theoretical framework for neural speech tracking.
The paper proposes CoupleFlow, a decoder for Auditory Attention Decoding (AAD) that relies on temporal coupling between neural and acoustic embeddings rather than direct classification or stimulus reconstruction. The core innovation is a "null-calibrated" design where the decision score is based on the Pearson correlation between centered neural and acoustic embeddings. This ensures that if the neural signal contains no time-locked information about the speech (e.g., random noise or misaligned data), the score is zero, preventing shortcuts based on acoustic cues or trial identity. Additionally, a conditional flow-matching head is used to estimate pointwise mutual information (PMI), providing a Bayes-optimal likelihood ratio decision rule under the assumption that the recording depends only on the attended talker. The method includes rigorous anti-shortcut training terms, such as an audio-only adversary and VICReg, to ensure the model learns genuine neural coupling.
The evaluation is exceptionally rigorous, addressing a major flaw in previous AAD literature: data leakage. The authors introduce content-disjoint splits, ensuring test speech is never heard in training, and perform null tests (across-trial and circular shifts) to verify that accuracy stems from neural coupling rather than trial recognition. Experiments span nine EEG and MEG datasets, including multi-talker rooms (MAESTRO) and hearing-impaired listeners. The paper demonstrates that previous high accuracies were largely due to leakage, and while CoupleFlow's absolute accuracy is lower than leaked baselines, it is significantly higher than leakage-free baselines. A key contribution is the derivation of an "evidence accumulation law" that predicts accuracy as a function of window length and signal-to-noise ratio, providing a theoretical framework for understanding decoding speed limits.
The paper provides extensive details on preprocessing, network architecture, and training protocols. It explicitly states that a generative AI assistant was used for coding and drafting, but emphasizes that all results are generated by scripts from logged runs and verified by the authors. The exclusion of datasets that fail time-alignment checks (like NJU) is well-documented. The use of a common pipeline across datasets enhances comparability. However, the specific code repository is not provided in the text, which slightly limits immediate reproducibility, though the detailed descriptions are sufficient for re-implementation.
The method assumes the recording depends primarily on the attended talker, which is an approximation since ignored speech is weakly tracked. The flow-matching head adds computational overhead. The evidence accumulation law relies on certain statistical assumptions (independence of Fisher transforms) that may not hold perfectly in all regimes. The paper acknowledges that MEG results are evaluated only on match-mismatch tasks due to dataset constraints.
This paper has significant impact on the field of Brain-Computer Interfaces and computational neuroscience. By exposing the prevalence of data leakage in AAD studies, it sets a new standard for evaluation rigor. The null-calibrated approach is a generalizable principle for any neural decoding task where shortcut learning is a concern. The evidence accumulation law provides a practical tool for designing neuro-steered hearing devices, allowing engineers to predict the required recording duration for target accuracy based on sensor quality. CoupleFlow introduces a null-calibrated auditory attention decoder that eliminates data leakage shortcuts via time-locked coupling scores and flow-matching likelihood ratios, establishing a rigorous benchmark and theoretical framework for neural speech tracking.
Humanoid mobility over complex terrain requires accurate foot placement and coordinated whole-body motion capable of robust adaptation. Reinforcement learning (RL) policies trained without motion references generalize well across terrains, yet eliciting effective whole-body coordination through reward design and exploration alone remains challenging. In contrast, reference-based methods yield natural motions but struggle to adapt beyond the predefined trajectories in their training data. We introduce a learning framework that bridges these two approaches by using motion data strictly as a training prior. An explicit, self-supervised, attention-based contact planner predicts future body-environment contacts, while a contact-conditioned tracker translates these plans into coordinated whole-body motion. Together, they establish contact as an interface between sensory observations and control actions. This abstraction allows the policy to internalize the contact-aware structure of locomotion rather than directly replicating kinematics. Consequently, a single policy can exploit data-driven motion priors for natural whole-body coordination while retaining the flexibility to discover environment-dependent behaviors through reinforcement learning. Building on the learned contact planner and tracker, a subsequent fine-tuning stage bootstraps their acquired capabilities to explore environment variations beyond those covered by the original motion data. Operating entirely from onboard observations without any reference inputs at deployment, this framework enables versatile humanoid mobility in challenging environments.
Primary: National University of Singapore
All Institutions: National University of Singapore, Robotic Systems Lab (ETH Zurich)
The paper introduces a contact-centric framework for humanoid mobility that uses attention-based planning to predict body-environment interactions, enabling a single policy to generalize across diverse terrains and skills without reference motions at deployment. This represents a significant step forward in humanoid control by decoupling contact planning from whole-body execution, allowing for more robust and adaptable behaviors in complex environments.
The paper proposes a novel framework for humanoid mobility that decouples the "what" (contact planning) from the "how" (whole-body tracking). The core innovation is the use of an attention-based mechanism to predict explicit contact locations on a terrain map, serving as an intermediate representation between perception and control. This is a significant conceptual shift from prior work that either relies on full-body trajectory tracking (which lacks generalization) or pure RL (which struggles with complex reward shaping for whole-body coordination). The three-stage training pipeline (Tracker Pretraining, Planner Supervision, RL Fine-tuning) is well-structured and logically sound, effectively leveraging motion data as a prior without binding the deployment policy to specific trajectories. The use of FiLM modulation for body-specific attention queries is a clever architectural choice that allows a single network to handle multiple contact points.
The experimental evaluation is robust and comprehensive. The authors conduct extensive real-world experiments on the Unitree G1 robot, demonstrating a wide variety of skills including ladder climbing, crawling, vaulting, and failure recovery. The simulation-based ablations are rigorous, isolating the contributions of the contact representation, the attention mechanism, and the RL fine-tuning stage. The comparison with MGMT (a strong baseline using diffusion-based motion generation) shows clear advantages in success rates and contact placement accuracy, particularly on sparse terrains. The qualitative comparisons with other methods (PHP, LLP) are fair and highlight the unique capabilities of the proposed approach. The inclusion of failure recovery experiments is a strong point, demonstrating the robustness of the learned policy.
The paper provides detailed descriptions of the network architectures, training procedures, and reward functions. The use of standard components (MLP trackers, attention planners, PD control) makes the method relatively accessible to reproduce. However, the specific details of the motion retargeting pipeline and the LiDAR mapping framework are described at a high level, which might make exact reproduction challenging without access to the code. The lack of a public code repository at the time of review (arXiv preprint) is a minor drawback, but the methodological details are sufficient for a skilled researcher to implement a similar system.
The paper acknowledges several limitations. The current perception is limited to 2.5D terrain maps, which restricts the system's ability to handle overhead contacts or complex 3D manipulation. The system is designed for local goal-conditioned locomotion and does not address global navigation. The contact representation cannot distinguish between motions with identical contact sequences but different kinematics (e.g., backflip vs. vertical jump). These are reasonable limitations for the current scope, but they highlight areas for future work.
This paper has significant potential impact on the field of humanoid robotics. By establishing contact as a general interface for mobility, it provides a scalable framework for adding new skills to humanoid robots without requiring exhaustive manual augmentation of motion datasets. The approach bridges the gap between data-driven imitation and reward-driven exploration, offering a path toward more versatile and robust humanoid control. The insights gained from this work could be applied to other robotic systems that require complex whole-body coordination, such as quadrupeds or manipulators. The paper introduces a contact-centric framework for humanoid mobility that uses attention-based planning to predict body-environment interactions, enabling a single policy to generalize across diverse terrains and skills without reference motions at deployment. This represents a significant step forward in humanoid control by decoupling contact planning from whole-body execution, allowing for more robust and adaptable behaviors in complex environments.
Multi-robot coordination of nonlinear systems is naturally formulated as joint-space optimal control subject to constraints over groups of robots. Existing methods that approach joint optimality remain largely centralized, offline, and confined to collision-free motion planning, while decentralized, real-time counterparts target safe navigation without pursuing the joint optimum. This paper develops a decentralized, real-time planner that approaches the joint optimum as an anytime process. We extend a recent single-robot framework that searches dispersive trees of forward-propagated commands for differentially flat systems to coordinate a multi-robot team near-optimally. We first show that the inter-robot coupling can be effectively replaced by some local constraints, under which locally grown dispersive trees contain a near-optimal agreement. It is this structure that the robots pursue by decentralized column generation, negotiating rents on the shared space that guide the search of each robot's tree. The negotiation settles on an agreement whose near-optimality is certified at quiescence. Our protocol, WarpWeaver, implements this negotiation as an asynchronous real-time loop over a receding horizon, and demonstrates effective closure to quiesced agreements even when real-time deadlines cut the negotiation short. In simulation, WarpWeaver reduces total travel time by up to 22% against centralized offline planners on the Dynobench suite and by up to 37% against a decentralized real-time baseline, and nearly doubles the success rate of a task-specific planner on graph connectivity. Hardware experiments on six robots planning onboard demonstrate real-world implementability.
Primary: Massachusetts Institute of Technology
All Institutions: Massachusetts Institute of Technology
WarpWeaver introduces a decentralized, real-time multi-robot coordination protocol that achieves near-optimal joint control by extending dispersive forward tree search via decentralized column generation, providing certified near-optimality at quiescence and demonstrating significant improvements over centralized and decentralized baselines in both simulation and hardware.
The paper proposes WarpWeaver, a decentralized, real-time multi-robot coordination protocol that leverages dispersive forward tree search (DFT) for differentially flat systems. The core innovation is the formulation of joint optimal control as a decentralized column generation problem. The authors prove that inter-robot coupling can be replaced by local constraints (corridors) such that locally grown trees contain a near-optimal agreement. They utilize the dual variables of a restricted master problem (an ILP relaxation) as "rents" on shared space, which guide the local tree search of each robot. This creates a negotiation loop where robots propose columns (trajectories) based on current prices, and the pool of columns is updated until quiescence or a real-time deadline. The theoretical contribution is significant, providing a certificate of near-optimality at quiescence relative to the joint optimum, which is a strong guarantee for decentralized methods that often lack such bounds. The extension from single-robot DFT to multi-robot coordination via column generation is a clever and rigorous application of operations research techniques to robotics.
The evaluation is comprehensive, covering simulation benchmarks (Dynobench) and hardware experiments. In simulation, WarpWeaver outperforms centralized offline planners in travel time (up to 22% reduction) and decentralized real-time baselines (up to 37% reduction). It also demonstrates superior success rates on connectivity maintenance tasks compared to task-specific planners. The hardware experiments on six robots planning onboard validate the real-time feasibility and robustness of the approach. The use of high-fidelity nonlinear quadrotor models and differentially flat systems (unicycles, integrators) shows the method's generality. The comparison against both centralized (offline) and decentralized (real-time) baselines is appropriate and highlights the trade-off between optimality and real-time performance.
The paper provides detailed algorithmic descriptions (Algorithm 1) and specifies search parameters, command sets, and dynamics for various platforms in Table 1. The use of standard benchmarks like Dynobench aids reproducibility. However, specific implementation details of the "dispersive tree" generation and the exact solver for the dual problem are not fully detailed in the provided text, though references to prior single-robot work are made. The code availability is not explicitly stated in the abstract or intro, but the level of detail suggests it is reproducible by experts in the field.
The method assumes differentially flat dynamics, which limits its applicability to systems that are not flat or where flatness is difficult to establish. The computational cost of growing dispersive trees, while polynomial, can still be high for large teams or long horizons, though the decentralized nature mitigates this. The "rents" mechanism relies on the structure of the ILP, which may not generalize easily to non-convex or highly complex joint constraints beyond the Lipschitz predicates assumed. The real-time performance depends on communication delays and computational resources, which may vary in real-world deployments.
This work bridges the gap between rigorous optimal control theory and practical real-time multi-robot coordination. It provides a framework for decentralized planning with optimality guarantees, which is valuable for applications requiring high precision and safety, such as drone swarms, autonomous vehicle fleets, and industrial automation. The use of column generation for coordination is a novel paradigm that could inspire further research in distributed optimization for robotics. WarpWeaver introduces a decentralized, real-time multi-robot coordination protocol that achieves near-optimal joint control by extending dispersive forward tree search via decentralized column generation, providing certified near-optimality at quiescence and demonstrating significant improvements over centralized and decentralized baselines in both simulation and hardware.
Human video scales easily and does not need robot hardware, but existing methods require depth sensing, overlay the robot onto 2D video, or generate data only for the demonstrated objects. We present Real2Sem2Real (R2Sem2R), a real-to-semantic-to-real pipeline that turns one monocular RGB video of a human demonstration into thousands of robot demonstrations across the semantic object instances of a category. R2Sem2R tracks the SE(3) pose of each object with DINOv3-distilled Gaussian splats, outperforming existing methods and FoundationPose with estimated metric depth. R2Sem2R then aligns digital cousins, each generated from one or a few photographs, to the demonstrated objects with a semantic alignment. This alignment matches whole objects and the functional regions of target objects, such as a coffee machine's tray. R2Sem2R maps the human hand to a feasible robot grasp that extends to the cousins. Robot demonstrations are generated either in IsaacSim, for photorealistic rendering, or MuJoCo, for contact physics, and R2Sem2R can generate over 2,000 episodes in about two hours. On two real robots and four tasks, we train a vision-language-action policy on data from one human video per task, and policies trained on our data match or exceed policies trained on teleoperation across diverse object instances. The project page is available at https://real2sem2real.github.io/.
Primary: Stanford University
All Institutions: Stanford University, ETH Zurich
The paper presents a novel and effective pipeline for generating semantically augmented robot demonstrations from a single human RGB video. By combining robust RGB-only object tracking with semantic alignment of digital cousins, it enables the transfer of functional knowledge across object instances, resulting in policies that match or exceed those trained on teleoperation with significantly less human effort.
The paper proposes a coherent "Real-to-Semantic-to-Real" pipeline that addresses a critical bottleneck in robot learning: the cost of collecting diverse, object-specific demonstrations. The core technical contribution is a robust RGB-only 4D object tracker using DINOv3-distilled Gaussian splats, which outperforms depth-dependent baselines like FoundationPose. The novelty lies in the "semantic alignment" of digital cousins (generated from few photos) to the demonstrated objects, allowing the transfer of functional affordances (e.g., where to place a mug on a specific machine) rather than just geometric similarity. The integration of hand-to-gripper retargeting and parallel simulation in IsaacSim/MuJoCo is well-engineered, though the reliance on VLMs for keyframe selection and region segmentation introduces potential fragility.
The experimental setup is rigorous, involving two real robots (xArm7, Panda) and four distinct tasks that test different aspects of the pipeline (placement, pouring, hanging, reorientation). The comparison against teleoperation is the gold standard, and the results showing R2Sem2R matching or exceeding teleoperation with significantly less human effort are compelling. The ablation study isolating the effect of semantic augmentation (R2Sem2R vs. R2R2R+) is particularly valuable, clearly demonstrating the added value of the cousin alignment. The tracking accuracy benchmarks on YCBInEOAT provide strong evidence for the superiority of the proposed tracker.
The paper provides detailed descriptions of the pipeline components, including loss functions, initialization strategies, and simulation settings. The use of standard tools (IsaacSim, MuJoCo, DINOv3) aids reproducibility. However, the specific implementation details of the "semantic ICP" and the VLM prompts used for region selection are not fully detailed in the main text, which could hinder exact replication. The code availability is implied by the project page, but the paper itself is a preprint/submission, so full code release status is pending.
The method is limited to rigid objects and requires a metric measurement of the demonstrated objects, which is a non-trivial assumption. The IsaacSim kinematic replay lacks contact dynamics, limiting applicability to contact-rich tasks, though MuJoCo is used as an alternative. The pipeline is computationally intensive (2.5 hours for 2000 episodes) and requires careful setup of the scene and camera calibration. The reliance on monocular depth estimation for some components (though mitigated by the splat tracker) remains a potential source of error.
This work has significant potential to democratize robot learning by reducing the barrier to entry for data collection. By enabling the generation of thousands of diverse demonstrations from a single human video, it could accelerate the development of general-purpose robot policies. The approach is applicable to a wide range of manipulation tasks and could be extended to other embodiments and object categories. The paper presents a novel and effective pipeline for generating semantically augmented robot demonstrations from a single human RGB video. By combining robust RGB-only object tracking with semantic alignment of digital cousins, it enables the transfer of functional knowledge across object instances, resulting in policies that match or exceed those trained on teleoperation with significantly less human effort.
Despite recent advances in policy learning, long-horizon manipulation remains difficult because learned policies must avoid compounding errors while preserving future feasibility. While search-based planning can explicitly reason over such future consequences, it quickly becomes expensive in high-dimensional continuous action spaces. This raises a central question: how can long-horizon reasoning from search be transferred into policies in continuous action spaces? To this end, we propose DISCO: Distilled Tree Search over Continuous Actions. DISCO uses progressive-widening MCTS in physics simulation to generate long-horizon plans. During search, a learned policy proposes continuous actions, while a learned value function scores actions by their expected progress toward task completion. Using GPU-parallelized simulation, DISCO periodically distills MCTS-generated plans into the policy-value model, improving the action proposals and value estimates used in subsequent searches. Finally, the learned policy-value model can be directly deployed without the need for simulator-based search at test time. Across simulated and real-world rearrangement tasks, DISCO outperforms behavior cloning, reinforcement learning, and search-based baselines.
Primary: Carnegie Mellon University
All Institutions: Carnegie Mellon University, Stanford University
The paper introduces DISCO, a method that distills long-horizon reasoning from GPU-parallelized MCTS into a deployable policy-value model for continuous action spaces. It represents a strong contribution to robot manipulation by effectively bridging the gap between sample-efficient planning and scalable policy learning, offering a viable solution to the compounding error problem in long-horizon tasks.
The paper proposes DISCO, a framework that bridges the gap between sample-efficient search-based planning and scalable policy learning in continuous action spaces. The core innovation is the use of progressive-widening Monte Carlo Tree Search (MCTS) within a physics simulator, where a learned policy proposes actions and a learned value function scores them. Crucially, the system employs a distillation loop: MCTS-generated plans are periodically distilled back into the policy-value model. This iterative refinement allows the policy to internalize the long-horizon reasoning capabilities of the search process. The method relies on GPU-parallelized simulation to make the search tractable, which is a significant engineering contribution. The final deployed model is a standard policy-value network that operates without the simulator, offering a clear advantage in real-world deployment latency and robustness compared to online search methods.
The evaluation covers both simulated and real-world multi-object rearrangement tasks. The paper claims to outperform behavior cloning (BC), reinforcement learning (RL), and search-based baselines. The inclusion of real-world experiments is a strong positive, as many papers in this domain remain purely simulated. The comparison against search-based baselines is particularly relevant, as it isolates the benefit of the distillation process over raw search performance. However, the specific metrics for "long-horizon" success rates and the degree of error compounding reduction would need to be scrutinized in the full results section to confirm the magnitude of improvement.
The method relies on specific hyperparameters for the MCTS (progressive widening factors, exploration constants) and the distillation frequency. The use of GPU-parallelized simulation suggests a dependency on specific hardware or simulation frameworks (likely Isaac Gym or similar), which may limit immediate reproducibility for labs without such infrastructure. The project page is provided, which likely contains code, aiding reproducibility.
The primary limitation is the dependency on a high-fidelity physics simulator for the training phase. If the simulator-to-real-world gap is significant, the distilled policy may suffer from performance degradation, although the real-world results suggest this is mitigated. Additionally, the computational cost of GPU-parallelized MCTS during training can be substantial, potentially limiting the scalability to extremely high-dimensional action spaces or very long horizons beyond what was tested.
This work has significant implications for the field of robot learning, particularly for tasks requiring precise, long-horizon manipulation. By demonstrating that search-based reasoning can be effectively distilled into a reactive policy, it offers a pathway to combining the robustness of planning with the speed of learned policies. This could influence future approaches to hierarchical reinforcement learning and model-based control. The paper introduces DISCO, a method that distills long-horizon reasoning from GPU-parallelized MCTS into a deployable policy-value model for continuous action spaces. It represents a strong contribution to robot manipulation by effectively bridging the gap between sample-efficient planning and scalable policy learning, offering a viable solution to the compounding error problem in long-horizon tasks.
Humanoid robots operating in human-centric environments must coordinate the entire body to traverse tight, cluttered spaces while maintaining balance. Existing methods often struggle to jointly consider dynamic stability and collision avoidance from high-dimensional perceptual inputs. Moreover, for humanoids, safe behavior is inherently multimodal: the same obstacle may admit multiple valid traversals, which is difficult to represent with a single deterministic policy. To address these challenges, we propose SWAP (Steerable Whole-body Avoidance Policy), a hierarchical framework that separates collision-aware decision making from stabilization. A high-level, perception-conditioned diffusion policy generates multimodal, collision-aware motion proposals, while a low-level whole-body RL controller tracks these proposals and maintains dynamic balance. To efficiently train the high-level policy, we obtain scalable supervision via hindsight labeling: we roll out the low-level policy under randomized commands, place obstacles only in the space that each executed motion did not sweep, so the motion is collision-free by construction, and re-render the perception the robot would have seen. At deployment, Monte Carlo sampling with simple cost signals steers the diffusion model toward safe, task-aligned behaviors without heavy reward tuning. Experiments in simulation and on a real Unitree G1 humanoid show reliable avoidance with static and dynamic obstacles. Test-time steering further enables customization, improving targeted rewards (e.g., speed, orientation, or posture) by 34% on average while maintaining a high collision avoidance rate. Together, these results support a practical solution to humanoid whole-body collision avoidance with test-time steerability. Project website: https://iscoyizj.github.io/SWAP-steerable-humanoid-oa-website/
Primary: Carnegie Mellon University
All Institutions: Carnegie Mellon University, Amazon FAR
The paper presents a novel hierarchical framework for humanoid whole-body collision avoidance that effectively combines diffusion-based multimodal planning with RL-based stabilization, demonstrating strong real-world performance and test-time steerability. The use of hindsight labeling for efficient training and the separation of collision-aware decision-making from dynamic balance represent significant methodological contributions that address key challenges in safe humanoid navigation.
The paper proposes SWAP, a hierarchical framework for humanoid whole-body collision avoidance that decouples high-level decision-making from low-level stabilization. The high-level component utilizes a perception-conditioned diffusion policy to generate multimodal motion proposals, addressing the inherent multimodality of safe navigation (e.g., going left vs. right around an obstacle). A key methodological contribution is the use of hindsight labeling for training the high-level policy: by rolling out a low-level RL controller under randomized commands and placing obstacles only in the space *not* swept by the robot, the authors generate collision-free supervision signals without requiring a complex reward function or simulator-in-the-loop collision detection during training. This is a clever and efficient training strategy. At deployment, Monte Carlo sampling with simple cost signals steers the diffusion model, allowing for test-time customization of behavior (e.g., prioritizing speed or posture) without retraining. The separation of concerns is well-motivated, and the use of diffusion models for multimodal action generation in robotics is a timely and relevant architectural choice.
The experiments are conducted in simulation and on a real Unitree G1 humanoid robot, which is a strong and practical choice for demonstrating real-world applicability. The evaluation includes both static and dynamic obstacles, covering a range of challenging scenarios. The paper reports a 34% average improvement in targeted rewards (speed, orientation, posture) via test-time steering while maintaining a high collision avoidance rate. While the specific metrics for "collision avoidance rate" and the baseline comparisons are not detailed in the provided text, the combination of simulation and real-robot validation, along with the quantitative improvement in steerability, suggests a rigorous experimental setup. The ability to demonstrate results on a physical humanoid is a significant strength, as many robotics papers remain purely in simulation.
The paper provides a project website, which likely contains code, videos, and additional details. The use of a standard platform (Unitree G1) and common simulation tools (implied) enhances reproducibility. The hindsight labeling technique is clearly described, allowing other researchers to implement similar training strategies. However, without access to the full code and hyperparameters, full reproducibility is difficult to assess. The reliance on a specific robot model may limit immediate reproducibility for labs without access to Unitree hardware, but the simulation components should be replicable.
The primary limitation is the reliance on a specific humanoid robot (Unitree G1) for real-world validation, which may not generalize directly to other platforms without significant adaptation. The method involves a two-stage process (high-level diffusion policy + low-level RL controller), which increases computational complexity and implementation difficulty compared to end-to-end approaches. The test-time steering via Monte Carlo sampling may introduce latency, which could be a concern in high-speed dynamic environments. Additionally, the paper does not extensively discuss failure modes or the limits of the approach in extremely cluttered or unpredictable environments.
This work has significant potential impact on the field of humanoid robotics and safe robot navigation. The hierarchical approach combining diffusion policies for multimodal planning with RL for stabilization is a promising paradigm that could be adapted to other robotic systems. The hindsight labeling technique offers a scalable way to generate training data for collision avoidance, which is a common challenge in robotics. The test-time steerability feature is particularly valuable for human-centric environments where user preferences or task-specific requirements may vary. This work could influence future research on safe robot operation, multimodal policy learning, and the integration of generative models in robotics. The paper presents a novel hierarchical framework for humanoid whole-body collision avoidance that effectively combines diffusion-based multimodal planning with RL-based stabilization, demonstrating strong real-world performance and test-time steerability. The use of hindsight labeling for efficient training and the separation of collision-aware decision-making from dynamic balance represent significant methodological contributions that address key challenges in safe humanoid navigation.
Video models provide rich priors for generalizable robotic manipulation, but plausible visual futures are not always executable. We introduce DreamCan, a hierarchical policy that grounds video models through sparse visual planning: a high-level planner adapted from a pre-trained video model and a low-level visuomotor policy. Rather than predicting dense trajectories, the high-level planner generates sparse visual subgoals that balance reachability and task utility. From offline, action-free robot videos, we estimate these quantities and use dynamic programming to select subgoal sequences without manual annotations. The resulting subgoals are more reliably attained than uniformly spaced alternatives, and the full system outperforms language, dense-video, and uniform-subgoal planners, reaching high planning success rates on Language-Table tasks and 91.2% success on LIBERO-Long with a 0.1B-parameter low-level policy. Additional suboptimal videos and test-time compute further improve success. The system also performs challenging real-world bimanual tasks, including box folding and packing with unseen object combinations. More results are available at https://dreamcan.github.io/.
Primary: Stanford University
All Institutions: Stanford University, Harvard University, National University of Singapore, Northwestern University
DreamCan introduces a hierarchical policy that uses sparse visual subgoals from video models to enable long-horizon robot manipulation. The paper presents a rigorous evaluation showing that this approach outperforms dense and uniform planning baselines, achieving high success rates in simulation and real-world bimanual tasks, thereby demonstrating the viability of video-based sparse planning for complex robotic manipulation.
The paper proposes "DreamCan," a hierarchical policy that bridges the gap between generative video models and executable robot actions. The core innovation lies in the high-level planner, which is adapted from a pre-trained video model to generate *sparse* visual subgoals rather than dense trajectories. This is a significant architectural choice, as dense video predictions are often physically infeasible for current robot hardware. The method estimates subgoal reachability and task utility from offline, action-free videos, utilizing dynamic programming to select optimal subgoal sequences without manual annotation. This unsupervised discovery of subgoals is a strong methodological contribution, reducing the reliance on expensive human demonstrations for long-horizon tasks. The low-level policy is a goal-conditioned visuomotor policy that executes the actions to reach these subgoals.
The experimental evaluation is robust, covering both simulation (Language-Table, LIBERO-Long) and real-world bimanual tasks. Achieving 91.2% success on LIBERO-Long with a small 0.1B-parameter low-level policy is a notable result, suggesting that the sparse planning approach effectively offloads complexity from the low-level controller. The comparison against language-based, dense-video, and uniform-subgoal planners provides a comprehensive baseline analysis. The inclusion of real-world bimanual tasks (box folding, packing) with unseen object combinations demonstrates generalization capabilities beyond simulation. The observation that additional suboptimal videos and test-time compute improve success rates is a valuable empirical finding for practitioners.
The paper provides a project URL (dreamcan.github.io) which likely contains code and additional results. The methodology relies on pre-trained video models and standard dynamic programming, which are well-understood components. However, the specific adaptation of the video model for sparse subgoal generation and the estimation of reachability/utility from action-free videos may require careful implementation details that are not fully visible in the abstract. The use of offline data is a practical advantage for reproducibility in real-world settings where collecting new action data is costly.
The reliance on pre-trained video models means the system's performance is bounded by the quality and coverage of the video priors. If the video dataset does not contain examples of the specific task or object configurations, the planner may fail. The method is designed for manipulation tasks; its applicability to locomotion or other robotic domains is not discussed. The computational cost of the high-level planner (video model inference) and the dynamic programming step could be a bottleneck for real-time operation, although test-time compute scaling is mentioned as a positive factor.
This work has significant implications for the field of robot learning, particularly for long-horizon manipulation tasks. By leveraging video models as priors for planning, it offers a path towards more generalizable and data-efficient robot policies. The sparse subgoal approach is a practical solution to the "plausibility vs. executability" problem in video-based planning. This could influence future research in hierarchical reinforcement learning and the integration of generative models into robotic control loops. DreamCan introduces a hierarchical policy that uses sparse visual subgoals from video models to enable long-horizon robot manipulation. The paper presents a rigorous evaluation showing that this approach outperforms dense and uniform planning baselines, achieving high success rates in simulation and real-world bimanual tasks, thereby demonstrating the viability of video-based sparse planning for complex robotic manipulation.
Differences in hand geometry, joint parameterization, and kinematic topology pose challenges for cross-embodiment dexterous grasp generation. However, spatial relations among links alone are insufficient to fully capture the hand's kinematic topology. We propose DexGraspFlow, a conditional link-level $\mathrm{SE}(3)$ flow-matching framework integrating geometric relations and kinematic topology. The framework encodes local object geometry, link geometry, and current poses. A dual-stream DiT models link--link coordination and link--object interaction, while attention biases derived from kinematic-tree distances provide explicit structural information for modeling evolving geometric interactions. The model jointly learns translational and rotational velocity fields, integrates them to generate link poses, and recovers joint configurations through inverse kinematics. Additionally, inference-time palm-orientation guidance enables controllable grasp generation without retraining. Across three robotic hands and 30 object--hand pairs, DexGraspFlow achieves a 95.33\% average simulation success rate, with an average generation latency, including inverse kinematics, approximately 49\% lower than that of a state-of-the-art baseline. Further experiments demonstrate zero-shot adaptability to seven finger-removal variants and palm-orientation control. A model trained on demonstrations for the deployed hand achieves a 91\% success rate over 100 real-robot grasping trials, supporting the framework's applicability to physical grasp execution.
Primary: Peking University
All Institutions: Peking University, University of Science and Technology of China
DexGraspFlow introduces a topology-aware SE(3) flow matching framework that significantly advances cross-embodiment dexterous grasp generation by explicitly encoding kinematic structure, achieving state-of-the-art success rates and efficiency with strong real-world validation.
The paper proposes DexGraspFlow, a framework for cross-embodiment dexterous grasp generation using SE(3) flow matching. The core methodological contribution is the integration of kinematic topology (via URDF-derived shortest-path distances) into the attention mechanism of a dual-stream DiT architecture. This addresses a specific gap in prior work (like TRO-Grasp) where spatial proximity was used as a proxy for kinematic relevance, which fails across different hand morphologies. The use of flow matching over diffusion models is a timely choice, offering faster inference (10 steps vs. 50+ for diffusion) and stable training. The formulation of separate translational (Euclidean) and rotational (SO(3) geodesic) velocity fields is mathematically sound and preserves the manifold structure of rotations. The inference-time palm-orientation guidance via tangent-space velocity corrections is a clever, training-free extension that enhances controllability.
The experimental evaluation is rigorous and comprehensive. The authors benchmark against strong, recent baselines (TRO-Grasp, DRO-Grasp, GenDexGrasp) across three distinct robotic hands (Barrett, Allegro, ShadowHand) and 30 object-hand pairs. The success rate of 95.33% is state-of-the-art, outperforming the previous best (TRO-Grasp) by a significant margin. The latency improvement (~49% lower) is substantial and practically important. The zero-shot generalization to finger-removal variants is a strong test of the topology-aware representation, showing the model understands the structural changes. The real-robot experiments (91% success rate) provide crucial validation beyond simulation, although the sample size (100 trials) is modest. The ablation studies clearly demonstrate the necessity of both geometric and topology biases.
The paper provides detailed implementation specifics, including dataset splits, hyperparameters (learning rate, batch size, network dimensions), and evaluation protocols (Isaac Gym settings, force magnitudes). The use of standard datasets (CMapDataset, ContactDB, YCB) and open-source tools (Pyroki, Isaac Gym) enhances reproducibility. However, the code and model weights are not explicitly linked in the provided text (though typically available for such papers), and the specific "filtered CMapDataset split" might require clarification if not publicly released.
The primary limitation is the reliance on a fixed set of training hands; generalization to completely novel hand morphologies (e.g., a 3-fingered hand vs. 5-fingered) is not tested, only finger removals. The method does not explicitly enforce joint limits or collision avoidance during the flow generation, relying on post-hoc IK which can fail or produce unnatural poses if the generated link poses are infeasible. The real-robot evaluation is limited to a single hand type (Linker Hand) and a small number of objects.
This work has significant implications for the field of dexterous manipulation. By providing a fast, accurate, and topology-aware method for cross-embodiment grasp generation, it facilitates the transfer of manipulation skills across different robotic platforms. The flow matching approach is likely to become a standard for generative robotics tasks due to its efficiency. The training-free guidance mechanism offers a practical way to add controllability to generative models without retraining, a valuable technique for other robotic applications. DexGraspFlow introduces a topology-aware SE(3) flow matching framework that significantly advances cross-embodiment dexterous grasp generation by explicitly encoding kinematic structure, achieving state-of-the-art success rates and efficiency with strong real-world validation.
Large-scale Transformers have achieved remarkable success across NLP, computer vision, and robotics, but their growing computational and memory demands challenge efficient inference. Spatial accelerators offer advantages in on-chip bandwidth and energy efficiency, yet designing them for large models remains costly and time-consuming. Existing accelerator generators typically focus on single-operation support, overlooking the benefits of multi-operation pipelining, which limits throughput and energy efficiency. We propose TranSAGE, a compiler-based framework that jointly optimizes scheduling for large-scale Transformers under multi-operation pipelining and generates corresponding accelerator implementations. Our approach integrates a design space exploration (DSE) engine with multi-operation dataflow optimization and a dynamic programming-based graph partitioning algorithm to efficiently identify pipeline-friendly operation clusters and their optimal dataflow parameters. We further design spatial architecture primitives and lowering passes to automatically generate efficient RTL implementations. Evaluations on four representative LLMs demonstrate that TranSAGE achieves up to 2.41x higher throughput and 13.04x higher energy efficiency than commercial GPU/NPU baselines. Compared with state-of-the-art accelerator generators, TranSAGE achieves up to 11.33x higher throughput and 6.07x higher energy efficiency. Our code is available at https://github.com/sjtu-zhao-lab/TranSAGE.
Primary: Shanghai Jiao Tong University
All Institutions: Shanghai Jiao Tong University, South China University of Technology
TranSAGE introduces a compiler-based framework that automates the generation of spatial accelerators for large-scale Transformers by jointly optimizing multi-operation pipelining and dataflow. The paper makes a significant technical contribution by addressing the high cost and complexity of manual accelerator design through a rigorous DSE and graph partitioning approach, yielding substantial improvements in throughput and energy efficiency over both commercial hardware and existing generator tools.
The paper proposes TranSAGE, a compiler-based framework that bridges the gap between high-level Transformer model specifications and low-level spatial accelerator RTL. The core methodological contribution is the joint optimization of scheduling and dataflow for multi-operation pipelining. Unlike prior works that often treat operations in isolation or use static partitioning, TranSAGE employs a Design Space Exploration (DSE) engine combined with a dynamic programming-based graph partitioning algorithm. This allows the system to identify "pipeline-friendly" operation clusters, which is crucial for maximizing throughput in spatial architectures where data movement is a primary bottleneck. The inclusion of specific spatial architecture primitives and lowering passes to generate RTL demonstrates a complete end-to-end pipeline, which is technically sound and addresses a significant pain point in accelerator design.
The evaluation is conducted on four representative Large Language Models (LLMs), which is appropriate for the target domain. The results show substantial improvements: up to 2.41x higher throughput and 13.04x higher energy efficiency compared to commercial GPU/NPU baselines. More importantly, the comparison against state-of-the-art accelerator generators shows up to 11.33x higher throughput and 6.07x higher energy efficiency. These are strong quantitative results. However, the "up to" phrasing suggests these are peak-case scenarios, and a more detailed breakdown of average performance across different model sizes and batch sizes would strengthen the evaluation. The energy efficiency claims are particularly compelling given the current trends in edge AI and datacenter power constraints.
The authors provide a public GitHub repository (https://github.com/sjtu-zhao-lab/TranSAGE), which significantly enhances reproducibility. Given the complexity of hardware generation and RTL synthesis, having the code available is a major plus. The paper mentions the use of "Codex" for language and code assistance, which is a transparent disclosure of tooling but does not directly impact the reproducibility of the scientific results, provided the code is complete and well-documented.
The primary limitation is the scope of the evaluation. While four LLMs are used, the paper does not explicitly detail the diversity of model architectures (e.g., only decoder-only vs. encoder-decoder) or the specific hardware constraints (e.g., memory capacity, interconnect bandwidth) assumed in the DSE. Additionally, the comparison with commercial GPUs/NPUs may be somewhat unfair if the accelerators are optimized for specific workloads while the baselines are general-purpose, though this is a common practice in the field. The "up to" metrics also mask the average performance gains, which might be lower.
This work has significant potential impact on the field of AI hardware acceleration. As Transformer models continue to grow in size and complexity, the cost of manual accelerator design becomes prohibitive. An automated framework that can efficiently generate high-performance spatial accelerators for large models could democratize access to efficient AI inference hardware, particularly for edge devices and specialized datacenter deployments. The focus on multi-operation pipelining is a key insight that could be adopted by other compiler frameworks and hardware designers. TranSAGE introduces a compiler-based framework that automates the generation of spatial accelerators for large-scale Transformers by jointly optimizing multi-operation pipelining and dataflow. The paper makes a significant technical contribution by addressing the high cost and complexity of manual accelerator design through a rigorous DSE and graph partitioning approach, yielding substantial improvements in throughput and energy efficiency over both commercial hardware and existing generator tools.
Consensus is a fundamental problem in distributed computing and at the core of state machine replication (SMR). Despite decades of active human research, discovering practical low-latency solutions to the problem is still open, as it requires combining protocol knowledge, correctness reasoning, implementation, and experimental evaluation. We report on how AI helped us discover A-greement, a new consensus protocol for geo-replicated state machines that significantly outperforms state-of-the-art solutions. Averaged across six deployments with 5 or 9 replicas, A-greement reduces the mean latency of a geo-distributed key-value store over the fastest baseline by 12.2% and 33.3% on write-heavy and read-heavy workloads, respectively, and matches the fastest baseline on read-only workloads. A-greement combines lease-authorized local reads, direct client learning for leader-ordered writes, and a fast fixed-quorum per-key write path, selected according to network topology and workload. At the heart of our discovery lies AI-greement, an agent harness for the "autonomous" discovery, implementation, experimentation, and verification of candidate protocols. AI-greement integrates (1) a concept-oriented protocol knowledge base, (2) a modular implementation skeleton, and (3) a Lean-based verification framework with reusable safety definitions, reference specifications, and proofs. AI-greement is of independent interest: its Lean formalization uncovers several previously unreported vulnerabilities in existing consensus protocols, and it provides guidelines on how domain-specific harnesses can turn general-purpose coding agents into effective tools for (distributed) computing research. Yet we argue that human consensus experts remain essential before, during, and after the search: agents reshape the researcher's role rather than end consensus research.
Primary: École Polytechnique Fédérale de Lausanne (EPFL)
All Institutions: École Polytechnique Fédérale de Lausanne (EPFL)
The paper presents AI-greement, a specialized agent harness that leverages formal verification and domain knowledge to autonomously discover and verify a new consensus protocol, A-greement, which outperforms state-of-the-art solutions in geo-distributed settings. This work is significant as it demonstrates a novel application of AI agents in the design of complex distributed systems, moving beyond code generation to algorithmic discovery and formal verification, thereby offering a new paradigm for tackling hard problems in distributed computing.
The paper proposes "AI-greement," a specialized agent harness designed to autonomously discover, implement, experiment with, and verify distributed consensus protocols. The methodology integrates three key components: a concept-oriented protocol knowledge base, a modular implementation skeleton, and a Lean-based formal verification framework. This approach moves beyond simple code generation by embedding domain-specific constraints and formal safety definitions directly into the agent's workflow. The resulting protocol, A-greement, is a hybrid design combining lease-authorized local reads, direct client learning for leader-ordered writes, and fast fixed-quorum per-key write paths. The use of Lean for verification is a significant methodological strength, as it allows the agent to reason about correctness rather than just performance, leading to the discovery of previously unreported vulnerabilities in existing protocols.
The evaluation is rigorous, comparing A-greement against state-of-the-art baselines across six different geo-distributed deployments with 5 and 9 replicas. The results show a 12.2% reduction in mean latency for write-heavy workloads and a 33.3% reduction for read-heavy workloads compared to the fastest baseline. The paper also validates the safety of the discovered protocol using the Lean framework. The inclusion of real-world network topologies and varied workload characteristics strengthens the empirical claims.
The paper provides details on the agent harness architecture and the Lean verification framework, which are critical for reproducibility. However, as the full text provided is a skeleton with section headers, specific implementation details, prompt engineering strategies, and code repositories are not visible in the excerpt. The mention of a "modular implementation skeleton" suggests that code artifacts are likely available or planned, but without the actual code or detailed prompt logs, full reproducibility of the *discovery process* is difficult to assess from the abstract and headers alone.
The primary limitation is the reliance on a highly specialized, domain-specific harness (AI-greement) which may not generalize easily to other areas of distributed computing or software engineering without significant adaptation. Additionally, the "autonomous" nature of the discovery is tempered by the authors' admission that human experts remain essential, suggesting the current level of autonomy is limited to search space reduction and verification assistance rather than fully independent invention. The performance gains, while significant, are specific to geo-replicated state machines and may not apply to other consensus contexts.
This paper has high potential impact on the field of AI for Systems. It demonstrates that LLMs can be effectively used not just for coding, but for the *design* of complex distributed algorithms when coupled with formal verification tools. The discovery of vulnerabilities in existing protocols via the Lean framework highlights the utility of AI-assisted formal methods. This work could inspire similar "agent harnesses" for other hard problems in computer science where correctness and performance are tightly coupled. The paper presents AI-greement, a specialized agent harness that leverages formal verification and domain knowledge to autonomously discover and verify a new consensus protocol, A-greement, which outperforms state-of-the-art solutions in geo-distributed settings. This work is significant as it demonstrates a novel application of AI agents in the design of complex distributed systems, moving beyond code generation to algorithmic discovery and formal verification, thereby offering a new paradigm for tackling hard problems in distributed computing.