Papers
arxiv:2610.30136

Agentic World Action Models

Published on Oct 21
· Submitted by
taesiri
on Oct 22
Authors:
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,

Abstract

Recent world action models provide visual foresight and future prediction for robot manipulation, but lack explicit mechanisms for compositional skill reuse. Agentic robotics combines code-based planning and reasoning with reusable skills, but often lacks predictive grounding in physical dynamics. We introduce AW-0, an agentic world action model framework that integrates code-based planning with joint video and action prediction. We jointly model code, future video, and robot actions as three coupled generative streams within a unified mixture-of-transformers architecture. Within this architecture a code expert generates parameterized skill routines and control logic while video and action experts generate future visual states and low-level motor commands. Code serves two complementary roles: it structures multi-step prediction and control within the world model and represents skills as reusable programs for subsequent agentic execution. We further introduce an automated curation pipeline that labels robot and human video trajectories with aligned programs and consolidates recurring routines into reusable skill libraries. Evaluations on RoboTwin 2.0 and physical bimanual manipulation tasks show improved task performance over VLA and WAM baselines, alongside gains in language following, semantic reasoning and robustness, demonstrating that agentic code enables connection between planning, prediction and execution within WAMs.

Community

This is an automated message from the Librarian Bot. I found the following papers similar to this paper.

The following papers were recommended by the Semantic Scholar API

Please give a thumbs up to this comment if you found it helpful!

If you want recommendations for any Paper on Hugging Face checkout this Space

You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend

Thank you for sharing your work on agentic world-action models. AW-0 couples code, future video, and action generation so that reusable programs structure prediction and execution together. RoboTwin 2.0 and physical bimanual evaluations report improvements over the evaluated VLA and WAM baselines.

We would like to discuss your work in Section 3.3 (“World-model-based control”) of our survey, In-Context Learning for Robots: Methods and Applications, to discuss the interface between predictive control and skill-based execution, showing how a code stream supplies reusable task structure within a world-action model.

If our treatment of context in predictive control is relevant to your work, we would appreciate your considering the survey as a reference.

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2610.30136
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 1

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.30136 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.30136 in a Space README.md to link it from this page.

Collections including this paper 2