InternW0

InternW0

A Foundational Physical World Model
for Efficient Real-World Interactions

Physical Intelligence Team, Shanghai AI Laboratory
Shanghai Artificial Intelligence LaboratoryInternRobotics
BibTeX
InternW0 overview: heterogeneous pretraining data, asynchronous video–action modeling, and simulation results
InternW0 couples future visual prediction with continuous robot control through an asymmetric video–action architecture. A high-capacity video expert provides predictive context, while a lightweight action expert adapts it to incoming observations for efficient, contact-aware interaction.

98.6%

LIBERO average

Mean success rate across all four task suites.

93.12%

RoboTwin 2.0-Full

Average success across clean and randomized settings.

75.60%

Clean2Random average

Clean-only post-training, evaluated on both scene settings.

16.47 Hz

Model-side policy updates

60.73 ms per action update on RTX 5090D; video prediction runs asynchronously.

Introduction

A Quick Overview of InternW0

See InternW0 carry out a multi-stage laboratory workflow before exploring the architecture, training data, and evaluation results.

Model

Asynchronous video–action modeling with contact-aware control

InternW0 uses a mixture-of-transformers backbone with separate video and action experts. Observation-conditioned context routing keeps longer-horizon predictions useful as new visual and physical feedback arrives.

InternW0 video and action experts coupled through observation-conditioned context routing

Joint video–action flow matching learns future visual dynamics and continuous control. A frozen Wan VAE encodes video, while a frozen DINOv3 encoder supplies current visual observations. Robot trajectories supervise both experts; egocentric videos train the video pathway without action labels. Domain-specific interfaces and soft prompts support heterogeneous embodiments, with force and tactile channels added during contact-aware post-training.

Data

7,233.5 hours across 25 training domains

Seven datasets combine real-robot trajectories, simulated manipulation, and egocentric laboratory video. A unified 37-dimensional state–action interface and validity masks accommodate different embodiments, while square-root domain sampling balances the training mixture.

EgoLab: egocentric laboratory activities, reconstructed hand annotations, and activity distribution
EgoLab contributes 275.4 hours of egocentric laboratory video, covering instrument handling, liquid transfer, mixing, and other wet-lab activities. Reconstructed hand trajectories support filtering; pretraining uses the video-only pathway.
SourceTypeDomainsHoursEpisodes
InternData-A1Simulated63,494.3568,194
AgibotWorldReal22,620.0158,380
RoboCOINReal13438.159,952
GalaxeaReal1314.915,362
MolmoActReal170.33,424
RoboDojoSimulated120.53,465
Robot manipulation data mixture. Six robot datasets supply state–action supervision; domain counts distinguish data sources and configurations rather than unique robot morphologies.
SourceHoursEpisodesSupervision
EgoLab275.43,192Future-video prediction without robot action labels
Egocentric video supervision from EgoLab. Together with the robot datasets, the full mixture contains 811,969 episodes across 25 training domains.

Benchmarks

Strong single-arm manipulation and bimanual generalization

LIBERO evaluates 40 single-arm tasks across spatial, object, goal, and long-horizon suites. RoboTwin 2.0 covers 50 bimanual tasks, with Full and Clean2Random protocols separating in-domain adaptation from generalization to unseen randomized scenes.

BenchmarkMetricInternW0
Average success rate98.6%
Average success rate93.12%
Average success rate75.60%
Success rates are reported in percent. Click a benchmark row to view the full comparison and evaluation setting.

Egocentric video improves transfer

Limited-data RoboTwin Clean2Random ablation comparing no pretraining, robot-only pretraining, and robot plus EgoLab
In a limited-data ablation using about 50 hours of robot data, adding about 50 hours of EgoLab improves randomized-scene success from 13.73% to 21.97% (+8.24 percentage points). These ablation results use a smaller corpus than the main Clean2Random result.

Efficient action updates

Critical-path latency and model-side update rate: Motus, Fast-WAM, and InternW0
InternW0 takes 60.73 ms per critical-path action update on RTX 5090D, corresponding to a maximum model-side update rate of 16.47 Hz and a 3.13× speedup over Fast-WAM. This measurement includes observation encoding, context routing, and action denoising; asynchronous video-plan generation is excluded.

Experiments

From everyday manipulation to scientific workflows

Five real-world tasks test instruction following, object discrimination, long-horizon coordination, and contact-aware tool use. Four use a dual-arm platform; quantitative pipetting uses a 20-DoF dexterous hand on a 7-DoF arm with hybrid force–position control.

Five real-world tasks: Make Sandwich, Pick Industrial Parts, Sort Tubes, MoF Experiments, and Quantitative Pipetting

The real-world suite spans Make Sandwich, Pick Industrial Parts, Sort Tubes, MoF Experiments, and Quantitative Pipetting.

Make Sandwich
Pick up two bread slices and a piece of meat, then stack them in the prescribed order.
Pick Industrial Parts
Identify industrial parts and place each one into its matching box.
Sort Tubes
Follow an instruction specifying the arm, tube color, and destination box.
MoF Experiments
Complete 15 ordered subtasks for solution preparation, including pouring, funnel removal, flask transfer, stopper insertion, and stirring.
Quantitative Pipetting
Coordinate five stages of dexterous tool use: pickup and reorientation, tip attachment, aspiration, dispensing, and tip ejection and return.

Real-world results

MethodMake Sandwich · SRPick Industrial Parts · SRSort Tubes · SRMoF · ProgressPipetting · Progress
π0.573.353.186.750.246.7
Fast-WAM40.050.666.710.718.7
InternW073.382.788.968.465.3
Results over 15 trials per task with randomized initial object poses (Table 5). Sandwich uses episode success rate; parts and tubes use object-level success rate. MoF and pipetting use ordered-subtask progress rate, with the same VLM for subtask generation across methods. All values are percentages.

Everyday and industrial manipulation

Dual-arm demonstrations of ordered assembly, part sorting, and language-conditioned tube selection.

Make Sandwich

Pick Industrial Parts

Sort Tubes

MoF Experiments

Close-up views of flask placement, stopper insertion, and stirrer operation within the 15-stage solution-preparation workflow.

Flask placement

Stopper insertion & stirring

Quantitative Pipetting

A dexterous hand coordinates pipette pickup, tip attachment, aspiration, dispensing, and tip ejection with force-aware control.

Quantitative Pipetting

MoF Experiments — subtask results
Subtaskπ0.5Fast-WAMInternW0
1 · Pick up funnel from rack100.0100.0100.0
2 · Insert funnel into flask100.046.7100.0
3 · Pick up graduated cylinder100.013.393.3
4 · Pour liquid into flask via funnel73.30.080.0
5 · Place graduated cylinder back73.30.080.0
6 · Hold flask steady on platform73.30.080.0
7 · Pick up funnel from flask73.30.080.0
8 · Insert funnel into rack hole46.70.066.7
9 · Return to initial position46.70.066.7
10 · Place flask onto stirrer33.30.066.7
11 · Pick up stopper from rack6.70.066.7
12 · Insert stopper into flask6.70.066.7
13 · Press left button of stirrer6.70.026.7
14 · Press right button of stirrer6.70.026.7
15 · Return to initial position6.70.026.7
Overall progress rate50.210.768.4

Subtask success rates and overall progress rate (%) from Table 6. Overall progress is the fraction of subtasks completed correctly and in order.

Quantitative Pipetting — subtask results
Subtaskπ0.5Fast-WAMInternW0
1 · Pickup & reorientation93.346.786.7
2 · Tip attachment40.013.366.7
3 · Liquid aspiration33.313.366.7
4 · Liquid dispensing33.313.360.0
5 · Tip ejection & return33.36.746.7
Overall progress rate46.718.765.3

Subtask success rates and overall progress rate (%) from Table 7. Contact-aware post-training combines force history with visual and proprioceptive observations.

Contact-aware manipulation

Pouring and pipette tip-attachment examples comparing InternW0, pi 0.5, and Fast-WAM
Qualitative comparisons on pouring (top) and pipette tip attachment (bottom). InternW0 aligns the tool before contact-rich execution and uses force feedback to adapt contact, while the illustrated baseline rollouts show misalignment.

Citation

BibTeX

@techreport{internw0,
  title       = {InternW0: A Foundational Physical World Model for Efficient Real-World Interactions},
  author      = {{Physical Intelligence Team, Shanghai AI Laboratory}},
  institution = {Shanghai AI Laboratory},
  year        = {2026},
  url         = {https://internrobotics.github.io/internw0/}
}