Unified Embodied Synthesis with World Foundation Models

The first unified embodied synthesis model that bridges foundation image generation and embodied world modeling

Xiaomi-Robotics-U0 overview illustration

Overview

Xiaomi-Robotics-U0 is a 38B autoregressive world foundation model continually trained for embodied intelligence.

Xiaomi-Robotics-U0 all-task overview

Unlike previous embodied world models trained solely on robot trajectories, Xiaomi-Robotics-U0 unifies the following within a single autoregressive framework.

  • Text-to-Image Generation
  • Any-to-Image Editing
  • Multi-view Embodied Scene Generation
  • Embodied Transfer
  • Embodied Video Generation

By transferring the rich semantic knowledge of foundation image generation into robotics, Xiaomi-Robotics-U0 achieves state-of-the-art performance across both single-step and sequential embodied generation tasks while significantly improving downstream robot policies.

Model

Xiaomi-Robotics-U0 unifies multimodal tokenization, embodied data training, and accelerated autoregressive inference into a single foundation model for robot-centric generation.

Data

Xiaomi-Robotics-U0 is continually trained using two complementary stages.

01

Single-step Generation

Single-step Generation figure
  • Text-to-Image
  • Any-to-Image
  • Embodied Scene Generation
  • Embodied Transfer
02

Sequential Generation

Sequential Generation figure
  • Interleaved Subtask-Subgoal
  • Embodied Videos
  • Multi-FPS (1 / 3 / 5 FPS)

This unified training strategy preserves foundation generation capability while introducing robot-centric reasoning and interaction modeling.

Architecture

Xiaomi-Robotics-U0 is built on a multimodal autoregressive architecture and uses IBQ as the image tokenizer, representing multiple modalities in the same space.

Xiaomi-Robotics-U0 next token prediction and FlashAR+ inference architecture
Xiaomi-Robotics-U0 adopts a multimodal autoregressive architecture. By discretizing images, it expands a text-only vocabulary into a multimodal vocabulary while preserving the next-token prediction paradigm, allowing autoregressive scaling across modalities. At inference time, Xiaomi-Robotics-U0 introduces FlashAR+, replacing token-by-token decoding with anti-diagonal decoding to achieve nearly 83x acceleration and make the model efficient enough for practical use.

We propose FlashAR+, a high-speed inference acceleration scheme that extends FlashAR to X2I tasks. At inference time, FlashAR+ uses lightweight post-training and acceleration adaptation, then combines with vLLM to further improve efficiency. Generation efficiency increases by up to 82.9x, with native support for Anything-to-Image multi-reference image editing scenarios.

Acceleration82.9xPeak generation efficiency gain
Before450.77sOriginal 1024 * 1024 single-sample latency
After FlashAR+5.44sAccelerated 1024 * 1024 single-sample latency

With diagonal-parallel decoding and vLLM paged KV-cache batch scheduling, 1024 * 1024 single-sample throughput improves from 450.77 seconds per image to 5.44 seconds per image, balancing high generation quality with engineering deployment speed.

AR and FlashAR+ comparison for embodied transfer and embodied scene generation
FlashAR+ substantially optimizes inference efficiency while preserving generation quality. When further integrated with vLLM at the engineering level, it achieves nearly 83x inference acceleration.

Capability

Across scene synthesis, controllable transfer, video rollout, and general image generation, the model turns language and visual context into scalable embodied data generation.

Capability I: Multi-view Embodied Scene Generation

Generate physically plausible multi-view robot observations directly from language.

Comparison with GPT-Image-2

Embodied Scene Generation

Easy
62.0%
Hard
68.5%

For Capability I: Multi-view Embodied Scene Generation, this benchmark reports the overall win rate of embodied scene generation. Xiaomi-Robotics-U0 outperforms GPT-Image-2 in most comparisons, achieving clear advantages in multi-view consistency while maintaining comparable instruction-following performance.

Capability II: Controllable Embodied Transfer

Transfer an existing embodied scene into a new one while preserving robot interaction.

Embodied transfer before/after example

Structured Scene Control

Xiaomi-Robotics-U0 disentangles embodied scenes into five independently controllable dimensions.

🏢Workspace
🌄Background
📦Foreground Irrelevant Objects
🎯Target Objects
💡Lighting

Each factor can be independently recombined, producing exponentially many robot scenes from compact descriptions without affecting robot pose or manipulation state.

Scene description generation pipeline

Transfer Results

Transfer Comparison with GPT-Image-2

Embodied Transfer

Easy
82.0%
Hard
79.3%

For Capability II: Controllable Embodied Transfer, this benchmark reports the overall win rate of embodied transfer. Xiaomi-Robotics-U0 shows stronger transfer robustness than GPT-Image-2 while preserving comparable instruction-following performance across edited embodied scenes.

Capability III: Embodied Video Generation

Starting from a single observation, Xiaomi-Robotics-U0 predicts future robot interactions across diverse scenarios.

WorldArena

Ranks 1st among over 100 models on WorldArena.

Initial Frame+Language+ActionVideo Rollout
ModelEWMScore_PRankVisual QualityMotion QualityContent ConsistencyPhysics Adherence3D AccuracyControllabilityAesthetic QualityBackground ConsistencyDepth AccuracyDynamic DegreeFlow ScoreImage QualityInstruction FollowingInteraction QualityJEPA SimilarityMotion SmoothnessPerspectivityPhotometric ConsistencySemantic AlignmentSubject ConsistencyTrajectory Accuracy
UNIS (Xiaomi-Robotics-U0)73.64161.7885.0855.8764.6092.0591.6040.7986.4485.2573.7086.0253.9493.8687.3090.6095.5198.842.1389.3579.0541.89
SisyphusWorld73.06260.1889.1758.1158.2892.6085.9338.3886.5294.8576.2799.8245.5782.6871.9896.5891.4290.345.6989.1882.1144.58
BWM-Fast72.71363.0879.6758.2262.3991.7889.6940.1590.1786.4169.5875.1151.2290.2279.8897.8794.3397.143.0889.1581.4244.89
SACWM72.67459.8085.5858.8659.6293.6785.4137.3087.9094.9970.3595.7945.8381.6672.2896.2690.6092.346.5089.1682.1746.95
DexWorldEngine72.66559.7079.2558.2466.2291.8991.0440.9688.8586.1969.1674.3151.4492.6281.0486.7194.2797.584.4289.4581.4651.41
PAIWorld72.34663.1280.4957.8261.7591.5987.0740.2889.0386.8168.8177.2252.2285.2477.7096.8595.4396.363.0288.9181.4245.80
FlowWAM-FiveAges72.00763.5480.1457.3460.5490.9486.9641.9488.4385.6170.1275.7253.4385.2476.6695.2694.5996.262.6488.6880.9644.42
EvoPhysWorld71.73860.0784.1558.0459.7589.2085.6239.3488.4682.3779.6177.2758.7382.8476.0082.1595.5896.023.5988.3982.0743.49
NoxWM71.70960.7387.2855.2258.4287.8386.6838.9287.4980.0875.7687.5153.6689.2479.9289.6198.5795.581.1084.1277.0736.91
LeviosaWM71.641059.2888.2655.0856.3488.4888.5735.8285.3681.4077.1789.3157.2488.4077.4284.7798.2995.561.2688.7378.6335.26

Data source: WorldArena

Generated Scene Rollout

Xiaomi-Robotics-U0 connects image generation with world modeling — generated scenes become starting points for trajectory generation.

LanguageEmbodied Scene+LanguageVideo Rollout

Multi-view Prediction

Consistent multi-view embodied prediction across different camera perspectives.

Multi-view Initial Frame+LanguageVideo Rollout

Capability IV: General T2I & X2I

Beyond embodied generation, Xiaomi-Robotics-U0 retains broad visual synthesis and editing capability across text-guided creation and instruction-driven image transformation.

General Text-to-Image

High-fidelity visual synthesis across scenes, objects, and styles

Any-to-Image Editing

Instruction-following edits that preserve structure while changing intent

Add a small wooden boat, with a dark red hull.

Input image for: Add a small wooden boat, with a dark red hull.
Edited Xiaomi-Robotics-U0 result for: Add a small wooden boat, with a dark red hull.

Change the watch strap to a dark brown crocodile-embossed leather strap.

Input image for: Change the watch strap to a dark brown crocodile-embossed leather strap.
Edited Xiaomi-Robotics-U0 result for: Change the watch strap to a dark brown crocodile-embossed leather strap.

Replace the tiny house on wheels with a vintage car.

Input image for: Replace the tiny house on wheels with a vintage car.
Edited Xiaomi-Robotics-U0 result for: Replace the tiny house on wheels with a vintage car.

Replace the bird in the image with a small rabbit.

Input image for: Replace the bird in the image with a small rabbit.
Edited Xiaomi-Robotics-U0 result for: Replace the bird in the image with a small rabbit.

Add morning dew drops.

Input image for: Add morning dew drops.
Edited Xiaomi-Robotics-U0 result for: Add morning dew drops.

Change the house to a coastal setting with beach and ocean.

Input image for: Change the house to a coastal setting with beach and ocean.
Edited Xiaomi-Robotics-U0 result for: Change the house to a coastal setting with beach and ocean.

Add a sprig of cilantro to the painting.

Input image for: Add a sprig of cilantro to the painting.
Edited Xiaomi-Robotics-U0 result for: Add a sprig of cilantro to the painting.

Add a family of ducks swimming near the waterfalls.

Input image for: Add a family of ducks swimming near the waterfalls.
Edited Xiaomi-Robotics-U0 result for: Add a family of ducks swimming near the waterfalls.

Add a person walking along the dirt path toward the ocean.

Input image for: Add a person walking along the dirt path toward the ocean.
Edited Xiaomi-Robotics-U0 result for: Add a person walking along the dirt path toward the ocean.

Change the background to matte black.

Input image for: Change the background to matte black.
Edited Xiaomi-Robotics-U0 result for: Change the background to matte black.

Extract the yellow necktie worn in the image.

Input image for: Extract the yellow necktie worn in the image.
Edited Xiaomi-Robotics-U0 result for: Extract the yellow necktie worn in the image.

Remove the colorful inflatable bounce house in the foreground.

Input image for: Remove the colorful inflatable bounce house in the foreground.
Edited Xiaomi-Robotics-U0 result for: Remove the colorful inflatable bounce house in the foreground.

Make it look like abstract art.

Input image for: Make it look like abstract art.
Edited Xiaomi-Robotics-U0 result for: Make it look like abstract art.

Add warm sunset lighting.

Input image for: Add warm sunset lighting.
Edited Xiaomi-Robotics-U0 result for: Add warm sunset lighting.

Transfer the image into a hand-sculpted claymation style.

Input image for: Transfer the image into a hand-sculpted claymation style.
Edited Xiaomi-Robotics-U0 result for: Transfer the image into a hand-sculpted claymation style.

Replace the pipe-cleaner dragon with a bright yellow rubber duck.

Input image for: Replace the pipe-cleaner dragon with a bright yellow rubber duck.
Edited Xiaomi-Robotics-U0 result for: Replace the pipe-cleaner dragon with a bright yellow rubber duck.

Remove the camper van and make the forest seamless.

Input image for: Remove the camper van and make the forest seamless.
Edited Xiaomi-Robotics-U0 result for: Remove the camper van and make the forest seamless.

Make it look like an architectural sketch.

Input image for: Make it look like an architectural sketch.
Edited Xiaomi-Robotics-U0 result for: Make it look like an architectural sketch.

Change the main object color while preserving details.

Input image for: Change the main object color while preserving details.
Edited Xiaomi-Robotics-U0 result for: Change the main object color while preserving details.

Add soft overhead factory lighting.

Input image for: Add soft overhead factory lighting.
Edited Xiaomi-Robotics-U0 result for: Add soft overhead factory lighting.

Real Robot Improvement

Xiaomi-Robotics-U0-generated style-transfer data is added to real demonstration data for policy post-training, enabling the policy to learn robustness to unseen backgrounds, lighting, and visual interference.

Base Settings

Store Earphones

Store Earphones Base setting 1
Store Earphones Base setting 2
Store Earphones Base setting 3

Fold Towel

Fold Towel Base setting 1
Fold Towel Base setting 2
Fold Towel Base setting 3

Pack Box

Pack Box Base setting 1
Pack Box Base setting 2
Pack Box Base setting 3

Varying object layouts under nominal lab lighting and seen tablecloths.

Interference Settings

Store Earphones

Store Earphones Interference setting 1
Store Earphones Interference setting 2
Store Earphones Interference setting 3

Fold Towel

Fold Towel Interference setting 1
Fold Towel Interference setting 2
Fold Towel Interference setting 3

Pack Box

Pack Box Interference setting 1
Pack Box Interference setting 2
Pack Box Interference setting 3

Held-out tablecloths and lighting, including low, colored, and patterned light.

Progress

Task Completion Progress (%)

30.6
-45.8
76.4
54.2
-27.7
81.9
51.1
-48.9
100.0
73.3
-26.7
100.0
28.9
-37.8
66.7
62.2
-2.2
64.4
36.9
-44.1
81.0
63.2
-18.9
82.1
Store EarphonesFold TowelPack BoxAverage
Interference Progress36.9% -> 63.2%+26.3 pts under held-out backgrounds and lighting.
Drop from Base44.1 pts -> 18.9 pts25.2 pts smaller degradation with Xiaomi-Robotics-U0-Aug.

Real Robot Demos

Store Earphones

Green Interference Scene

Original

Xiaomi-Robotics-U0-Aug

Pink Interference Scene

Original

Xiaomi-Robotics-U0-Aug

Fold Towel

Green Interference Scene

Original

Xiaomi-Robotics-U0-Aug

Pink Interference Scene

Original

Xiaomi-Robotics-U0-Aug

Pack Box

Green Interference Scene

Original

Xiaomi-Robotics-U0-Aug

Blue Interference Scene

Original

Xiaomi-Robotics-U0-Aug

See Our Video

Citation

@misc{li2026xiaomiroboticsu0,
  title         = {{Xiaomi-Robotics-U0}: Unified Embodied Synthesis with World Foundation Model},
  author        = {Xinghang Li and Jun Guo and Qiwei Li and Long Qian and Hang Lai and Yueze Wang and Hongyu Yan and Jiahang Cao and Xi Chen and Jingen Qu and Jiaxi Song and Nan Sun and Hanye Zhao and Futeng Liu and Wanli Peng and Heyun Wang and Yunhong Wang and Caoyu Xia and Jack Zhao and Diyun Xiang and Hangjun Ye and Heng Qu and Huaping Liu and Jason Li},
  year          = {2026},
  eprint        = {2607.11643},
  archivePrefix = {arXiv},
  url           = {https://arxiv.org/abs/2607.11643}
}

Acknowledgements

Built upon Qwen3-32B & EMU3.5.

Thanks to all contributors.