Brain / model / chipBrainOpen source

X-VLA (LeRobot)

Hugging Face (United States) ·
Illustration

No official image on file. Showing a schematic category illustration.

Soft-prompted VLA in LeRobot that scales across robots, cameras and action spaces with one transformer backbone.

Key specs

ArchitectureSoft-prompted unified transformer

Technical details

X-VLA is a soft-prompted, flow-matching VLA (arXiv 2510.10274) now integrated into LeRobot. It treats each hardware setup as a task and encodes it with a small set of learnable soft-prompt embeddings, letting one Transformer backbone absorb heterogeneous robots, cameras and action spaces. X-VLA-0.9B is pretrained on 290K episodes across seven platforms, and adapts to new robots by learning new prompts; with about 9M tuned parameters it reports near-π0 performance on LIBERO and Simpler-WidowX. In LeRobot it is used with policy.type=xvla, an action registry (including auto mode) and domain IDs.

ArchitectureSoft-prompted flow-matching VLA built from pure Transformer encoders: learnable per-domain soft-prompt embeddings encode embodiment/camera/domain differences from the earliest fusion stage (24 layers, hidden size 1024, 16 heads, 32-length soft prompts).
Params0.9B (X-VLA-0.9B)
Inputs outputsInputs: multi-view images, language, proprioceptive state, domain ID; outputs: action chunks (default 32 steps), e.g. 20-D ee6d or 14-D joint actions, auto-padded to the robot's action dimension.
Training dataPhase I pretraining on 290K episodes from DROID, RoboMIND and AgiBot spanning seven platforms and five arm types; Phase II adaptation by learning new soft prompts.
Embodiments supportedSingle-arm to bimanual arms; checkpoints for LIBERO, WidowX (Bridge), AgileX, Google Robot, cloth folding, SO-101 bimanual via action modes.
License weightsApache-2.0
License codeApache-2.0
Hardware requirementsCUDA GPU; bfloat16 recommended for fine-tuning to avoid OOM.
Benchmarks claimed
BenchmarkLIBERO (lerobot/xvla-libero)
Result93% success
Source urlhuggingface.co/…/xvla
BenchmarkSoft-FOLD cloth folding (lerobot/xvla-folding)
Result100% success over 2 hours of continuous folding
Source urlhuggingface.co/…/xvla
How to tryhuggingface.co/…/xvla-base
Sources

Benchmarks, where listed, are as claimed by the vendor.

Sources

More in Brain / model / chip

Illustration
Pi API (beta)

Pi API (beta)

Physical Intelligence · Brain / model / chip
NVIDIA Isaac ROS 5.0Open source

NVIDIA Isaac ROS 5.0

NVIDIA · Brain / model / chip
NVIDIA Jetson Orin Nano 2

NVIDIA Jetson Orin Nano 2

NVIDIA · Brain / model / chip