Ψ0 (Psi-Zero), Explained: The Humanoid Foundation Model That Learns From Human Video

Ψ0 (Psi-Zero), Explained: The Humanoid Foundation Model That Learns From Human Video — key results, explained in plain English

Making a robot smart comes down, in the end, to data. And the data that matters most — a person steering a robot by teleoperation, one demonstration at a time — is expensive and slow to collect. Ψ0 (Psi-Zero), a paper released in March 2026 and promptly accepted to RSS (Robotics: Science and Systems) 2026, one of the top venues in robot research, took a different route: 800 hours of first-person human video — the kind YouTube is full of — plus just 30 hours of real robot data. With that combination it beat a competing model trained on more than ten times the data by over 40 percent in success rate. Today we take this paper apart at a general reader’s eye level.

ItemDetails
Original titleΨ₀: An Open Foundation Model Towards Universal Humanoid Loco-Manipulation
Authors / affiliationSonglin Wei, Hongyi Jing, Boqian Li and 12 others (corresponding authors Yue Wang, Marco Pavone) · Physical Superintelligence Lab
Release / acceptancearXiv preprint released March 12, 2026 / accepted to RSS 2026 · model and code released as open source
DOI / linkarXiv:2603.12263 — arxiv.org/abs/2603.12263

Loco-manipulation? The word welds locomotion (walking) to manipulation (handling things with the hands). It names the ability to move and manipulate as one body — the way a person walks over, opens a door, picks something up, and carries it. A humanoid cannot become a real worker without it.

The core technique

Ψ0’s core idea is, unexpectedly, refusing to mix.

A lot of recent work has assumed that pouring human data and robot data into one pot and co-training on both is the way forward. The Ψ0 authors push back: a human body and a humanoid body differ fundamentally — in joint structure and in how they move — so blending the two datasets makes them trip each other up. It is like trying to stamp a right-hander’s and a left-hander’s handwriting habits into one person’s body at the same time.

So Ψ0 splits learning into two separate stages (staged training):

  • Stage 1 — building intuition from human video: the model first studies 800 hours of first-person footage of people handling objects, absorbing the general visual-action sense of “in this situation, the hand reaches like this.”
  • Stage 2 — calibrating hands and feet on robot data: on top of that, 30 hours of high-quality humanoid robot data fine-tune the model to drive real robot joints precisely.
Ψ0 two-stage training — human video for intuition, robot data for calibration

The theory in plain words

Ψ0’s brain divides into two systems, like the human “fast brain / slow brain.”

  • System-2 (the slow brain, in charge of understanding): a vision-language model (VLM) backbone that understands the camera view and a language command (“put the cup on the shelf”). It reads the situation and decides what needs doing.
  • System-1 (the fast brain, in charge of execution): a flow-based action expert that turns that judgment into actual joint motion. It carries the diffusion/flow techniques used in image-generation AI (the Stable Diffusion family) over to robot motion generation — a module of roughly 500 million (500M) parameters that produces smooth, continuous movement.

Because Stage 1 pre-soaks the VLM backbone in human video in an autoregressive fashion, Stage 2 needs only a little robot data to lock in real-world competence quickly. The result: a completely new long-horizon task can be learned from just 80 demonstrations. Against the hundreds to thousands of demonstrations robot learning usually demands, that is a jolt.

Real-world results

The most attractive point is the data economics. Robot data has a severe bottleneck: a person has to teleoperate the robot and gather it stitch by stitch. Ψ0 cuts that expensive robot data down to 30 hours and fills the rest with cheap, abundant human video. According to the paper, this recipe outperformed even a model pre-trained on more than 10 times the data.

The natural application scenarios are repetitive walk-grasp-carry work: loading and unloading in warehouses, tidying and storage at home, tool use by service robots. The remaining limits are just as clear, though. Sourcing high-quality human video (first-person, with hand manipulation clearly visible) is itself no small task, and the paper’s performance numbers come from controlled settings — they have not been validated against the unpredictable variables of full household and industrial environments. And although the work has moved past the preprint stage into RSS acceptance, product-grade safety and reliability remain a separate, long road.

800 hours of human video versus 30 hours of robot data

Why it matters

Industrially, the big fact is that Ψ0 is released open source. Smaller robot companies and labs that could never afford to develop a foundation model of their own now have a path: take this model and fine-tune it with a small amount of their own robot data.

Seen from Korea’s robot industry — the world’s densest robotics market — hardware-strong players such as Rainbow Robotics (humanoid platforms), Doosan Robotics (collaborative robots), and LG and Samsung (appliance and home robots) could use a data-efficient robot brain like Ψ0 as a lever to close the software gap quickly. The “learn from human video” direction also meshes well with the country’s strength in video and data infrastructure.

Who should care

  • If you invest: robot competitiveness may shift from “who holds the most data” to “who learns best from the least.” Teams and companies with data-efficiency technology may get re-rated. (This is industry-trend information, not a recommendation to buy any particular stock.)
  • If you study or research: image-generation AI (diffusion/flow) and robot control are meeting inside one model. Whichever field you are in, learning the other side’s techniques widens your opportunities.
  • If you build products: rather than building a foundation model from scratch, taking an open model and fine-tuning it on “our robot’s data” may be the realistic winning move.

The 3–5 year view

The bridge Ψ0 built — from human video to robot motion — could redraw the robot-learning landscape three to five years out. The vast archive of first-person human activity video on the internet becomes the robot’s textbook, and a new task takes hours to teach instead of days. Humanoids that learned to walk, grasp, and carry from watching people, quietly settling into warehouses and homes — that picture stops being a distant one.

Frequently asked questions

Is Ψ0 a robot that is already on sale?

No. Ψ0 is not a specific product but “brain” software — a foundation model that can sit on top of many different humanoids — and its code and model are released open source for research.

Can human video alone make a robot move perfectly?

Human video is the Stage 1 ingredient that builds the “feel”; precise real movement is completed in Stage 2, where 30 hours of robot data fine-tune the model. Keeping those two stages separate is the heart of this paper.

This edition examined Ψ0, a humanoid foundation model whose weapon is data efficiency. Next on this shelf: a recent paper on contact-rich manipulation that combines tactile sensing with force control.

Source: arxiv.org/abs/2603.12263 (project: psi-lab.ai/Psi0)

This article reinterprets published research for a general audience; for full details, see the original paper. The rest of the decoded-papers shelf lives on the Physical AI page.

Watch it explained

NVIDIA introduces GR00T N1, the open humanoid foundation model trained on human video and synthetic data (2.23M subscribers, 285K views).

Full index

Every guide in the Physical AI library — 27 of them, grouped so you can find the one you need.

Start here

Research papers, decoded

Machines, priced

Home robots, tested

Chips & companies

Looking for the other library? Generative AI — tools, tested →

Similar Posts