A robot has learned to bowl, fold towels, unscrew lids, pour drinks, and prepare fresh orange juice by first imitating human demonstrations and then refining its skills through autonomous learning.
Researchers developed a new training framework called RL-100 that combines imitation learning with reinforcement learning, enabling robots to perform a wide range of real-world manipulation tasks with high reliability.
In tests, the system adapted to unfamiliar situations, recovered from disturbances, and even matched or outperformed human teleoperators in several tasks.
The robot also operated continuously for seven hours serving fresh juice in a public mall without a single failure.
Smarter robot learning
Developed by researchers led by Shanghai Jiao Tong University, the framework, called RL-100, allows robots to first acquire safe, human-like behaviors from demonstrations and then improve those skills through autonomous trial-and-error.
The approach overcomes one of robotics’ biggest challenges: moving beyond simply copying humans to achieving faster, more reliable, and more adaptable performance in unstructured environments. The researchers drew inspiration from how children learn. Babies initially rely on guidance from parents before gradually refining their abilities through independent practice. RL-100 follows the same philosophy through a three-stage learning pipeline.
The first stage uses imitation learning, where the robot observes teleoperated demonstrations performed by human experts. These demonstrations train a diffusion-based visuomotor policy, enabling the robot to learn the relationship between visual inputs—captured through RGB cameras or 3D point clouds—and the corresponding manipulation actions. This stage provides a stable behavioral foundation but remains limited by the quality and efficiency of the human demonstrations.
To overcome this “imitation ceiling,” the second stage introduces iterative offline reinforcement learning. Instead of relying solely on human data, the robot repeatedly performs tasks, stores the resulting experiences, and retrains itself using both demonstration data and its own successful attempts. A unified Proximal Policy Optimization (PPO)-based objective allows the system to refine the diffusion policy without destabilizing previously learned behaviors, while an offline policy evaluation mechanism prevents updates that could reduce performance.
The final stage applies a smaller amount of online reinforcement learning directly on the physical robot. This phase specifically targets rare failure cases that remain after offline training, improving reliability from roughly 90 percent success to near-perfect task completion while requiring relatively little additional real-world data.
Robots master manipulation
RL-100 also addresses a key practical limitation of diffusion policies—their computational latency. Standard diffusion models require multiple denoising steps before producing each action, making them too slow for high-frequency robotic control.
To solve this, the researchers developed a consistency-model distillation technique that compresses the multi-step diffusion policy into a single-step controller, reducing inference latency from around 100 milliseconds to about 10 milliseconds while maintaining performance. This enables faster reaction times and smoother control during deployment.
The framework is designed to be task-, robot-, and representation-agnostic, supporting both single-arm and dual-arm robots, single-action and action-chunk control, and either RGB images or 3D point clouds without changing the underlying learning framework.
Researchers evaluated RL-100 across eight challenging manipulation tasks involving rigid objects, deformable materials, liquids, and precision assembly. These included bowling, towel folding, pouring, unscrewing lids, folding boxes, and two stages of orange juicing. After completing the full training pipeline, the robot achieved a 100 percent success rate across 1,000 evaluation trials, matched or exceeded expert human teleoperators in task completion speed, adapted to unseen objects and environmental changes without retraining, and remained robust even when researchers physically interfered with its actions.
In a real-world deployment, the robot continuously prepared fresh orange juice for customers in a shopping mall for seven hours without a single failure, demonstrating the framework’s potential for reliable long-term operation in homes, factories, and public spaces.