Runway introduces Praxis-1, a robotics model pretrained on web video

Runway introduces Praxis-1, a robotics model pretrained on web video

Ondřej Barták
Ondřej Barták
Entrepreneur and Programmer
3. 10. 2026
2 minutes reading · 43 views
Listen to the article
Audio version of the article
Runway introduces Praxis-1, a robotics model pretrained on web video

Runway has introduced Praxis-1, its first robotics world action model, built on large-scale video pretraining. The company proposes fine-tuning that foundation on robot-specific data to reduce the need for demonstrations collected through teleoperation. Early partner tests are underway, with the model’s weights planned for public release in the coming months.

From visual motion to robot commands

The proposed training process has two stages. Runway first aims to use web video to teach motion, interactions between objects and physically plausible behavior, followed by fine-tuning on robot data. Its goal is to reduce the demonstrations needed for individual tasks and hardware configurations.

Video footage alone usually lacks the information a robot records while performing a task. Web videos generally contain no control commands, joint positions or force measurements. Praxis-1 therefore requires robot-specific fine-tuning to connect learned visual concepts with commands the machine can execute.

An experiment comparing two pretraining sources

Runway reports that model performance improves as it scales up pretraining on third-person video. In one placement experiment, the company compared web video with footage of teleoperated robots. After fine-tuning, the web-video-pretrained version recorded a final placement error of 16.1 cm, compared with 16.0 cm for the version pretrained on robot video.

Another result concerns the evaluation of control policies in simulation. Runway reports a 0.95 correlation between evaluations in its generated simulations and results on physical robots.

Targeting difficult manipulation tasks

Runway is targeting four manipulation challenges with Praxis-1. One is selecting the correct target among nearly identical objects. Another involves cluttered scenes where objects overlap and obscure one another.

For transparent objects, the company is targeting shape and depth estimation when visual cues are weak. The fourth area involves deformable objects, such as cloth, that lack fixed grasp points.

Tests across robot platforms and planned open weights

Runway’s announcement describes the same control policy operating across different robot configurations without retraining, including bimanual systems, six-degree-of-freedom arms and mobile bases. In early partner tests, Noble Machines is using a bimanual manipulation system, Standard Bots is using its RO1 six-degree-of-freedom arm, and Ultra is using a mobile robot base.

The company demonstrated transfer between environments in a separate example. The same control policy operated in both a controlled studio and a domestic kitchen without additional training.

Runway plans to release Praxis-1’s weights publicly in the coming months. Developers can meanwhile request early access from the company’s robotics team.

Advertisement

Content created with help from UpTier.

SEO and GEO on autopilot. UpTier’s multi-agent systems write and optimize content for search engines and AI answers.

Discover UpTier ↗

Category:Robotics
Did you enjoy this article?
Discover more interesting posts on our blog
Back to blog

Related posts

A camera that takes off after intruders. Amazon shows what security without people could look likeA camera that takes off after intruders. Amazon shows what security without people could look like
Ring wants to transform security for homes and businesses: an autonomous drone and ground robot map the premises, respond to alarms and show what is happening.
5 min read
16. 11. 2026
OpenAI Disbands Robotics Team but Will Still Build Its Own HumanoidOpenAI Disbands Robotics Team but Will Still Build Its Own Humanoid
OpenAI has disbanded its standalone robotics team, but has not abandoned its humanoid plans. The reshuffle aims to speed up development using models that, according to the company, control robots better than expected.
7 min read
16. 11. 2026
Gemini Robotics 2.5 aims to improve robots’ dexterityGemini Robotics 2.5 aims to improve robots’ dexterity
Google DeepMind has introduced a robot-control model that combines vision, language and actions. DeepMind says it achieved a 96% success rate in a test packing automotive parts at Mercedes-Benz.
1 min read
11. 11. 2026
Přihlaste se k odběru našeho newsletteru
Zůstaňte informováni o nejnovějších příspěvcích, exkluzivních nabídkách, a aktualizacích.
CodedTrip

Operated by CodedTrip LLC, USA.

YouTube
TikTok