Progression

blogs.nvidia.com

Open source AI has shown how quickly developers can innovate when models, data and tools are shared. Robotics has the same opportunity, but advancements in physical AI development can still be gated by costly and fragmented resources, from large datasets and robot foundation models to simulation, compute and validation tools.

NVIDIA and Hugging Face are collaborating to bring the NVIDIA Isaac GR00T 1.7 open, reasoning vision language action (VLA) model for humanoid robots and the NVIDIA Isaac Teleop framework to LeRobot — Hugging Face’s open source library for robotics — with NVIDIA Cosmos 3, a frontier model for physical AI, planned soon. Together, these integrations give developers a more accessible and standardized path for end-to-end robot development while driving innovation and collaboration across the open robotics community.

“Open source is how a field turns advanced research into something people can study, adapt and build on,” said Thomas Wolf, cofounder and chief science officer at Hugging Face. “With NVIDIA Isaac GR00T 1.7 and Isaac TeleOp in LeRobot today, robotics developers can use shared models, data and workflows to train and evaluate robots in the open. And with NVIDIA Cosmos 3 planned next, the community will have a path to bring frontier world models into that same collaborative loop.”

An Open Pipeline for Robot Foundation Models

Hugging Face LeRobot is an open source robotics library for training, running and sharing robot datasets, models, policies and workflows. NVIDIA’s continued partnership with Hugging Face connects NVIDIA’s 3 million robotics developers with Hugging Face’s 16 million AI builders, expanding access to frontier physical AI tools through open workflows.

Bringing NVIDIA physical AI capabilities into LeRobot gives developers a common way to collect and standardize data, train and fine-tune robot foundation models, evaluate performance and deploy models through open workflows. The integrations include:

• NVIDIA Isaac Teleop, an open source framework for robot data collection, helps developers capture high-quality human demonstrations from external devices using standardized, interoperable formats, then expand and share datasets with the community, all directly in LeRobot.
• NVIDIA Isaac GR00T 1.7, the first open and commercially viable robot foundation model, makes it easier to post-train and deploy models through LeRobot workflows, helping developers adapt GR00T to new robot embodiments and tasks with benchmarked performance.
• NVIDIA Cosmos 3, a frontier world foundation model for physical AI coming soon to LeRobot, will help developers generate and augment robotics data, simulate scenarios and support policy development when real-world data is limited or too expensive to collect.

These integrations build on a broader set of NVIDIA resources already connected to LeRobot to support the full robotics development loop, including:

• The largest open source physical AI dataset, downloaded more than 15 million times, which includes more than 350,000 real and simulated trajectories and 57 million grasps to help developers kickstart their robotics workflows.
• NVIDIA Isaac Sim– and Isaac Lab-based simulation frameworks to help developers set up environments, generate robot data, test policies and validate behaviors before moving to physical robots.
• NVIDIA Isaac Lab-Arena in LeRobot Environment Hub to enable developers to quickly prototype complex simulation environments, register them in LeRobot EnvHub and seamlessly use them within the LeRobot ecosystem to train and evaluate generalist robot policies such as GR00T, Pi and SmolVLA.
• NVIDIA Jetson Thor integration with LeRobot’s Reachy 2 to support deployment of VLA models on open source humanoid robots.

Learn more about how to use Isaac Teleop, Isaac GR00T 1.7 and Isaac Lab-Arena with LeRobot for end-to-end humanoid development and explore detailed LeRobot integration workflows.