NVIDIA announced new services and platforms aimed at accelerating the development of humanoid robotics. Unveiled at the SIGGRAPH conference, the offerings include NVIDIA NIM microservices, the OSMO orchestration service, and a teleoperated data capture workflow. These tools are designed to aid robot manufacturers, AI model developers, and software creators in building the next generation of humanoid robots.
The NIM microservices, powered by NVIDIA inference software, provide pre-built containers that streamline deployment, significantly reducing the time required from weeks to minutes. Two notable microservices, MimicGen and Robocasa, enhance simulation workflows in NVIDIA Isaac Sim™, a robotics simulation application built on the NVIDIA Omniverse™ platform. MimicGen generates synthetic motion data from teleoperated recordings, while Robocasa creates robot tasks and simulation-ready environments in OpenUSD.
The OSMO service, a cloud-native solution, allows for the orchestration and scaling of complex robotics workflows, including synthetic data generation, model training, and reinforcement learning. This service aims to cut deployment and development cycles from months to less than a week.
NVIDIA’s new teleoperation workflow, demonstrated at SIGGRAPH, enables the generation of extensive synthetic motion and perception data from minimal human demonstrations. This process involves capturing a small number of teleoperated demonstrations using Apple Vision Pro, simulating the recordings in Isaac Sim, and generating synthetic datasets via the MimicGen microservice. These datasets are then used to train the Project GR00T humanoid foundation model, streamlining the model development process.
The company also introduced the NVIDIA Humanoid Robot Developer Program, providing early access to NVIDIA’s technologies, including Isaac Sim, Isaac Lab, Jetson Thor humanoid robot computers, and Project GR00T models. Companies such as 1x, Boston Dynamics, ByteDance Research, and others have already joined the program, which aims to provide best-in-class technology for advancing humanoid robotics.
