| |

NVIDIA Announces Generative AI Models and NIM Microservices for OpenUSD Language, Geometry, Physics and Materials

August 27, 2024

NVIDIA Announces Generative AI Models and NIM Microservices for OpenUSD Language, Geometry, Physics and Materials

New Services Accelerate Universal Scene Description-Based Workflows and Development of Industrial Digital Twins and Robotics

NVIDIA has announced major advancements to Universal Scene Description, or OpenUSD, that will expand adoption of the universal 3D data interchange framework to robotics, industrial design and engineering, and accelerate developers’ abilities to build highly accurate virtual worlds for the next evolution of AI.

Through new OpenUSD-based generative AI and NVIDIA-accelerated development frameworks built on the NVIDIA Omniverse™ platform, more industries can now develop applications for visualizing industrial design and engineering projects, and for simulating environments to build the next wave of physical AI and robots.

The new offerings include NVIDIA NIM™ microservices for AI models that can generate OpenUSD language to answer user queries, generate OpenUSD Python code, apply materials to 3D objects, and understand 3D space and physics to help accelerate digital twin development. In addition, new USD connectors to robotics and industrial simulation data formats and developer tools let users stream massive, fully NVIDIA RTX™ ray-traced datasets to Apple Vision Pro.

“The generative AI boom for heavy industries is here,” said Rev Lebaredian, vice president of Omniverse and simulation technology at NVIDIA. “Until recently, digital worlds have been primarily used by creative industries; now, with the enhancements and accessibility NVIDIA NIM microservices are bringing to OpenUSD, industries of all kinds can build physically based virtual worlds and digital twins to drive innovation while preparing for the next wave of AI: robotics.”

Generative AI Comes to USD With NVIDIA NIM
The world’s first generative AI models for OpenUSD development, developed by NVIDIA, will be available as NVIDIA NIM microservices. The models enable developers to incorporate generative AI copilots and agents into USD workflows, broadening the possibilities in 3D worlds and helping speed the adoption of USD across a new range of industrial sectors, like manufacturing, automotive and robotics.

The microservices available in preview are:

  • USD Code NIM microservice — answers general knowledge OpenUSD questions and automatically generates OpenUSD-Python code based on text prompts that can then be inputted into an OpenUSD viewing app, such as usdview from Pixar, or an NVIDIA Omniverse Kit-based application to visualize the corresponding 3D data.
  • USD Search NIM microservice — enables developers to search through massive libraries of OpenUSD, 3D and image data using natural language or image inputs.
  • USD Validate NIM microservice — checks the compatibility of uploaded files against OpenUSD release versions and generates a fully RTX-rendered, path-traced image, powered by NVIDIA Omniverse Cloud APIs, or application programming interfaces.

Newly announced microservices that will be available soon are:

  • USD Layout NIM microservice — enables users to assemble OpenUSD-based scenes from a series of text prompts based on spatial intelligence.
  • USD SmartMaterial NIM microservice — predicts and applies a realistic material to a computer-aided design object.
  • fVDB Mesh Generation NIM microservice — generates an OpenUSD-based mesh, rendered by Omniverse Cloud APIs, from point-cloud data.
  • fVDB Physics Super-Res NIM microservice — performs AI super resolution on a frame or sequence of frames to generate an OpenUSD-based, high-resolution physics simulation.
  • fVDB NeRF-XL NIM microservice — generates large-scale neural radiance fields in OpenUSD using Omniverse Cloud APIs.

Foxconn, a global manufacturing leader with more than 170 factories worldwide, is already benefiting from NVIDIA’s computing platform, using NIM microservices and Omniverse to create a digital twin of a factory under development.

“Digital twins will help us accelerate the next wave of industrial manufacturing and autonomous machines,” said Zhe Shi, chief digital officer and head of the Smart Manufacturing platform at Foxconn. “NVIDIA Omniverse and the new NIM microservices will democratize the ability to develop digital twins and help our teams build physically based virtual factories faster than ever.”

WPP, a world leader in marketing and communications services company, is an early adopter of USD Search and USD Code NIM microservices, implementing them in its generative AI-enabled content creation pipeline, built on NVIDIA Omniverse, for customers such as The Coca-Cola Company.

“The beauty of the innovation is how compatible it is with the way we work, and that it leverages open standards — accelerating not only future work, but allowing us to continue to build on and extend the usefulness of all our previous investments in standards like OpenUSD,” said Stephan Pretorius, chief technology officer at WPP. “Using NVIDIA NIM microservices with NVIDIA Omniverse has made it possible for us to launch innovative new production tools with companies like The Coca-Cola Company at unprecedented speed.”

USD Connectors Bring Generative AI to More Industries
A series of new USD connectors for robotics data formats and streaming to Apple Vision Pro opens the portals of OpenUSD interoperability and advanced authoring to more industries.

NVIDIA and Siemens, a global leader in industrial automation and software, are extending their collaboration to facilitate more industrial workloads using OpenUSD. Siemens will integrate OpenUSD pipelines with its Simcenter portfolio of simulation technologies to support evidence-based decision-making and collaboration among key stakeholders.

This integration enables high-fidelity, real-time, photorealistic visualization of complex simulation data, providing deeper insights into a product’s performance within its real-world operating environment. The work will build on Siemens’ efforts to incorporate Omniverse into its Teamcenter Product Lifecycle Management portfolio.

NVIDIA also released a connector from Unified Robotics Description Format to OpenUSD, letting roboticists seamlessly bring their robot data across applications, including for design, simulation and reinforcement learning.

To further advance OpenUSD ecosystem expansion, NVIDIA announced the OpenUSD Exchange software development kit, enabling developers to build their own robust OpenUSD data connectors.

New developer tools and APIs to stream large-scale OpenUSD scenes from an application built on the Omniverse platform to Apple Vision Pro via the NVIDIA Graphics Delivery Network are now available in early access.

“OpenUSD is revolutionizing the way we create and interact with 3D content,” said Steve May, chief technology officer of Pixar and chairman of the Alliance for OpenUSD (AOUSD). “Now, with these new services and APIs for OpenUSD built by NVIDIA, we expect to see accelerated growth and adoption of USD, paving the way for new users and industries to more easily engage with our ecosystem.”

OpenUSD Ecosystem Momentum
Last year, NVIDIA cofounded the AOUSD along with Pixar, Adobe, Apple and Autodesk. Through AOUSD, NVIDIA and other collaborators have announced a new OpenUSD release, progress on an OpenUSD core specification and new members.

Availability
The USD Search, USD Code and USD Validate NIM microservices are available in preview on the NVIDIA API catalog. The OpenUSD to URDF connector is now available with NVIDIA Isaac Sim™.

Developers can get started integrating generative AI into OpenUSD workflows with new Omniverse developer tools and a reference workflow for building a generative AI-enabled synthetic data pipeline with OpenUSD.

Source

Related Story

Siemens and NVIDIA Expand Collaboration on Generative AI for Immersive Real-Time Visualization

Siemens announced that it will deepen its collaboration with NVIDIA to help build the industrial metaverse. Siemens is bringing immersive visualization powered by new NVIDIA Omniverse Cloud APIs to the Siemens Xcelerator platform, driving increased use of AI-driven digital twin technology. At the NVIDIA GTC, the two companies demonstrated how generative AI can revolutionize the visualization of complex data, making photorealism possible, and showcased how sustainable shipbuilder HD Hyundai can use it to develop new products.

Related Articles


Latest Articles

  • Festo Didactic Showcases Technical Education and Training at Hannover Messe 2025

    Festo Didactic Showcases Technical Education and Training at Hannover Messe 2025

    May 20, 2025 By Krystie Johnston Hannover Messe 2025 was an extra special event for Festo. The Festo Group celebrated their 100th anniversary, Festo Canada celebrated their 50th anniversary, and Festo Didactic celebrated their 60th anniversary. Festo Didactic, the education arm of the company, understands how important education is for empowering individuals, driving economic growth,… Read More…

  • EtherCAT in Boost Mode

    May 14, 2025 EtherCAT and PC-based control in test bench technology EtherCAT is by far the fastest Industrial Ethernet technology. Nevertheless, the data acquisition process at Kraus & Naimer’s cam controller test benches called for an even shorter bus cycle. To achieve the required performance, Beckhoff specialists reduced the previous cycle time from 100 µs… Read More…


Featured Article

Revolutionizing Material Movement with Autonomous Mobile Robots

Revolutionizing Material Movement with Autonomous Mobile Robots

In today’s fast-paced manufacturing and logistics industries, the need for efficient and flexible material movement solutions has never been greater. Traditional methods like conveyor systems, forklifts, and manual pushcarts have served us well, but they come with limitations.

That’s why Omron is thrilled to announce the launch of their game-changing MD Series of Autonomous Mobile Robots (AMRs). Read more


Products

  • Electromate to Offer UR7e, UR12e & UR15 Collaborative Robots from Universal Robots

    May 20, 2025 Electromate is expanding its lineup of collaborative automation solutions with the addition of three advanced models from Universal Robots: the UR7e, UR12e, and UR15. These robots provide enhanced options for payload, reach, and precision in demanding collaborative applications. The UR7e delivers a 7 kg payload, 1300 mm reach, and ±0.03 mm repeatability. Positioned between the UR5e and… Read More…

  • Redefining Non-Invasive Temperature Measurement

    May 14, 2025 iTHERM SurfaceLine TM611 provides accuracy and response time comparable to invasive temperature measurement. The non-invasive thermometer iTHERM SurfaceLine TM611 by Endress+Hauser can be used across all industries for a wide range of demanding industrial applications. The surface-mounted thermometer measures process temperature without the risk of leakage and flow disruption. A specially designed… Read More…