NVIDIA embraces the meta universe and officially releases the Omniverse platform, which can generate AI avatars


Tencent technology news on November 9, NVIDIA released a set of tools for software developers on Tuesday to help them create a “meta universe” composed of three-dimensional virtual worlds and use more computing power from NVIDIA chips in the process. NVIDIA not only provides developers with software to draw a new virtual world, but also provides the equipment needed to lay the foundation for the virtual world, so as to closely connect the company with the metauniverse.
NVIDIA, whose business has gradually penetrated into software and services, officially released Omniverse enterprise at the company’s GPU Technology Conference on Tuesday. Omniverse enterprise, which released its beta version last December, is a simulation and collaboration platform. According to NVIDIA, the platform “acts as the connective tissue of a physically accurate 3D virtual world”. Omniverse enterprise uses NVIDIA chips to build a powerful computing system for enterprise customers. The starting price is $9000 per year and is sold through partners such as Dell and Lenovo Group.
Huang Renxun, CEO of NVIDIA, said in his keynote speech that through Omniverse, “we now have the technology to create a new 3D world or simulate our physical world.” among the products released by NVIDIA, including Omniverse avatar, a technology platform for generating interactive artificial intelligence avatars. The platform integrates NVIDIA’s technologies in voice artificial intelligence, computer vision, natural language understanding, recommendation engine and simulation technology, opens the door to the creation of artificial intelligence assistant, which can help deal with billions of daily customer service interactions, bring greater business opportunities and improve customer satisfaction. In addition, NVIDIA also released Omniverse replicator, an engine that generates a large amount of data needed to train deep neural networks of artificial intelligence.
“You will see an unchangeable theme — how to use Omniverse to simulate warehouses, factories and factories, physical and biological systems, 5G edges, robots, and autopilot cars,” Jen-hsun Huang said. In terms of self driving cars, Omniverse can help NVIDIA achieve its smallest product segmentation market: automotive market. NVIDIA’s previous financial report showed that the company’s auto chip sales in the second quarter were $152 million, accounting for only a small part of the company’s total revenue of $6.51 billion.
Using Omniverse Replicator, NVDA released DRIVE Sim, which can narrow the gap between the virtual world and the real world and improve the fidelity, helping autopilot cars better perceive and control the environment and respond to rapid changes. According to NVIDIA, DRIVE Sim can also be paired with Omniverse Avatar, integrating artificial intelligence drivers and concierge into self driving cars.
NVIDIA also announced that it would work with Equinix, a data center infrastructure company, to pre install and integrate the company’s artificial intelligence technology into its global data center. NVIDIA said Equinix was the first project partner of NVIDIA launchpad products. Launchpad allows users to run large data workloads for applications such as cancer research using artificial intelligence technology. Data center chipset sales have become the fastest growing part of the chip field. Chip manufacturers including NVIDIA, Intel and AMD are competing for market share. According to the financial report released by AMD at the end of last month, the company continued to perform strongly in data center sales. The sales of this business increased by 69% year-on-year to US $1.91 billion; Even Intel reversed a series of declines, and the financial report showed that its data center sales increased by 10% year-on-year to $6.5 billion.
Omniverse Enterprise
NVIDIA’s Omniverse, known as the “engineer’s metauniverse”, has been adopted by more than 700 companies and more than 70000 individual creators. They are committed to the analog digital twin project to replicate the real-world environment in the virtual space. Omniverse is NVIDIA’s simulation and collaboration platform, which provides the foundation of the metauniverse. Metauniverse is considered to be a virtual world that is both mapped and independent of the real world on the basis of the traditional cyberspace and with the improvement of the maturity of a variety of digital technologies. Omniverse is now moving from beta to universal, and it has expanded to the software ecosystem, making it accessible to 40 million 3D designers.
Richard kerris, vice president of platform development at Omniverse, said at the press conference: “You will see that Omniverse has become the basic platform of digital twins in all our different industries. We have seen and heard a lot about virtual worlds, but what really combines all these is connection. It gives these worlds a consistent foundation or a consistent channel to work together. Omniverse is the one who achieves this goal. It is me We are a platform to enhance and expand existing workflow. ”
Since the release of the public beta in 2010, Omniverse has expanded its coverage from engineers to almost any user who can use Blender’s open source 3D software. The software has more than 3 million users. Today, its other new extensions include daz3d, plantfactory, plantcatalog and Vue of EON software, radical, redeployment, replica, style3d and twinbru.
“We believe that these virtual worlds will become the next thing for the next era of innovation, whether it is city visualization and layout, earth simulation for weather patterns, digital production, or synthetic data for autopilot cars,” Chris said. “The virtual world is crucial to the next generation of innovation. We built Omniverse to serve this opportunity.”

Omniverse is adding new features such as augmented reality, virtual reality and multi graphics processor rendering, as well as infrastructure and industrial digital twin applications. NVIDIA has launched NVIDIA cloudxr, so developers can easily stream Omniverse experiences interactively to their mobile augmented reality and virtual reality devices.
Omniverse background
Omniverse is based on USD (Universal scene description), an open source animation tool widely used by Pixar, the world’s top animation studio. Pixar uses it to make animated movies. The platform also uses NVIDIA’s technologies, such as real-time realistic rendering, physics, materials and interactive workflow between industry-leading 3D software products.
“We think USD is a 3D hypertext markup language (HTML),” Chris said. “This is an important factor because it allows all these existing software products to take advantage of the virtual world we are talking about. You can see the output capability of Omniverse, whether you stream to an augmented reality or virtual reality device, or use a tablet computer to peep into the 3D world.”
Omniverse supports collaboration and simulation, which is critical for NVIDIA customers working in robotics, automotive, architecture, engineering, architecture, manufacturing, media and entertainment. Omniverse enables designers, artists, and reviewers to collaborate in real time across leading software applications anytime, anywhere in a shared virtual world. Chris said that NVIDIA is absorbing the opinions of developers, partners and customers and promoting the development of the platform, so that everyone from individuals to large enterprises can cooperate with others to build an amazing virtual world, which looks, feels and acts like the physical world.
NVIDIA defines the metauniverse as an immersive interconnected shared virtual world. Here, artists can create unique digital scenes, architects can create beautiful buildings, and engineers can design new products for families. These creations — often called digital twins — can be brought into the material world after they are perfected in the digital world.
Rev lebaredian, vice president of NVIDIA simulation technology and Omniverse engineering, said: “Digital twins are essentially a way to draw materials from the real world and represent them in the virtual world. Once you have an accurate representation of things in the real world in the virtual world and a simulator that can accurately simulate the behavior of the world, you can do something quite amazing,” he added, “In the virtual world, you can jump to any point of that world, you can feel it and feel it, just as you use the new technology being developed there to make us more immersed in these virtual worlds, from virtual reality to augmented reality, or the more traditional way to watch it through our screen. Through simulation, we can also be in these worlds We can record what happened in the past in the virtual world. ”
The key to Omniverse’s adoption by the industry is Pixar’s open source USD — the foundation of Omniverse collaboration and Simulation Platform — which enables large teams to work simultaneously across multiple software applications in shared 3D scenes. Engineers can process the same part of simulated images at the same time. The USD open standard provides software partners with a variety of ways to expand and connect to Omniverse, whether through U SD adopts and supports, or builds plug-ins or through Omniverse connector.
Omniverse Avatar
Omniverse avatar can generate interactive artificial intelligence avatar, which combines voice artificial intelligence, computer vision, natural language understanding, recommendation engine, simulation and other technologies. Huang Renxun’s Avatar was used in Huang Renxun’s keynote speech, which is also regarded as one of the highlights of his keynote speech.
Omniverse avatar opens the door to the creation of AI assistants that can be easily customized for almost any industry. This can help billions of daily customer service interactions – Restaurant orders, bank transactions, personal appointments and reservations – bring greater business opportunities and improve customer satisfaction. Of course, this means that these AI assistants may interact with people in the future Such competitive work.
“The dawn of intelligent virtual assistant has come,” Huang Renxun said in his speech. “Omniverse avatar combines NVIDIA’s basic graphics, simulation and artificial intelligence technologies to create some of the most complex real-time applications in history. The use cases of collaborative robots and virtual assistants are incredible and will have a far-reaching impact.”
Omniverse Replicator
Omniverse Replicator is a synthetic data generation engine, which produces 3D and 4D data, and can speed up the training of deep neural network. Invidia introduced two applications for generating synthetic data: a virtual world Nvidia Drive Sim used to manage the digital twin of autopilot cars, and another Nvidia Isaac Sim used to manipulate the digital twins of robots.
These two physics based Omniverse virtual worlds allow developers to guide artificial intelligence models, fill the data gaps in the real world, and mark the ground truth in a way that humans cannot do. The data generated in these virtual worlds can cover a variety of scenarios, including rare or dangerous situations that cannot be experienced regularly or safely in the real world. Use these data structures Built AV and robots can master skills in a series of virtual environments before applying skills to the physical world.

Omniverse replicator can create a large variety of physically accurate data according to the needs of AV and robot developers, so as to enhance the expensive and laborious manual marking of real-world data, which may be error prone and incomplete. It can also generate real ground data that is difficult or impossible for humans to mark, such as speed, depth, blocked objects, bad weather conditions or tracking the movement of objects on sensors. (compiled by Tencent technology / Wuji)