您现在的位置是:Neuralangelo: Nvidia's new AI model turns 2D videos into 3D structures >>正文
Neuralangelo: Nvidia's new AI model turns 2D videos into 3D structures
上海品茶网 - 夜上海最新论坛社区 - 上海千花论坛897人已围观
简介By subscribing, you agree to our Terms of Use and Policies You may unsubscribe at any time.Artificia...
By subscribing, you agree to our Terms of Use and Policies You may unsubscribe at any time.
Artificial intelligence (AI) company and chip manufacturer Nvidia announced the latest AI tool in its army of models.
Neuralangelo is an AI model that turns 2D video clips into detailed 3D structures. It uses neural networks for 3D reconstruction, generating life-like virtual replicas of buildings, sculptures, and other real-world objects.
The name Neuralangelo is an ode to the world’s most famous sculptor and painter, Michelangelo, known for the Renaissance sculpture David, painting of the Sistine Chapel ceiling, and many other masterpieces.
In a demo attached below, Neuralangelo recreates objects as iconic as Michelangelo’s David and as commonplace as a flatbed truck.
See Also Related- Nvidia joins trillion-dollar club, riding on the AI boom
- The AI revolution has just begun: Nvidia CEO says seize the opportunity
- Nvidia and MediaTek partner to introduce next-generation in-car systems with AI
- Nvidia to build Israel's most potent AI supercomputer
- Nvidia strengthens portfolio to offer more AI products and services
The AI model emerged from a study done in collaboration with the NVIDIA research team and the Johns Hopkins University in Maryland, U.S.
Neuralangelo is one of nearly 30 projects by NVIDIA Research to be presented at the Conference on Computer Vision and Pattern Recognition (CVPR), taking place June 18-22 in Vancouver. The papers span topics including pose estimation, 3D reconstruction, and video generation, said the company in a blog.
Multiple images observed from different viewpoints
How it works is that the AI-powered model will observe the depth, shape, and size of the characters or objects in a 2D video from multiple angles. Neuralangelo will at first create an initial 3D representation of the scene and then will optimize the render to enhance it further to lift the intricate details and textures.
Creative professionals can then use the 3D outcome in design applications, editing them further for use in art, video game development, and robotics, said the company in a blog. It also equips users with the capability of creating digital twins of the real world using ubiquitous mobile devices.
Many are wondering what this means for the gaming industry, in which Nvidia’s graphic cards are a leader. The company recently announced the Nvidia RTX 4060 Ti, an upgrade after RTX 4070.
“The 3D reconstruction capabilities Neuralangelo offers will be a huge benefit to creators, helping them recreate the real world in the digital world,” said Ming-Yu Liu, senior director of research and co-author of the paper, in the blog.
“This tool will eventually enable developers to import detailed objects — whether small statues or massive buildings — into virtual environments for video games or industrial digital twins,” she added.
As one Twitter user described it as ‘photogrammetry on steroids,’ neural surface reconstruction methods used in Neuralangelo have shown potential in overcoming ambiguous observations like large areas of homogeneous colors, repetitive texture patterns, or strong color variations. Photogrammetry is a technique that uses photos as the primary medium for the measurement of physical objects.
The concept behind Neuralangelo is not new. NVIDIA research last year created NVIDIA 3D MoMa, which allows architects, designers, and game developers to import objects into a graphics engine for digital manipulation.
Tags:
转载:欢迎各位朋友分享到网络,但转载请说明文章出处“上海品茶网 - 夜上海最新论坛社区 - 上海千花论坛”。http://www.jz08.com.cn/news/95967.html
相关文章
Polkadot (DOT) benefits from Binance news
Neuralangelo: Nvidia's new AI model turns 2D videos into 3D structuresDOT price surged closer to $8.00 before slowing down, but will likely increase if bulls hold above $...
阅读更多
Best sites to Buy Crypto 2021
Neuralangelo: Nvidia's new AI model turns 2D videos into 3D structuresWith the recent bull run giving a positive end to a very unpredictable year, many people are now eag...
阅读更多
Ruffer Investment allocates 3% of funds to Bitcoin
Neuralangelo: Nvidia's new AI model turns 2D videos into 3D structuresRuffer Investment has rationalised its unprecedented resolution to purchase $750 million worth of Bi...
阅读更多
热门文章
- New magnets for LHC upgrade arrive at CERN from US
- Belgium's first and only crypto lender suspends activities
- New washing technique boosts battery life, researchers claim
- 45% of stablecoin balance has left crypto exchanges in 4 months, but where has all the money gone?
- Ukraine plans to build 4 new nuclear reactors this year
- Bank of America is bullish on DeFi and NFTs