Luma AI to Accelerate NeRF XR Content Creation Lemuria Live
This Monday, Luma AI debuted a plugin for NVIDIA NeRF, a volumetric capture and immersive content creation suite which enables developers to run their designs on Unreal Engine 5 as a real-time render.
The update allows Unreal developers to run Luma AI volumetric renderings locally. Therefore, negating the need for streaming, geometry or material alterations. Platform developers can import Luma AI volumetric captures into an Unreal project, immediately presenting the digitised object in a developerâs pipeline.
Developers creating immersive gaming content or virtual production assets can leverage Luma AIâs plugin to streamline their production pipelines. Moreover, brands and entertainment groups could leverage the technology stack to create bespoke content such as immersive media and experiences.
Creating Luma AI NeRFs
Luma AIâs âVideo-to-3Dâ API software allows XR developers to generate NeRF digital Twins at a dollar a scene while only taking 30 minutes to create a virtual object.
The pricing allows Luma AI to democratise high-quality RT3D content creation for developers representing various use cases.
Luma AI states that its NeRF software is applicable to use cases such as eCommerce inventory previews and VFX content production.
The firmâs solution allows platform developers to embed NeRF objects directly into an RT3D engine, add textured objects, and import 360 scene captures.
Using Luma AI with NVIDIA NeRF and Unreal 5
Using Luma AIâs volumetric capture APIs, developers can create a digital twin of a real-life object and then import the file into Unreal 5 by installing the firmâs fresh plugin.
From there, Unreal developers can simply drag and drop their NeRF file into a project allowing for photorealistic assets in VR experiences.
Additionally, Luma AI provides four âBlueprintsâ to assist an Unreal developer with suitably importing an asset into a virtual world which reflects its digital environment.
Luma AIâs Baked Blueprint accurately simulates a captured objectâs real-life lighting conditions.
Dynamic Blueprints allow a NeRF object to alter based on Unreal lighting and shadow conditions.
Luma AIâs Cropped Blueprint provides an automatically shortened version of NeRF objects, if present.
Finally, the Environment Blueprint simulates a suitable sky-box for each NeRF capture.
Flattening the Curve for NeRF Content
Luma AI is working on RT3D rendering solutions that flatten the curve for local computing requirements. For example, in February, the firm introduced NeRF rendering tools that enable developers to preview RT3D content on web browsers.
Today we are ready to take AI Graphics to the next level: full volumetric photorealistic NeRF rendering on the web. All in realtime!
What you see is what you get for photorealistic 3D is finally here!
Starting with the the Fields Editor soon youâll be able to reshoot in⦠pic.twitter.com/ywkTdEVdyT
â Luma AI (@LumaLabsAI) February 23, 2023
Today we are ready to take AI Graphics to the next level: full volumetric photorealistic NeRF rendering on the web. All in realtime!In March, Luma AI secured roughly $20 million in a Series A funding round, accelerating Luma NeRF distribution for brands, studios, and smartphone users.
In a statement regarding its successful Series A funding, Luma AI expressed that it is âaggressively expandingâ its team to work on data and engineering systems that support large-scale renders and the ânext generation of UX.â
The funding round introduced NVentures, NVIDIAâs Venture Capital Group, to its partners, which also includes Matrix Partners, South Park Commons, and RFCâs Andreas Klinger.
Mohamed (Sid) Siddeek, the Corporate Vice President and Head of NVentures, said:
Luma is one of the first to bring to market new 3D NeRF capture technology, enabling non-technical users to create higher quality 3D renders than has previously been possible. The team has consistently demonstrated the ability to rapidly productize new research, and their long-term vision of democratizing access to 3D workflow tools for consumers has the potential to drastically lower the skills barrier to create & edit in 3D.
More on NeRF Solutions
NVIDIA is also working on a NeRF service. Instant NeRF from NVIDIA leverages AI networks to create a complete volumetric capture of an object or environment with rich considerations of a subjectâs lighting, shadows, and reflections.
The service also includes tools to import volumetric content into NVIDIAâs Omniverse suite for creating enterprise-grade immersive solutions, such as a VR scene.
NVIDIA developers can integrate their NeRF content across various use cases, such as property management, retail, and eCommerce.
Moreover, Epic Games provides a volumetric capture solution via RealityScan, an integrated NeRF service for Unreal 5. Using a sister smartphone application, the service allows users to create high-quality digital twins with a phone camera. The Reality Scan smartphone service also employs AR visualisations and feedback to reduce output errors.
There are various NeRF services emerging from trusted RT3D solutions providers. XR Today listed a handful of volumetric capture applications and services to help lead developers into the new design territory.
NeRF and photogrammetry solutions prepare XR enterprise designers for the Industry 4.0 landscape that presents new digital transformation opportunities; thatâll only increase as additional software, products, and updates debut and as RT3D engines become increasingly user-friendly and low-barrier.
About TechnoSoundz
TechnoSoundz is a news aggregation service provided by Lemuria Live, LLC. Here is Original Source of this article.
Coming Soon! SSR002 â Russ Urbanâs Funky 4 Play Remix Project featuring DJ Justin Johnson, Luis Martinez and Erik Horton
Follow us on Facebook for more news that you canât lose!
The post Luma AI to Accelerate NeRF XR Content Creation first appeared on Lemuria Live.
