Use of True Digital Twins to Develop, Test, and Optimize Complex Systems
, Kinetic Vision
, Kinetic Vision
We'll present a method where complex systems and processes are developed using a virtual environment, commonly known as a digital twin. The twin replicates the proposed physical space and includes all mechanical, robotic, sensor, vision, AI, and computer systems, while simultaneously incorporating real human action and interaction. Humans experience the system in virtual reality, with concurrent motion capture driving their avatars in real time. The avatars interact with virtual objects and their physical “stand-ins," which are also motion-tracked. All aspects of the system, including hardware, software, AI training data and models, and human interaction, are developed, tested, and optimized virtually using a software platform running on NVIDIA GPUs like the RTX 2080 Ti.