Realizing Augmented Reality’s Benefits in Surgery through Real-Time Edge AI
, Surgical Artificial Intelligence Lead, Orsi Academy
Learn the current challenges and bottlenecks of augmented reality (AR) in robotic soft tissue surgery. We'll explore how one major issue, the occlusion of robotic instruments during AR, was resolved earlier this year with a dedicated inferencing pipeline developed on NVIDIA's Holoscan infrastructure. This enabled the first-in-human AR-guided robotic surgery with real-time AI inference on Holoscan. This pipeline efficiently processes and infers segmentation algorithms on edge, allows for 3D model manipulation, and has sufficient computational bandwidth for other real-time surgical AI processing workloads. We'll finish with a look at where the field is advancing next, which other current bottlenecks in robotic surgery can benefit from GPU acceleration, and what current steps have been taken to solve these needs.