Taming the Computer Vision Zoo with NVIDIA Triton for an easy scalable eco system
, Volkswagen
AI based visual inspection is one of the key quality control and status monitoring technologies. That’s why Volkswagen Group IT developed an ecosystem where creative computer vision solutions are contributed from internal teams and partners and shared with all business units as computer vision self-services. Having multiple different types of AI technologies rises the need to consolidate and streamline the deployment. This talk is about consolidation of inferencing workload using NVIDIA TRITON inferencing server. NVIDIA TRITON is a key part in the so called “Volkswagen Computer Vision Workbench”. The vision workbench allows partners to contribute computer vision solutions in different formats (Tensorflow, PyTorch, ONNX) while using generic business apps for standard computer vision tasks from the ecosystem. Having a simplified model administration, update and deployment environment is a crucial step for VW to serve AI models in new and interesting environments.