Improving the User Experience with Real-Time Deep Learning Model Inference in a Mobile Environment
, Voyagerx
There have been huge advancements in mobile deep learning over the past few years. vFlat, a deep learning-based mobile scanner, uses real-time inference to provide useful 3D information from 2D input. We'll cover:
1. How vFlat used real-time inference to improve the user experience. 2. Our experience with hardware acceleration on Android and iOS devices to realize real-time on-device inference, which includes TFLite GPU delegate, TFLite Metal delegate, and CoreML. 3. Practical considerations and tricks that we learned along the way.