Dynamic Shapes First: Advanced GPU Fusion in PyTorch
, NVIDIA
Highly Rated
The PyTorch team at NVIDIA has built an entirely new code generation stack specifically for PyTorch, enabling better automated fusion while also supporting dynamic shapes without frequent recompilation. We'll walk you through the design, benefits, and future direction of this project.