Quantum computing has the potential to offer giant leaps in computational capabilities, impacting a huge range of industries from drug discovery to portfolio optimization. Realizing these benefits requires pushing the boundaries of quantum information science now in developing algorithms, researching more capable quantum processors, and creating tightly integrated quantum-classical systems and tools. We'll review these challenges facing quantum computing, offer insight into how GPU supercomputing can help move industries toward quantum advantage, and discuss the latest developments in software and systems for tightly integrated quantum-classical computing.