NVIDIA DGX H200

Name: DGX H200: AI for Enterprise
Brand: NVIDIA

The gold standard for AI factory infrastructure.

The World’s Proven Choice for Enterprise AI Factories

Expand the frontiers of business innovation and optimization with NVIDIA DGX™ H200. Part of the NVIDIA DGX platform, DGX H200 is the AI powerhouse that’s the foundation of NVIDIA DGX SuperPOD^™ and NVIDIA DGX BasePOD^™, accelerated by the groundbreaking performance of the NVIDIA H200 Tensor Core GPU.

Download Datasheet

The Most Complete AI Factory

The Heart of Your AI Center of Excellence

Build your AI Center of Excellence on NVIDIA DGX H200, a fully integrated hardware and software solution that includes NVIDIA Base Command™, the NVIDIA AI Enterprise software suite, and expert advice from NVIDIA DGXperts.

Break Through Barriers to Scale AI

Get 32 petaFLOPS of AI performance and 2X faster networking than the previous generation, and high-speed scalability with the NVIDIA DGX H200 architecture. The solution is supercharged for the largest workloads, including generative AI, natural language processing, and deep learning recommendation models.

AI Infrastructure Tailored for You

Experience the power of NVIDIA DGX H200 in a multitude of ways that fit your business: on-premises, colocated, rented from managed service providers, and more. And with DGX-Ready Lifecycle Management, organizations get a predictable financial model to keep their deployments leading-edge.

Explore NVIDIA DGX H200

8x NVIDIA H200 GPUs with 1,128GBs of Total GPU Memory
18x NVIDIA NVLink® connections per GPU, 900GB/s of bidirectional GPU-to-GPU bandwidth
4x NVIDIA NVSwitches™
7.2TB/s of bidirectional GPU-to-GPU bandwidth, 1.5X more than previous generation
10x NVIDIA ConnectX®-7 400Gb/s Network Interface
1TB/s of peak bidirectional network bandwidth
Dual Intel Xeon Platinum 8480C processors, 112 cores total, and 2TB System Memory
Powerful CPUs for the most intensive AI jobs
30TB NVMe SSD
High-speed storage for maximum performance

What Customers Are Saying About NVIDIA DGX

Our DGX systems with NVIDIA Hopper architecture are powering the next generation of AI-enabled digital advertisement. We are using DGX systems to create AI-produced digital ads, including celebrity avatars, fully utilizing generative AI and LLM technologies.

— Takahito Naito, Managing Executive Officer, CyberAgent, Inc.

DGX systems with NVIDIA Hopper architecture are powering our collaborative research tackling grand challenges in climate science, sustainability, and microelectronics. The systems are enabling Oregon State University to drive innovation, solutions, entrepreneurship, and partnerships with industry and other higher education institutions to benefit Oregon, the nation, and the world.

— Edward Feser, Provost and Executive Vice President, Oregon State University

Quote 1
Quote 2

NVIDIA DGX SuperPOD

Leadership-class AI infrastructure.

Learn More

NVIDIA DGX Offers and Solutions

NVIDIA DGX SuperPOD

NVIDIA DGX SuperPOD is a turnkey AI data center infrastructure solution that delivers uncompromising performance for every user and workload. Configurable with any NVIDIA DGX system, DGX SuperPOD provides leadership-class accelerated infrastructure with scalable performance for the most demanding AI training and inference workloads, with industry-proven results, allowing it to deliver performance without compromise.

Infrastructure Purpose-Built for AI

NVIDIA DGX BasePOD

AI is powering mission-critical use cases in every industry—from healthcare to manufacturing to financial services. NVIDIA DGX BasePOD provides the reference architecture on which businesses can build and scale AI infrastructure.

The Industry Standard for AI at Scale

NVIDIA Base Command

Learn how to achieve cutting-edge breakthroughs with AI faster with this special technical training offered exclusively to NVIDIA DGX customers from the AI experts at NVIDIA’s Deep Learning Institute (DLI).

The Operating System of the NVIDIA DGX Data Center

Specifications

NVIDIA DGX H200

GPU	8x NVIDIA H200 Tensor Core GPUs
GPU Memory	1,128GB total
Performance	32petaFLOPS FP8
NVIDIA NVSwitch	4x
System Power Usage	~10.2kW max
CPU	Dual Intel® Xeon® Platinum 8480C Processors 112 cores total, 2.00GHz (Base), 3.80GHz (max boost)
System Memory	2TB
Networking	4x OSFP ports serving 8x single-port NVIDIA ConnectX-7 VPI Up to 400Gb/s NVIDIA InfiniBand/Ethernet
Management Network	10Gb/s onboard NIC with RJ45 100Gb/s Ethernet optional NIC Host baseboard management controller (BMC) with RJ45
Storage	OS: 2x 1.9TB NVMe M.2 Internal storage: 8x 3.84TB NVMe U.2
Software	NVIDIA AI Enterprise – Optimized AI software NVIDIA Base Command – Orchestration, scheduling, and cluster management NVIDIA DGX OS / Ubuntu / Red Hat Enterprise Linux / Rocky – Operating system
System Weight	287.6lb (130.45kgs)
System Dimensions	Height: 14.0in (356mm) Width: 19.0in (482.2mm) Length: 35.3in (897.1mm)
Operating Temperature	5–30°C (41–86°F)

Learn More About NVIDIA DGX

Build Your AI Factory for 2025 and Beyond

Prepare for future AI demands with NVIDIA DGX SuperPOD powered by Blackwell, the ultimate platform for your AI center of excellence. Harness full-stack solutions from NVIDIA’s ecosystem to stay ahead in the AI race.

Watch Video

NVIDIA DGX Enterprise Support and Services

Maximize the Value of the NVIDIA DGX Platform

NVIDIA Enterprise Services provides support, education, and infrastructure specialists for your NVIDIA DGX infrastructure. With NVIDIA experts available at every step of your AI journey, Enterprise Services can help you get your projects up and running quickly and successfully.

Learn More About Enterprise Services