The breakthrough CPU for the modern data center.
The NVIDIA Grace™ CPU is designed for a new type of data center—one that processes mountains of data to produce intelligence with maximum energy efficiency. These data centers run diverse workloads like AI, data analytics, hyperscale cloud applications, and high-performance computing (HPC). To meet the most demanding data center needs, Grace delivers 2X the performance per watt, 2X the packaging density, and the highest memory bandwidth compared to today’s leading servers.
The Grace CPU combines 72 high-performance and power-efficient Arm® Neoverse™ V2 cores, connected with the NVIDIA Scalable Coherency Fabric (SCF) that delivers 3.2TB/s of bisection bandwidth–double that of traditional CPUs to deliver maximum performance, while maintaining full compatibility with the Arm ecosystem. Grace is the first data center CPU to utilize server-class high-speed LPDDR5X memory with a wide memory subsystem that delivers up to 500GB/s of bandwidth at one fifth the power of traditional DDR memory at similar cost.
Highlights
NVIDIA Grace Superchip 480GB of LPDDR5X, AMD EPYC 9654 768 GB of DDR5. OS: Ubuntu 22.04 Compilers: GCC 12.3 unless noted below. Power for energy efficiency includes CPU + memory measured power. Graph Analytics: The Gap Benchmarks Suite BFS arXiv:1508.03619 [cs.DC], 2015. Data Analytics : HiBench+K-means Spark (HiBench 7.1.1, Hadoop 3.3.3, Spark 3.3.0; Grace: NVHPC 24.5, x86: Intel 2021.4) Weather: ICON QUBICC 80 km resolution NVHPC 24.5 (Grace) ICC 2021.4 (x86) Microservices: Google Protobufs (Commit 7cd0b6fbf1643943560d8a9fe553fd206190b27f | N instances in parallel)
Features
Specifications
NVIDIA Grace CPU C1 | NVIDIA Grace CPU Superchip | |
Configuration | 1x Grace CPU | 2x Grace CPU |
Core Count | 72 Arm Neoverse V2 Cores with 4x 128b SVE2 | 144 Arm Neoverse V2 Cores with 4x 128b SVE2 |
L1 cache | 64KB i-cache + 64KB d-cache per core | 64KB i-cache + 64KB d-cache per core |
L2 cache | 1MB per core | 1MB per core |
L3 cache | 114MB | 228MB |
LPDDR5X size | 120GB, 240GB and 480GB on-module memory options available | 240GB, 480GB and 960GB options available |
Memory bandwidth | Up to 384 GB/s for 480GB Up to 512 GB/s for 120GB, 240GB |
Up to 768 GB/s for 960GB Up to 1024 GB/s for 240GB, 480GB |
NVLink-C2C bandwidth | n/a | Up to 900 GB/s |
PCIe Links | Up to 4x PCIe Gen 5x16 with option to bifurcate | Up to 8x PCIe Gen 5x16 with option to bifurcate |
Get Started
Sign up to hear when NVIDIA Grace Blackwell becomes available.