NVIDIA DGX H200 - The World’s Proven Choice for Enterprise AI

NVIDIA DGX™ H200

Expand the frontiers of business innovation and optimization with NVIDIA DGX™ H200. Part of the DGX platform, DGX H200 is the AI powerhouse that’s the foundation of NVIDIA DGX SuperPOD™ and DGX BasePOD™, accelerated by the groundbreaking performance of the NVIDIA H200 Tensor Core GPU.

The Most Complete AI Platform

The Heart of Your AI Center of Excellence

Build your AI Center of Excellence on DGX H200, a fully integrated hardware and software solution that includes NVIDIA Base Command™, the NVIDIA AI Enterprise software suite, and expert advice from NVIDIA DGXperts.

Break Through Barriers to Scale AI

Get 32 petaFLOPS of AI performance and 2X faster networking than the previous generation, and high-speed scalability with the DGX H200 architecture. The solution is supercharged for the largest workloads, including generative AI, natural language processing, and deep learning recommendation models.

AI Infrastructure Tailored for You

Experience the power of DGX H200 in a multitude of ways that fit your business and with DGX-Ready Lifecycle Management, organizations get a predictable financial model to keep their deployments leading-edge.

Explore NVIDIA DGX H200

Explore the powerful components of DGX H200

1 8x NVIDIA H200 GPUs With 1,128 Gigabytes of Total GPU Memory
18x NVIDIA® NVLink® connections per GPU, 900 Gb/s of bidirectional GPU-to-GPU bandwidth

2 4X NVIDIA NVSwitches™
7.2 Tb/s of bidirectional GPU-to-GPU bandwidth, 1.5X more than previous generation

3 10x NVIDIA ConnectX®-7 400 Gb/s Network Interface
1 Tb/s of peak bidirectional network bandwidth

4 Dual Intel® Xeon® Platinum 8480C Processors and 2 TB System Memory
Powerful CPUs for the most intensive AI jobs

5 30 Terabytes NVMe SSD
High speed storage for maximum performance

Specifications

	NVIDIA DGX H200
GPU	8x NVIDIA H200 Tensor Core GPUs, with 141GB of GPU memory each
GPU Memory	1,128GB tota
Performance	32 petaFLOPS FP8
NVIDIA NVSwitch™	4x
System Power Usage	10.2kW max
CPU	Dual Intel® Xeon® Platinum 8480C Processors 112 Cores total, 2.00 GHz (Base), 3.80 GHz (Max Boost)
System Memory	2TB
Networking	4x OSFP ports serving 8x single-port NVIDIA ConnectX-7 VPI - Up to 400Gb/s InfiniBand/Ethernet 2x dual-port QSFP112 NVIDIA ConnectX-7 VPI - Up to 400Gb/s InfiniBand/Ethernet
Management Network	10Gb/s onboard NIC with RJ45 100Gb/s ethernet NIC Host baseboard management controller (BMC) with RJ45
Storage	OS: 2x 1.92TB NVMe M.2 Internal storage: 8x 3.84TB NVMe U.2
Software	NVIDIA AI Enterprise: Optimized AI Software NVIDIA Base Command™: Orchestration, Scheduling, and Cluster Management DGX OS / Ubuntu / Red Hat Enterprise Linux / Rocky: Operating system
Support	Comes with 3-year business-standard hardware and software support
System Dimensions	Height: 14.0in (356mm) Width: 19.0in (482.2mm) Length: 35.3in (897.1mm)
Operating Temperature	5–30°C (41–86°F)

NVIDIA Base Command powers the DGX platform, enabling organizations to leverage the best of NVIDIA software innovation. Enterprises can unleash the full potential of their DGX infrastructure with a proven platform that includes enterprise-grade orchestration and cluster management, libraries that accelerate compute, storage, and network infrastructure, and an operating system optimized for AI workloads. Additionally, DGX infrastructure includes NVIDIA AI Enterprise, a suite of software optimized to streamline AI development and deployment.

NVIDIA DGX Enterprise Support and Services

Every NVIDIA DGX™ platform includes enterprise support for DGX infrastructure, NVIDIA AI Enterprise, and NVIDIA Base Command™ software, which includes hardened system software, optimized AI libraries, world-class cluster management, robust job scheduling, and workload orchestration. Get the most out of your NVIDIA DGX deployment and streamline AI experimentation with NVIDIA expertise and proven methodologies.

Read the Datasheet

Experience the Benefits

Ensure Continuity

Keep your DGX platform operating at peak performance with various levels of enterprise-grade support and a deep connection with the product and engineering.

Achieve Faster ROI

Get faster results with onboarding, optimization, training, and certification services for your employees.

Customize Your AI Journey

Get personalized instructions and guidance and proactive recommendations for your data science practice and data center operations.

AMD

Intel

Servers/JBODs

Seagate

Western Digital

AMD

Intel

Highlights

Public Test Drive

Customer Access

The cornerstone for your AI center of excellence