Data Sheet

PowerEdge Server GPU Matrix

Graphic Bus/ GPU

GPU Memory Memory Max Power Interconnect Slot Auxiliary
Brand Model System Height/ Workload1
Memory ECC Bandwidth Consumption Bandwidth Width Cable
Interface Length5

AMD Infinity
AMD MI300X OAM 192 GB HBM3 Y 5.3 TB/sec 750W 896 GB/sec N/A N/A N/A AI / HPC
Fabric Links

PCIe Gen4x16/ HPC/Machine

64 GB/sec
AMD MI210 64 GB HBM2e Y 1638 GB/sec 300W Infinity Fabric DW FHFL CPU 8 pin learning
(PCIe 4.0)
Link bridge8 training

32 GB/sec HHHL/ Inferencing/

Intel Flex 140 12 GB GDDR6 Y 336 GB/Sec 75W PCIe Gen4 x8 SW N/A
(PCIe 4.0) FHHL Edge

600GB/s
Nvidia H100 NVL 94 GB HBM3 Y 3.9 TB/s 350W- 400W PCIe Gen 5x16 DW FHFL PCIe 16 pin AI / HPC
( PCIe 5.0)

H200 SXM5 141GB

Nvidia Y 4.8 TB/s 700W NVIDIA NVLink 900 GB/sec N/A N/A N/A AI / HPC
(x8) HBM3e

H100 SXM5
Nvidia 80 GB HBM3 Y 3 TB/sec 700W NVIDIA NVLink 900 GB/sec N/A N/A N/A AI / HPC
(x8)

H100 SXM5
Nvidia 80 GB HBM3 Y 3 TB/sec 700W NVIDIA NVLink 900 GB/sec N/A N/A N/A AI / HPC
(x4)

64 GB/sec5 AI/
Nvidia L40S 48 GB GDDR6 Y 864 GB/sec 350W PCIe Gen4 x16 DW FHFL PCIe 16 pin Performance
(PCIe 4.0)
graphics/VDI

PCIe Gen4x16/ 64 GB/sec5

Nvidia A30 24 GB HBM2 Y 933 GB/sec 165W DW FHFL CPU 8 pin mainstream AI
NVLink bridge8 (PCIe 4.0)

64 GB/sec Performance
Nvidia L40 48 GB GDDR6 Y 864 GB/sec 300W PCIe Gen4 x16 DW FHFL PCIe 16 pin
(PCIe 4.0) graphics/VDI

PCIe Gen4x16/ 64 GB/sec5 Performance

Nvidia A40 48 GB GDDR6 Y 696 GB/sec 300W DW FHFL CPU 8 pin
NVLink bridge8 (PCIe 4.0) graphics/VDI

64 GB/sec
Nvidia A16 64 GB GDDR6 Y 800 GB/sec 250W PCIe Gen4 x16 DW FHFL CPU 8 pin VDI
(PCIe 4.0)

64 GB/sec Inferencing/
Nvidia L4 24 GB GDDR6 Y 300 GB/s 72W PCIe Gen4 x16 SW HHHL N/A
(PCIe 4.0) Edge/VDI

64 GB/sec Inferencing/
Nvidia L4 24 GB GDDR6 Y 300 GB/s 72W PCIe Gen4 x16 SW FHHL N/A
(PCIe 4.0) Edge/VDI

32 GB/sec Inferencing/
Nvidia A2 (v2) 16 GB GDDR6 Y 200 GB/sec 60W PCIe Gen4 x8 SW HHHL N/A
(PCIe 4.0) Edge/VDI

32 GB/sec Inferencing/
Nvidia A2 (v2) 16 GB GDDR6 Y 200 GB/sec 60W PCIe Gen4 x8 SW FHHL N/A
(PCIe 4.0) Edge/VDI

64 GB/sec mainstream
Nvidia A10 24 GB GDDR6 Y 600 GB/sec 150W PCIe Gen4 x16 SW FHFL PCIe 8 pin
(PCIe 4.0) graphics/VDI

32 GB/sec Inferencing/
Nvidia T4 16 GB GDDR6 Y 300 GB/sec 70W PCIe Gen3 x16 SW HHHL N/A
(PCIe 3.0) Edge/VDI

32 GB/sec Inferencing/
Nvidia T4 16 GB GDDR6 Y 300 GB/sec 70W PCIe Gen3 x16 SW FHHL N/A
(PCIe 3.0) Edge/VDI

PowerEdge Server GPU Matrix Data Sheet

© 2024 Dell Inc. or its subsidiaries.
 Brand Model Part Numbers Tied SKU2 Customer Kit SKU2

AMD MI300X OAM W9DCT 490-BJZD

AMD MI210 0RJ6Y/YJFV0/880VN 490-BHUU 490-BJYD 490-BHUT 490-BJYF

Intel Flex 140 P7M0V/DHG15 490-BIIQ 490-BIIM 490-BIIK 490-BIIO

Nvidia H100 NVL MM3MP 330-BCFX

Nvidia H200 SXM5 (x8) P1Y02 490-BKHF

Nvidia H100 SXM5 (x8) W2YC4 489-BBGD

Nvidia H100 SXM5 (x4) V0W6P 489-BBGJ

Nvidia L40S 7WK28 490-BJVT 490-BJVV

Nvidia A30 W3C1G/RV08M 490-BGUT 490-BGWJ 490-BGYE 490-BGUS 490-BHQK

Nvidia L40 VHNWT/20FCY 490-BJHP 490-BJHQ 490-BJHN

Nvidia A40 M9WT5/W6GX6 490-BGKG 490-BGSJ 490-BGKE

Nvidia A16 8F04V/D1P1T 490-BHER 490-BHET 490-BHES

Nvidia L4 V9XT2 490-BJRN 490-BJRR

Nvidia L4 NG3PY 490-BJRP 490-BJRQ

Nvidia A2 (v2) H98K0 490-BHVO 490-BHVQ

Nvidia A2 (v2) MG5JX 490-BHVR 490-BHVP

Nvidia A10 CGNVH/6KNWW 490-BGKF 490-BGLB 490-BGYD 490-BGKH

Nvidia T4 7PH29 490-BFHN 490-BFLB

Nvidia T4 HCKJM 490-BEYL 490-BEYM

17th Gen
15th Gen Server Support 16th Gen Server Support
Server Support
XR4520C

R760xd2

XR8620t

XR7620

XR5610
XE9680

XE9640

XE8640

R760xa

R760xs

C6620
R6525

R7525

R7625

R7615

R6625

R6615
XR12

XR11
R750

R650

R760

R660

R960

R360

R770

R670
T550

T560

T360
Brand Model

AMD MI300X OAM X X X X X X X X ✓ X X X X X X X X X X X X X X X X X X X X X

AMD MI210 X X X ✓ X X X X X X X ✓ X X X X ✓ ✓ X X X X X X X X X X X X
Intel Flex 140 ✓ ✓ X X X X ✓ ✓ X X X ✓ ✓ X X ✓ X X X X X X X X X X X X X X
Nvidia H100 NVL X X X X X X X X X X X ✓ X X X X X X X X X X X X X X X X X X
Nvidia H200 SXM5 (x8) X X X X X X X X ✓ X X X X X X X X X X X X X X X X X X X X X
Nvidia H100 SXM5 (x8) X X X X X X X X ✓ X X X X X X X X X X X X X X X X X X X X X
Nvidia H100 SXM5 (x4) X X X X X X X X X ✓ ✓ X X X X X X X X X X X X X X X X X X X
Nvidia L40S X X X X X X X X X X X ✓ ✓ X X X ✓ ✓ X X X X X X X X X X X X
Nvidia A30 ✓ X X ✓ ✓ ✓ ✓ X X X X ✓ ✓ X ✓ X ✓ ✓ X X X ✓ X X X X X X X X
Nvidia L40 ✓ X X ✓ X X X X X X X ✓ ✓ X X X ✓ ✓ X X X ✓ X X X X X X X X
Nvidia A40 ✓ X X ✓ ✓ X ✓ X X X X ✓ ✓ X X X ✓ ✓ X X X X X X X X X X X X
Nvidia A16 ✓ X X ✓ X X X X X X X ✓ ✓ X X X ✓ ✓ X X ✓ X X X X X X X X X
Nvidia L4 ✓ ✓ X ✓ X X ✓ ✓ X X X X X X X ✓ X X X X X X X X ✓ X X X ✓ ✓
Nvidia L4 ✓ ✓ X ✓ X ✓ ✓ ✓ X X X ✓ ✓ X ✓ ✓ ✓ ✓ ✓ ✓ X ✓ X ✓ ✓ ✓ X X X X
Nvidia A2 (v2) ✓ ✓ ✓ ✓ X X X ✓ X X X X X ✓ X ✓ X X X X X X ✓ X ✓ X X X X X
Nvidia A2 (v2) ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ X X X ✓ ✓ X ✓ ✓ ✓ ✓ ✓ ✓ X ✓ X X ✓ ✓ X ✓ X X
Nvidia A10 ✓ X X ✓ X X X X X X X X X X X X X X X X X X X X X X X X X X
Nvidia T4 ✓ ✓ ✓ ✓ X X X X X X X X X X X X X X X X X X X X X X X X X X
Nvidia T4 ✓ ✓ ✓ ✓ ✓ X ✓ ✓ X X X X X X X X X X X X X X X X X X X X X X

Server Compability Legend: ✓ = Supported | X = Not supported

2 | PowerEdge Server GPU Matrix Data Sheet

© 2024 Dell Inc. or its subsidiaries.
 NVIDIA

PLATFORM H200 H100 H100

H100 NVL SXM5 SXM5 SXM5 L40S L40 L4 A40 A30 A16 A10 A2 T4
(x8) (X8) (X4)

R770 Shipping (4)

R660 Shipping (2)

XE9680 Shipping Shipping

XE9640 Shipping

XE8640 Shipping

Shipping
R760xa Shipping (4) Shipping (43) Shipping (43) Shipping (83) Shipping (43) Shipping (43) Shipping (43)
(123)

R760 Shipping (2) Shipping (2) Shipping (4) Shipping (2) Shipping (2) Shipping (2) Shipping (6)

R760xs Shipping (2)

R760xd2 Shipping (2) Shipping (1) Shipping (2)

R660 Shipping (3) Shipping (2)

R7625 Shipping (2) Shipping (2) Shipping (4) Shipping (2) Shipping (2) Shipping (2) Shipping (6)

R7615 Shipping (3) Shipping (3) Shipping (4) Shipping (3) Shipping (3) Shipping (3) Shipping (6)

R6625 Shipping (3) Shipping (2)

R6615 Shipping (2) Shipping (2)

R960 Shipping (4)

T560 Shipping (2) Shipping (5) Shipping (2) Shipping (6)

R360 Shipping (1)

T360 Shipping (1)

C6620 Shipping (2)

XR7620 Shipping (5) Shipping (2) Shipping (5)

XR5610 Shipping (2) Shipping (2)

XR8620t Shipping (3)

R750 Shipping (2) Shipping (6) Shipping (2) Shipping (2) Shipping (2) Shipping (3) Shipping (6) Shipping (6)

R650 Shipping (3) Shipping (3) Shipping (3)

R7525 Shipping (3) Shipping (6) Shipping (3) Shipping (3) Shipping (3) Shipping (3) Shipping (6) Shipping (6)

R6525 Shipping (3) Shipping (3)

XR4520c Shipping (2) Shipping (1) Shipping (2)

XR12 Shipping (3) Shipping (2) Shipping (2) Shipping (2) Shipping (2)

XR11 Shipping (3) Shipping (2) Shipping (2)

(qty) - max number of GPUs allowed, maximum number of GPUs allowed might differ in different configurations on the same platform

3 | PowerEdge Server GPU Matrix Data Sheet

© 2024 Dell Inc. or its subsidiaries.
 AMD INTEL
PLATFORM
MI210 MI300X OAM (X8) Flex 140
R770

R660

XE9680 Shipping

XE9640

XE8640

R760xa Shipping (43) Shipping (103)*

R760 Shipping (6)*

R760xs

R760xd2

R660 Shipping (3)*

R7625 Shipping (2)

R7615 Shipping (3)

R6625

R6615

R960

T560

R360

T360

C6620

XR7620

XR5610

XR8620t

R750 Shipping (6)

R650 Shipping (2)

R7525 Shipping (3)

R6525

XR4520c

XR12 Shipping (2)

XR11 Shipping (3)

(qty) - max number of GPUs allowed, maximum number of GPUs allowed might differ in different configurations on the same platform

1. Suggested ideal workloads, but can be used for other workloads

2. Different SKUs are mentioned because different platforms might support different SKUs. This sheet doesn’t specifically call out platform-SKU associations
3. up to 600GB/sec for H100 when NVLink bridge is used, up to 200GB/sec for A30 when NVLink bridge is used, up to 112.5GB/sec for A40 when NVLink bridge is used, up to 300GB/sec for MI210
when Infinity Fabric Link bridge is used
4. A40 w/NVLink bridge is supported on R760xa, A30 w/NVLink bridge is supported on R760xa, MI210 w/Infinity Fabric Link bridge is supported on R760xa
5. DW - Double Wide, SW - Single Wide, FH- Full Height, FL - Full Length, HH - Half Height, HL - Half Length

* Currently available as Customer Install only

Learn more about Contact a Dell View more resources Join the conversation
Dell solutions Technologies Expert with #PowerEdge

© 2024 Dell Inc. or its subsidiaries. All Rights Reserved. Dell and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other trademarks may be trademarks of their
respective owners.