PowerEdge MX IO Guide
PowerEdge MX IO Guide
The content in this guide applies to all versions of PowerEdge MX up to and including 2.10.00
Example Topologies
Additional Resources
A B
A B
E Fabric Slot A1
E F
Fabric Slot A2
Scalable Networking Storage Networking
• Two redundant • Redundant, highly
general-purpose available
fabrics • 32G Fibre Channel or
12G SAS storage
• MX Scalable Fabric fabric
Architecture for multi- E Fabric Slot B1
chassis networking
Fabric Slot B2
• Future forward design
F Fabric Slot C1 Fabric Slot C2
High-performance, scalable 25G fabric switch 16 x 25GbE internal ports 2 x 100GbE/32Gb FC QSFP28 Uplink Ports
1GbE and 10G-BaseT are DAC-Q28DD-2Q28-100G-xM DAC-Q28DD-8S28-25G-xM DAC-Q28-4S28-25G-xM Q28-128GFC-SW4 (4x32GFC Optic)*
supported via the QSA28 OR OR OR AND
adapter AOC-Q28DD-2Q-40G-7M AOC-Q28DD-8S28-25G-xM AOC-Q28-4S28-25G-xM CBL-MPO12-4LC-OM4-xM
OR OR OR
Q28DD-80G/200G-2SR4 (Optic) Q28DD-80G/200G-2SR4 (Optic) Q28-100G-SR4-NOF (Optic)
AND AND AND
CBL-MPO12DD-2MPO12-OM4-xM Corning Edge8 Cabling CBL-MPO12-4LC-OM4-xM
NOTE: Not every option is presented on this page. Please contact your account team for additional options
17 Copyright 2022 Dell Inc
Connecting to Non-Dell 10GbE or 25GbE uplink ports
For example: Cisco, Arista, Juniper
A port group is a logical descriptor given to one or more physical ports that
supports one or more logical configurations.
Port Group 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16
17 19 21 23 25 27 29 31 33 35 37 39
Physical Ports 18 20 22 24 26 28 30 32 34 36 38 40
41 42 43 44
210-ANZJ 210-ANZI Dell MX5108n 25GbE Ethernet Switch, 4x10G-BaseT, 1x40GbE QSFP+, 2x100GbE QSFP28
470-ABOG 470-ABPE Dell Networking Cable, MPO to 4xLC, Fiber Breakout Cable, MMF, OM4, Optics Required, 3M
470-ABOH 470-ABPG Dell Networking Cable, MPO to 4xLC, Fiber Breakout Cable, MMF, OM4, Optics Required, 5M
470-ABOI 470-ABPK Dell Networking Cable, MPO to 4xLC, Fiber Breakout Cable, MMF, OM4, Optics Required, 7M
• Use the table below to ensure that the correct cable/optic is being used
Description Type Primary Speed Port Type 2x100G 100G 2x40G 40G 8x25G 4x25G 8x10G 4X10G
40G DAC DAC 40G QSFP+ X X
100G DAC DAC 100G QSFP28 X X X X
4x25G breakout DAC DAC 100G QSFP28 X X
8x25G breakout DAC DAC 100G QSFP28-DD X X
2x100G QSFP28-DD DAC DAC 100G QSFP28-DD X X X X X X X X
40G AOC or Transceiver Optical 40G QSFP+ X X
100G AOC or Transceiver Optical 100G QSFP28 X X
2x100G/2x40G QSFP28-DD Transceiver Optical 100G QSFP28-DD X X X X X X X X
2x100G QSFP28-DD AOC or Transceiver Optical 100G QSFP28-DD X X X X
2x40G QSFP-DD AOC or Transceiver Optical 40G QSFP28-DD X X X X
The QSA28 Adapter is a QSFP form factor carrier that allows a SFP, SFP+,
or SFP28 optic/cable to be inserted into a QSFP+, QSFP28, or QSFP28-DD
port. This provides the ability to support a single 1G, 10G, or 25G cable/optic
27 Copyright
Copyright 2022
2022 Dell
Dell Inc
Inc
PowerEdge MX Ethernet Pass-through Modules
25GbE Pass-through Module 10G-BaseT Pass-though Module
16 x 25GbE internal ports 16 x 25GbE internal ports
DAC-SFP28-25G-xM DAC-SFP-10G-xM
OR OR
AOC-SFP28-25G-xM DAC-SFP28-25G-xM*
OR OR
SFP28-25G-SR-NOF AOC-SFP-10G-xM
AND OR
CBL-LC-OM4-xM SFP-10G-SR
AND
CBL-LC-OM4-xM
16/32GFC (LWL)
210-AOCK 210-AOCJ Dell MXG610S switch, includes 16 activated ports & 4x FC32 SFP+ SWL optics
210-AOCM 210-AOCL Dell MXG610S switch, includes 16 activated ports & 8x FC32 SFP+ SWL optics, Enterprise Bundle
528-BFOE 528-BFOS Dell MXG610S ENT Feature License Bundle (Trunking, Extended Fabric, and Fabric Vision)
16 ports licensed = 8 servers & up to 8 external uplinks (any combination of SFP+ & QSFP ports)*
24 ports licensed = 8 servers & all 16 external uplinks
NOTE: If you need the enterprise bundle, purchase the SKU with the license included (210-AOCM). Do not
purchase a different SKU and then add the stand-alone ENT license bundle
NOTE: As of April 13th, 2023, Brocade software licenses are delivered digitally
• Mixing MX9116n and MX7116n within the same fabric *IS* allowed
• No mixing of Ethernet switch and Pass-Through Modules within the same fabric on
MX7000
– For example, MX9116n in A1 and 25G PTM in A2 is not allowed
For the comprehensive table of recommended slot configurations for IOMs, see Appendix A in the
Dell OpenManage Enterprise-Modular Edition Version 2.10.00 for PowerEdge MX7000 Chassis User's
Guide
36 Copyright
Copyright 2022
2022 Dell
Dell Inc
Inc
100GbE solution
External Fabric Switching Engine and
IOM Fabric Expander Module
Connection to MX8116n
DAC-Q56DD-400G-xM DAC-Q28DD-100G-xM DAC-Q56DD-400G-xM ACC-Q56DD-4Q28-100G-xM
OR OR OR
ACC-Q56DD-400G-xM AOC-Q28DD-100G-xM DAC-Q28DD-2Q28-100G-xM
OR OR OR
AOC-Q56DD-400G-xM Q28DD-80G/200G-2SR4 (Optic) Q28DD-80G/200G-2SR4 (Optic)
OR AND AND
Q56DD-400G-SR4.2 (Optic) CBL-MPO12DD-OM4-xM CBL-MPO12DD-OM4-xM
AND
CBL-MPO12DD-OM4-xM Port mode 4x25GbE Port mode 8x25GbE Port mode 1x100GbE
Port mode 4x100GbE
NOTE: Not every option is presented on this page. Please contact your account team for additional options
41 Copyright 2022 Dell Inc
IOM Placement Rules for Fabrics A & B
• Single MX8116n in a fabric *IS* allowed
• No mixing of MX8116n and MX9116n/MX7116n within the same fabric on MX7000
• No mixing of Ethernet switch and Pass-Through Modules within the same fabric on
MX7000
– For example, MX8116n in A1 and 25G PTM in A2 is not allowed
For the comprehensive table of recommended slot configurations for IOMs, see Appendix A in the
Dell OpenManage Enterprise-Modular Edition Version 2.10.00 for PowerEdge MX7000 Chassis User's
Guide
42 Copyright
Copyright 2022
2022 Dell
Dell Inc
Inc
Cables for QSFP56-DD ports-MX 100G Solution
FI SKU APOS SKU Description
470-ADYO 470-ADYS Dell Networking Cable, 400GbE Q56DD Passive Copper Direct Attach Cable, 0.5 Meter
470-ADXJ 470-ADYU Dell Networking Cable, 400GbE Q56DD Passive Direct Attach Cable, No FEC, 1 Meter
470-ADYV 470-ADYT Dell Networking Cable, 400GbE Q56DD Passive Copper Direct Attach Cable, 2 Meter
470-AEDO 470-AEDD Dell Networking Cable, 400GbE QSFP56-DD to QSFP56-DD, Active Copper Cable, 3 Meter
470-AEDH 470-AEDG Dell Networking Cable, 400GbE QSFP56-DD to QSFP56-DD, Active Copper Cable, 5 Meter
470-AEDI 470-AEDJ Dell Networking Cable, 400GbE QSFP56-DD to QSFP56-DD, Active Copper Cable, 7 Meter
470-BBGB 470-BBGC Dell Networking Cable 400GbE QSFP56-DD to QSFP56-DD Active Optical Cable 10Meter,G2
470-BBGF 470-BBGG Dell Networking Cable 400GbE QSFP56-DD to QSFP56-DD Active Optical Cable 15Meter,G2
470-BBGH 470-BBGD Dell Networking Cable 400GbE QSFP56-DD to QSFP56-DD Active Optical Cable 30Meter,G2
NOTE: For the complete list of supported cables & optics, refer to the Interop matrix on the Sales Portal
43
QSFP56-DD Breakout Cables
FI SKU APOS SKU Description
470-AFPF 470-AFPH Dell Networking Cable 400GbE Breakout, QSFP56-DD to 4xQSFP56 Depop SFF DAC 3 Meter
470-AEDM 470-AEDF Dell Networking Cable, 400GbE QSFP56-DD to 4xQSFP28 100GbE, Active Copper Cable, Breakout, 3 Meter
470-AEDE 470-AEDL Dell Networking Cable, 400GbE QSFP56-DD to 4xQSFP28 100GbE, Active Copper Cable, Breakout,5 Meter
44
100GbE Ethernet SKUs
Ethernet I/O Modules
Factory SKU After Sale SKU Description
210-BFBJ 210-BFBI Dell Networking MX8116n 100GbE Fabric Expander Module
…
Chassis 10:
Slot A1: MX7116n
NOTE: If a Scalable Fabric has some chassis with
Slot A2: MX7116n Quad Port NICs and some with only Dual Port
NICs, only the chassis with Quad Port NICs
require the second FEM port to be connected
…
require the second FEM
port to be connected
Chassis Connection Order support QSFP28 and QSFP+ Optics and cables
In order to provide optimal performance through the MX9116n FSE, it is recommended to connect the
FEMs to the FSE in the following order:
Port Group 1 2 3 4 5 6 7 8 9 10 11 12
1&2 4 6 8 10 3 5 7 9
Connect FEM
from Chassis 6 to QSFP28-DD ports not used for FEM connections can be
Port-Group 3 utilized for additional uplinks, connections to rack servers, or
VLT connections (VLT is required for SmartFabric Services)
in both Full Switch and SmartFabric mode.
55
PowerEdge MX networking with Embedded Top of Rack switching
Single Chassis,
Dual Fabric,
Separate networks
Dual Fabric,
Single MX8116n per Fabric
Separate networks,
Single Z9432F-ON
Multi Chassis,
Dual Fabric,
Separate networks
Additionally, the cable/optic type used will vary depending on the length required
Cable DAC AOC Optic2 Fiber
Description Connector
Option (very short) (short-medium) (medium-long) (Requires Optic)
CBL-MPO12DD-OM4-xM or
1 FSE/FEM Connection QSFP28-DD DAC-Q28DD-200G-xM AOC-Q28DD-200G-xM Q28DD-80G/200G-2SR4
Corning Edge8 Structured Cabling
5 Breakout 8x25GbE QSFP28-DD DAC-Q28DD-8S28-25G-xM AOC-Q28DD-8S28-25G-xM Q28DD-80G/200G-2SR4 Corning Edge8 Structured Cabling
6 Breakout 8x10GbE QSFP28-DD DAC-Q28DD-8S28-25G-xM AOC-QDD-8SFP-10G-xM Q28DD-80G/200G-2SR4 Corning Edge8 Structured Cabling
1 – The QSFP-64GFC-SW4 (4x16GFC Optic) is EoL as of 15 October 2020. Use Q28-128GFC-SW4 (4x32GFC Optic) instead.
2 – SR4 transceivers support distances up to 150M over OM4 fiber. The MX7000 management modules use 1G BASE-T cables with a distance limit of 100M, therefore the effective useable length for a SR4 optic
is 100M over OM4 fiber
Cable Option 1
Fabric A Populated
Cable Option 1
Fabric A & B Populated
Chassis 1 & 2
Cable Option 1
Cable Option 1
NOTE: The diagram does
not show the VLTi
connections required in
SmartFabric mode and
Chassis 3-10 recommended in Full switch
mode. Connect VLTi Cables
between MX9116n FSEs on
Port 37 and 39.
Upstream Switches
FC Switches
FC Array
ToR Switches
ToR Switches
Cat 6A Copper
Cable Option 3
ToR Switches
*Pass-Through to Dell Networking switches only. Non-Dell switches are not supported
76 Copyright 2022 Dell Inc
Example Topologies
Scalable Fabric Wiring Diagram – 2 Chassis with Quad Port NICs
Cable Option 1
Fabric A Populated
Cable Option 1
Fabric A & B Populated
Chassis 1 & 2
Cable Option 1
83 Copyright
Copyright 2022
2022 Dell
Dell Inc
Inc
Note the difference in the MPO-12/MPO-12DD
QSFP28-DD in Depth diagram below, this shows two rows of 4 strands of
transmit on a Q28DD-200G-2SR4 optic (each row of
• Q28DD-200G-2SR4 optics require the use 8 strands operates as its own QSFP28-100G-SR4
of 16-strand MPO cables. They will not link).
function with MPO-12 cables used with MPO-12 Cables
Q28-100G-SR4 optics.
– These cables can be described “MPO-12 Two Row”
or “MPO-12DD” cables. Red = Tx
Green = Rx MPO-12DD Cables
• Dell stocks MPO-12DD cables in lengths of
1,3,5, and 7 Meters.
• Implementations where Q28DD-200G-
2SR4 optics are to be used with cable
lengths expected to exceed 7 meters,
please use Corning MPO-12DD cables.
These cables are sourced with the “MPO-
12 Two row” or “MPO-12DD” form factor.
84 Copyright
Copyright 2022
2022 Dell
Dell Inc
Inc
QSFP28-DD Breakout Cables
Structured Cabling
• Dell has partnered with Corning Structured Cabling Solutions to provide an easy to customize structured
cabling solution
– Standard Dell ProDeploy and ProDeploy+ services do not include installation for Corning Structured Cabling Solutions.
Contact your account team for options for a custom installation contract if needed
• This solution provides rack housings from 1U to 4U allowing for multiple cassette types in each enclosure.
The system has cassettes to do the following:
– QSFP breakout to 4xLC (MPO12 to 4xLC)
– QSFP to QSFP extension (MPO12 to MPO12)
– QSFP-DD to 2xQSFP28 (MPO12-DD to 2xMPO12)
– QSFP-DD to 8xLC (MPO12-DD to two 4xLC cartridges)
– QSFP-DD to QSFP-DD extension (MPO12-DD to MPO12-DD)
Q28DD-200G-2SR4
3 3 Q28DD-200G-2SR4
1 2 1
Rack 1 Rack 2
1 2
4
Rack 1 Rack 2
Rack 1
4 5
Rack 2
Dell Networking MX9116n Spec Sheet Dell Networking MX9116n Spec Sheet https://www.dell.com/learn/product_docs/dellemcnetworkingmx9116nspecsheet.pdf
Dell Networking MX7116n Spec Sheet Dell Networking MX7116n Spec Sheet https://www.dell.com/learn/product_docs/dellemcnetworkingmx7116nspecsheet.pdf
Dell Networking MX8116n Spec Sheet Dell Networking MX8116n Spec Sheet https://www.delltechnologies.com/asset/en-us/products/networking/technical-
support/dell-networking-mx8116n-spec-sheet.pdf
Dell Networking MX5108n Spec Sheet Dell Networking MX5108n Spec Sheet https://www.dell.com/learn/product_docs/dellemcnetworkingmx5108nspecsheet.pdf
Dell Networking MXG610s Spec Sheet Dell Networking MXG610s Spec Sheet https://www.dell.com/learn/product_docs/dellemcnetworkingmxg610sspecsheet.pdf
https://www.dell.com/learn/shared-content~data-sheets~en/documents~dell-
Dell Networking Optics Spec Sheet Dell Networking Optics Spec Sheet
networking-optics-spec-sheet.pdf
Dell eLabs Networking Switch Support Matrix for Current support matrix of Dell Networking Ethernet https://elabnavigator.emc.com/vault/pdf/Dell_EMC_Networking_Switch.pdf?key=15234
Storage switches and Dell Storage platforms 28507371
Sept 26, 2018 1.1.2 Corrected FC Gateway Topology, Fixed headers, updated cable images, corrected NPAR support for Intel NICs
Updated PTM image, Added additional cables & optics to 25G PTM, Scalable Fabric design for Dual Fabrics, Clarified supported 40G optics, updated Mellanox NIC information,
October 25, 2018 1.2 added Additional Resources section, information on connecting to Cisco switches, unsupported topologies for Scalable Fabric and SmartFabric services
Clarified items on the switch Quick Reference page, added IOM slot matrix, corrected SKU numbers, updated Dell EMC 4x32G FC optic to reflect support
January, 2019 1.3
for 4x 8G FC, corrected description of MXG610s on QRG page, updated list of white papers
Clarified cables/optics for VLTi on MX5108, updated NPAR support on NIC QRG, corrected SKU numbers, updated resources and whitepaper links,
May, 2019 1.4
updated MX7116n QRG, Updated Layout/Template
Updated multiple slides to add new cables/optics supported with OS10.5.0, Added Slide for MX7116n FEM as Pass-Through Module, Updated & Added
September, 2019 1.5
whitepaper links, Added information about Corning Edge8 Structured Cabling
March, 2020 1.6 Updated Brocade SKUs, Minor other corrections, updated broken links
Clarified MXG610s QRG, Updated Edge8 ProDeploy policy, clarified number of NPAR partitions for Marvell NICs, updated max supported VLANs for
June 2020 1.7
switches, updated MX7116n breakout options for 10G Support
Added content for Broadcom 57504 quad port NICs, Added content for new Scalable Fabric topologies, Added example topology for direct attached FC,
August 2020 1.8
corrected broken links, additional information on QSFP28-DD cables, minor updates and corrections
October 2020 1.9 Updated FC Mezz QRG, Adjusted to account for EOL of QSFP-64GFC-SW4
Added cable configuration for QSFP to QSFP FC optic connection, updated multiple Scalable Fabric and example topology slides, added cable/speed compatibility slide, added
April 2021 1.10 C&O FAQ and C&O spec sheet link to resources section, Updated DD optic references to Q28DD-80G/200G-2SR4 Dual-Rate optic
December 2021 1.11 Added new MSA types, updated brocade license SKUs, updated switch P*V limits, Updated Topologies, minor updates and corrections
August 2022 1.13 Updated MXG610 Licensing and SKUs, Notes and Link for MX Chassis Management Module Cabling
April 2023 1.14 Updated content with 100GbE MX8116n and Z9432F-ON solution
99