Dell EMC SmartFabric OS10 - Virtual Link Trunking
Dell EMC SmartFabric OS10 - Virtual Link Trunking
Trunking
Reference Architecture Guide
H18362.2
Abstract
This reference architecture guide provides an overview of Virtual Link Trunking (VLT)
and best practices for VLT deployment within the Dell EMC SmartFabric OS10 operating
system.
November 2021
Notes, cautions, and warnings
NOTE: A NOTE indicates important information that helps you make better use of your product.
CAUTION: A CAUTION indicates either potential damage to hardware or loss of data and tells you how to avoid
the problem.
WARNING: A WARNING indicates a potential for property damage, personal injury, or death.
© 2021 Dell Inc. or its subsidiaries. All rights reserved. Dell, EMC, and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other
trademarks may be trademarks of their respective owners.
Contents
Chapter 1: Introduction................................................................................................................. 4
Dell Technologies vision..................................................................................................................................................... 4
Typographical conventions................................................................................................................................................4
Appendix A: References............................................................................................................... 18
Dell Technologies Networking Guides...........................................................................................................................18
Support and feedback.......................................................................................................................................................18
Terminology......................................................................................................................................................................... 18
Contents 3
1
Introduction
In the last two decades, applications have evolved from single monoliths to the highly distributed microservices model. The
scale of the traffic supported in a modern-day infrastructure is huge. All new applications demand a greater network bandwidth,
and the interconnect speeds are increasing at a rapid pace. To provide non-stop services, modern data centers require high
availability (HA) designs for providing non-stop services. The HA concept should be followed in both software and hardware
designs.
For software design, the software should communicate and synchronize data with the connected Top-of-Rack (ToR) or leaf
switch. This way, if one of the switches goes down, either due to planned maintenance or outage, the other switch will take
over. For hardware design, hosts with two NICs should be dual-attached with one link to two leaf switches in a port-channel.
Dell Technology calls this protocol Virtual Link Trunking or VLT. In this protocol, the end host functions as if it were connected
to a single switch with a bond.
VLT enables networks with high availability and resiliency. VLT has been deployed at various locations, and customers are
satisfied with its seamless functionality for the traffic flow and their business needs.
This document explains the dual-node VLT deployment strategies with its associated network reference architecture with
an emphasis on best practices and references for network scenarios. This document also covers the configuration and
troubleshooting of VLT using relevant show commands and different outputs.
NOTE: This guide might contain language that is inconsistent with the current guidelines for Dell Technologies content. Dell
Technologies plans to update the guide over subsequent future releases to revise the language accordingly.
Typographical conventions
Monospace text CLI examples
Underlined monospace text CLI examples that wrap the page, or to highlight information in CLI output
Italic monospace text Variables in CLI examples
Bold text UI fields and information that is entered in the UI
4 Introduction
2
Virtual Link Trunking Overview
With the mandatory need for high availability in modern data centers and enterprise networks, VLT plays a vital role with rapid
convergence, seamless traffic flow, efficient load balancing, and loop-free mechanics.
VLT configured in the Dell EMC SmartFabric OS10 operating system functions by aggregating two identical physical switches to
form one single logical switch.
Two switches appear as a single switch on the network with all the links in VLT that can carry traffic across many physically
diverse topologies. Implementing VLT enables multiple parallel paths between nodes without loops and includes traffic load
balancing when alternate paths exist. The outcome is high availability and high resilience for connected access, core switches,
and clients during switch firmware upgrades. If a link fails, traffic continues to flow with minimal disruption.
VLT provides the following benefits:
● Provides node-level redundancy and load sharing by using the same port-channel terminating on multiple upstream nodes.
● Provides a loop-free topology.
● Eliminates STP-blocked ports.
● Optimizes bandwidth utilization by using all available uplink bandwidth.
● Guarantees fast convergence if either a link or device fails.
● Enhances optimized forwarding with Virtual Router Redundancy Protocol (VRRP).
● Optimizes routing with VLT peer routing for Layer 3 VLANs.
● Enables Layer 3 routing protocol support in VLT LAGs with scaled Layer 3 VLAN support.
● Provides link-level resiliency.
● Assures high availability without taking the network offline during firmware upgrades.
VLT operation
Both the VLT nodes of a domain always continue to forward data plane traffic in active/active mode. With the instantaneous
synchronization of MAC and ARP entries, both the nodes remain active/active and continue to forward the data traffic
seamlessly.
The VLT implementation in Dell EMC SmartFabric OS10 has been modified for optimal operation based on the internal
architecture and the base operating system.
VLT architecture
The VLT-Fabric Manager (VLT- FM) module implements the core VLT protocol functionalities and VLT fabric orchestration.
Other modules in the system use the services of VLT-FM to achieve the complete VLT solution.
The VLT fabric consists of two nodes providing a logical single switch view to the connected devices. However, each of the
VLT peers maintains separate control and data planes and can be configured individually for a port, protocol, and management
behaviors.
The VLT design architecture is based on the VLT fabric manager process, controlling the VLT neighbor, and overall fabric
orchestration. The protocol used to communicate between VLT peers is defined as VLT Control Protocol (VLT-CP). The
Node Discovery Service module, or NDS, handles the topology discovery and management. On receiving the topology update
message, VLT-FM builds raw topology and initiates a loop-prevention algorithm to construct the overlay topology.
The VLT application elects the primary node that is based on the lower MAC address; however, with the primary-priority
command, the node with the least primary priority becomes the primary node. This election is not preempted, which means that
the primary role does not change until the nodes are rebooted or the VLT process is restarted whenever there is a change in
priority.
A VLT interconnect (VLTi) synchronizes states between VLT peers. Dell EMC SmartFabric OS10 automatically adds VLTi ports
to VLANs spanned across VLT peers, but does not add VLTi ports to VLANs configured on only one peer.
The primary node election's priority is based on the lower system mac-address of the switch; however, with the primary-
priority command, the VLT node with the least configured priority takes over as the primary node. This election will not be
preempted. If the primary node is reloaded, it is assigned the secondary role. The role change avoids disruptions in traffic flow
due to the election process.
The election happens only during the initial configuration or when VLT is initially launched. The VLT role election has no
significance for the data traffic flowing through the VLT domain. It is only for the control protocol exchange and handles
potential split-control failure scenarios.
VLAN ID 4094 is assigned automatically and internally reserved as a control VLAN to exchange VLT-related information between
the nodes. The IPv6 address that is automatically assigned within the reserved range is mapped for VLAN 4094 for reachability
between the VLT nodes.
For the VLT interconnect (VLTi) link, once the discovery interfaces are configured on both nodes, port-channel 1000 is
automatically configured, mapping the physical discovery interfaces. The ports should be configured as no switchport from the
default Layer 2 mode while configuring the discovery interfaces.
Every thirty seconds, heartbeat messages are sent between the VLT nodes to check the liveliness of the peers and to handle
the VLTi failure scenario. The heartbeat interval value is configurable and reaches the peer through the backup destination.
Similarly, keep-alive messages (non-configurable) are sent through the VLTi port-channel.
For VLT port-channels, the user should explicitly assign the vlt-port-channel id to the configured port-channel on both of the
nodes. This port-channel identifier should be the same for both of the nodes.
Important points to remember:
● VLT port-channel interfaces must be switch ports.
● Dell EMC strongly recommends that the VLTi (VLT interconnect) be a static LAG and that you disable LACP on the VLTi.
● If you include RSTP/PVST, and it must be configured before VLT is configured.
● VLT Heartbeat is supported only on default VRFs.
● If you enable IGMP snooping on the VLT peers, ensure the value of the delay-restore command is not less than the
query interval.
In this sample configuration, the 1/1/1 and 1/1/2 interfaces form the discovery interface/VLTi (Po-1000) on the VLT Peer1.
Similarly, the 1/1/1 and 1/1/2 interfaces form the discovery interface on VLT Peer2. The VLT backup destination is mapped to
the remote peer's management IP address. Port-channel 1 is configured on both VLT nodes as interface 1/1/10 and 1/1/11. VLAN
101-110 is mapped to port-channel 1.
The configurations for VLT-Peer1 and VLT-Peer2 are the same except for the back-up destination IP address. The sample
configuration for VLT-Peer1 is as follows:
For Multiple Spanning Tree Protocol (MSTP) on VLT nodes, configure both VLT peer nodes in the same MST region to avoid
network loops. Ensure that the VLAN-to-instance mappings, region name, and revision ID are the same on both VLT peer nodes.
VRRP in VLT
With VRRP configured in both of the VLT nodes, the active/active mode is internally enabled by default, ensuring seamless
traffic flow. The active/active mode is activated when the VLT VLANs are configured with a VRRP group. For practical
purposes, VRRP offers a single virtual IP as a default gateway for its access clients.
VRRP should be enabled on host-facing VLANs. The gateway for the hosts should be the virtual IP of the respective VRRP
group. Since VRRP establishes an active/active mode in VLT, the VLT nodes route traffic from the hosts.
Peer routing
VLT peer routing enables optimized routing where packets destined for the Layer 3 endpoint of the VLT peer are locally routed.
VLT supports unicast routing of both IPv4 and IPv6 traffic.
To enable VLT unicast routing, both VLT peers must be in Layer 3 mode. The VLAN configuration must be symmetrical on both
peers. Users cannot configure the same VLAN as Layer 2 on the first node and as Layer 3 on the other node.
IPv4 routing provides forwarding of packets to a destination IP address, based on a routing table. This routing table defines how
packets are routed (dynamically, broadcasted directly, or using proxy ARP), and what type of information is included with the
packets.
Peer routing is not restricted to a VLAN with routing protocols. Instead, it is enabled domain wide. Peer routing ensures active/
active routing for the traffic path. To route traffic on behalf of other VLT peers, enable peer routing on both nodes. Peer routing
synchronizes the router MAC address (local destination MAC address) within the VLT domain and ensures seamless routing by
the peer node.
Upstream devices from the VLT domains can have static routing, or any other dynamic routing protocols, to support the N-S
traffic. The host can still be reached if the traffic to the VM host lands at any upstream DC, ensuring high availability for the
application and services.
OS10(config)# vlt-domain 1
OS10(conf-vlt-1)# backup destination 10.16.151.110 vrf management interval 20
OS10#configure terminal
OS10(config)#interface ethernet 1/1/1
OS10(conf-if-eth1/1/1)vlt delay-restore orphan-port enable
OS10(conf-if-eth1/1/1)exit
OS10(conf)vlt-domain 1
OS10(conf-vlt-1)delay-restore 150
Terminology
VLT domain - The domain includes VLT peer devices, VLT interconnects, and all port-channels in the VLT connected to the
attached devices. It is also the configuration mode that you must use to assign VLT global parameters.
VLT interconnect (VLTi) - The link between VLT peer switches used to synchronize operating states.
VLT peer device - A pair of devices connected using a dedicated port-channel—the VLTi. You must configure VLT peers
separately.
Discovery interface - Interfaces on VLT peers in the VLT interconnect (VLTi) link.
VLT MAC address - Unique MAC address that you assign to the VLT domain. A VLT MAC address is a common address in both
VLT peers. If you do not configure a VLT MAC address, the primary peer's MAC address is used as the VLT MAC address across
both peers.
VLT node priority - The priority based on which the primary and secondary VLT nodes are determined. If priority is not
configured, the VLT node with the lowest MAC address is elected as the primary VLT node.
VLT port-channel - A combined port-channel between an attached device and the VLT peer switch.
18 References