NETWORK PLANNING DCI-EVPN/VXLAN Config guideline

VR configuration guide for ENUO-AD DCI implementation

Document Control

Date Author Version Remark

18-Aug-22 Tayzar Lwin 0.09 Draft
5-Sep-22 Tayzar Lwin 1.0.0 Final
7-Sep-22 Tayzar Lwin 1.0.1 Updated on type5 route config on
SLG
9-Sep-22 Tayzar Lwin 1.0.2 Add AS planning

Contents
Contents..................................................................................................1
1 Acronyms.........................................................................................2
1.1 AS planning.................................................................................................................................2
2 EVPN/VXLAN Network Topology.........................................................3
2.1 Physical Topology........................................................................................................................3
2.2 Device type and roles use in DCI network..................................................................................3
2.3 Logical Topology..........................................................................................................................4
3 General configuration guide..............................................................5
3.1 IRB interfaces and VLAN.............................................................................................................5
3.2 switch-options.............................................................................................................................5
3.3 ESI and LACP configuration guide...............................................................................................5
3.4 RE protection for DCI routers......................................................................................................5
4 Routing-instances configuration templates.........................................6
4.1 BGN#-VR-CV configuration template......................................................................................6
4.2 SLG#-VR-CV configuration template.......................................................................................7
4.3 SLG#-VR-LB and BSG##-VR-LB configuration template..........................................................7
4.4 BSG#-VR-VXGW configuration template...................................................................................8

Sensitive and Confidential Page 1

 NETWORK PLANNING DCI-EVPN/VXLAN Config guideline

Purpose
There are many Leaf devices to be deployed in ENUO-AD datacenter as part of our
next generation DCI (EVPN/VXLAN). Those devices must have same parameters in
some parts of the configuration and this document is the guide to those parameters.

1 Acronyms
Short name Equipment type /Description
PoD Point of delivery
BNG Border Leaf Northbound Gateway
SLG Server Leaf Gateway
BSG Border Leaf Southbound Gateway
VR-CV Virtual routing and forwarding instance for CV
VR-LB Virtual routing and forwarding instance for Load balancers
VR-VXGW Virtual routing and forwarding instance for VXLAN Server

1.1 AS planning
AS Number Routers/VRF Service
65500 DCI Overlay IBGP for EVPN
65501 DCR1, DCR2 DCI core router
65502 VR-CV CV Anycast Gateway
65503 VR-LB LB Anycast Gateway
65504 VR-VXGW VXSVR Anycast Gateway
65505 VR-STG STG Anycast Gateway
65506 VR-DB DB Anycast Gateway
65510 SPINE1, SPINE2 Used for Overlay, AS is
configured at group level

65520 BNG1, SLG1, BSG1, etc.. All Leaf, used for Overlay
and AS is configured at
group level

Sensitive and Confidential Page 2

 NETWORK PLANNING DCI-EVPN/VXLAN Config guideline
2 EVPN/VXLAN Network Topology

2.1 Physical Topology

2.2 Device type and roles use in DCI network

No. Device Type Type of services used Remarks

1 MX10008 DCI Core, AGG, PBR Chassis type, DCI core will be
run on chassis

2 QFX5220-128C Lean spine, RR No end devices connect to spines

3 QFX5120-32C Leaf, VRF

4 S5850-32S2Q 10G TOR Switch

5 S3900-24T4S 1G TOR Switch for control Network edge

Sensitive and Confidential Page 3

 NETWORK PLANNING DCI-EVPN/VXLAN Config guideline
2.3 Logical Topology

 Spine1 is RR1 and Spine2 is RR2 for iBGP topology

 Same cluster ID for RR1 and RR2
 For all DCI routers and switches, autonomous system number, 65500 is configured under
routing-option section
 “advertise-peer-as” need to configure on DCR and SPINES Underlay BGP group
 “family inet unicast loops 1” need to configure on LEAFs Underlay BGP group
 “multipath multiple-as” need to configure on every Underlay BGP group
 Each “local-as” is configured at Underlay bgp group respectively

Sensitive and Confidential Page 4

 NETWORK PLANNING DCI-EVPN/VXLAN Config guideline
3 General configuration guide
3.1 IRB interfaces and VLAN
 l3-interface for each VLAN is irb.$vlan-id (e.g. irb.24 is for vlan 24)
 family inet address is ‘x.x.x.[2-9]’ (e.g. 172.17.87.2/24 for first VR-CV)
 virtual-gateway-address is the same for each vlan/l3-interface, it will be the first IP address
in most cases.
 Must configure “virtual-gateway-accept-data”
 Virtual-gateay-v4-mac format is “fe:dc:00:00:$vlan_id-in-last-two-octets”, (e.g,
‘fe:dc:00:00:00:24’ is for vlan 24, ‘fe:dc:00:00:10:01’ is for vlan 1001, etc. )
 VNI for each VLAN is “500000+vlan_id”

3.2 switch-options
 vtep-source-interface lo0.0
 route-distinguisher $loopback-IP:24

3.3 ESI and LACP configuration guide

 ESI value is configured manually, and it must be the same values for the first 8 bytes with
changes only in the 9th and 10th bytes on a per-EVPN LAG basis as per Juniper
recommendation. So, 9th byte will be ae number and 10th byte will be incremented across the
EVPN domain
ʃ Datacenter ID ʅ
 Format = 00:01:28:86:91:20:00:00:$ae-number:01

Integer conversion of DCI loopback IP subnet network ID, 172.18.200.0

The first ESI for our system with ae1 will be ‘00:01:28:86:91:20:00:00:01:01’

 ESI will be all-active

 lacp system-id = last 6 bytes in ESI number (e.g. ‘91:20:00:00:01:01’ in above ESI)
 lacp active

3.4 RE protection for DCI routers

 There will be RE protection profile for DCI routers and VRF as data plane routing path is on
VRF of DCI routers.

4 Routing-instances configuration templates

Sensitive and Confidential Page 5

 NETWORK PLANNING DCI-EVPN/VXLAN Config guideline
4.1 BGN#-VR-CV configuration template

set routing-instances VR-CV instance-type mac-vrf

set routing-instances VR-CV service-type vlan-aware
set routing-instances VR-CV interface irb.24
set routing-instances VR-CV interface irb.42
set routing-instances VR-CV interface irb.43
set routing-instances VR-CV interface irb.44
set routing-instances VR-CV interface lo0.1
set routing-instances VR-CV route-distinguisher $VRF-loopback-IP:42
set routing-instances VR-CV vrf-target target:1:42
set routing-instances VR-CV vrf-target auto

#Static route to client subnets is on BGN only

# Need to add all the required static route for ENUO-AD deployment
set routing-instances VR-CV routing-options static route 10.x.x.x/15 next-hop x.x.x.x
set routing-instances VR-CV routing-options autonomous-system 65502

# Multipath load-balancing to PBR

set routing-instances VR-CV routing-options multipath

#Type 5 route
set routing-instances VR-CV protocols evpn encapsulation vxlan
set routing-instances VR-CV protocols evpn default-gateway no-gateway-community
set routing-instances VR-CV protocols evpn extended-vni-list all
set routing-instances VR-CV protocols evpn ip-prefix-routes advertise direct-nexthop
set routing-instances VR-CV protocols evpn ip-prefix-routes encapsulation vxlan
set routing-instances VRF_CV protocols evpn ip-prefix-routes vni 510042

Sensitive and Confidential Page 6

 NETWORK PLANNING DCI-EVPN/VXLAN Config guideline
4.2 SLG#-VR-CV configuration template

set routing-instances VR-CV instance-type mac-vrf

set routing-instances VR-CV service-type vlan-aware
set routing-instances VR-CV interface irb.24
set routing-instances VR-CV interface irb.42
set routing-instances VR-CV interface irb.43
set routing-instances VR-CV interface irb.44
set routing-instances VR-CV interface lo0.1
set routing-instances VR-CV route-distinguisher $VRF-loopback-IP:42
set routing-instances VR-CV vrf-target target:1:42
set routing-instances VR-CV vrf-target auto
set routing-instances VR-CV routing-options autonomous-system 65502

#Type 5 route
set routing-instances VR-CV protocols evpn encapsulation vxlan
set routing-instances VR-CV protocols evpn default-gateway no-gateway-community
set routing-instances VR-CV protocols evpn extended-vni-list all
set routing-instances VR-CV protocols evpn ip-prefix-routes advertise direct-nexthop
set routing-instances VR-CV protocols evpn ip-prefix-routes encapsulation vxlan
set routing-instances VRF_CV protocols evpn ip-prefix-routes vni 510042

4.3 SLG#-VR-LB and BSG##-VR-LB configuration template

set routing-instances VR-LB instance-type mac-vrf
set routing-instances VR-LB service-type vlan-aware
set routing-instances VR-LB interface irb.492
set routing-instances VR-LB interface lo0.2
set routing-instances VR-LB route-distinguisher $VRF-loopback-IP:492
set routing-instances VR-LB vrf-target target:1:492
set routing-instances VR-LB vrf-target auto
set routing-instances VR-CV routing-options autonomous-system 65503

Sensitive and Confidential Page 7

 NETWORK PLANNING DCI-EVPN/VXLAN Config guideline
4.4 BSG#-VR-VXGW configuration template

set routing-instances VR-VXGW routing-options autonomous-system 65504

set routing-instances VR-VXGW routing-options multipath
set routing-instances VR-VXGW instance-type vrf
set routing-instances VR-VXGW interface irb.509
set routing-instances VR-VXGW interface irb.510
set routing-instances VR-VXGW interface irb.511
set routing-instances VR-VXGW interface lo0.3
set routing-instances VR-VXGW route-distinguisher 172.18.200.12:509
set routing-instances VR-VXGW vrf-target target:1:509

#Type 5 route on VR-VXGW is not necessary for now. It’s for future growth

set routing-instances VR-VXGW protocols evpn ip-prefix-routes advertise direct-nexthop

set routing-instances VR-VXGW protocols evpn ip-prefix-routes encapsulation vxlan
set routing-instances VR-VXGW protocols evpn ip-prefix-routes vni 510509
set routing-instances VR-CV protocols evpn encapsulation vxlan
set routing-instances VR-CV protocols evpn default-gateway no-gateway-community
set routing-instances VR-CV protocols evpn extended-vni-list all

Sensitive and Confidential Page 8