Brkens 2092
Brkens 2092
-
• What is BGP EVPN ?
• BGP EVPN in Enterprise Campus
Underlay and Overlay Networks
Agenda
•
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 2
Webex App
Questions?
Use the Webex app to chat with the speaker
after the session
How
1 Find this session in the Cisco Events mobile app
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 3
Catalyst 9000 Spine | Leaf | Border Hybrid Role - Spine + Leaf + Border Support BGP EVPN RT2 to RT5 re-originate
Catalyst 9000 Leaf | Border support
Support BGP EVPN Layer 2 Multi-home ESI support
Support Increased VNI Scale in 2X (512)
Overlay Type : Layer 2, Centralized Distributed AnyCast RP for TRM
Overlay Type : Layer 3 Overlay Gateway IPv4 ARP / IPv6 ND Suppression Catalyst 9500-H Custom SDM Template
IPv4/IPv4 host overlay Multicast with Default
Overlay Type : Distributed AnyCast for Distributed AnyCast Gateway, Layer 2 MDT, Fabric External Domain RP for large scale MAC/IP routes
Gateway Leaf Increased up to 500 Leaf scale per Fabric
L3/L3 Overlay Topologies : Full-mesh | Partial-
EVPN L2 Multi-homing with Cisco Mesh | Hub-n-Spoke | P2P Domain
IPv4 host in overlay
StackWise Virtual Optimized L2 Multicast with IGMP/MLD
Ingress Replication for BUM Per-VNI Multicast BUM Rate-Limiter
Central Switching Wireless support Snooping for Centralized Gateway
DHCPv4 Relay in EVPN VRF BGP EVPN PVLAN based Segmentation
Firewall integration for Service-Insertion IPv4 host overlay Multicast with Data MDT
Multicast DNS Service-Routing over BGP EVPN IPv6 host overlay Multicast with Data MDT
Border : Multi-VRF IPv4 Handoff IPv6 host in overlay
VXLAN
Border : L2 VLAN Handoff DHCPv4/v6 Relay in Default VRF Border : Multi-VRF IPv4 and IPv6 Data
Border Multi-VRF v4/v6 Multicast Handoff MDT to external Multicast Handoff
VXLAN Aware Flexible Netflow - IPv4 /
IPv6 Unicast/Multicast overlay Border : EVPN to VPLS IRB Interworking Border : EVPN IPv4 and IPv6 Data MDT to
Border : Multi-VRF IPv6 Handoff domain external Multicast Multicast VPN Handoff
Border : EVPN to MPLS VPNv4 Integration Border : EVPN to MPLS Multicast VPNv4 Border : EVPN to Global VN Extranet
Border : EVPN to MPLS VPNv6 Integration Integration support
Border : EVPN to VPLS Bridge Border : EVPN to Non-EVPN VN Extranet
Interworking support
16.9.1 16.12.1 17.3.1 17.6.1
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 4
Cisco Catalyst 9000
BGP EVPN VXLAN Fabric
Enterprise Healthcare Education Financial Public Sector Manufacturing Hospitality Media Transportation Retail
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 5
VXLAN Overview
Ethernet Frame
Classical
VNI
802.1Q
Outer Outer
UDP VXLAN DMAC SMAC Etype Payload
CRC 24 bits
MAC IP (new)
The VXLAN Network Identifier
4B
(VNI/VNID) is part of the
14B 20B 8B 8B 14B
VXLAN Header
MAC-in-UDP Encapsulation
20B + 8B +8B + 14B* = 50 Bytes
of total overhead
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 6
VXLAN with BGP EVPN
Control
Leaf EVPN MP-BGP - RFC 7432
Plane
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 7
BGP EVPN System Role Catalyst EVPN Scale and Performance Matrix
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 8
BGP-EVPN in
Campus
-
Enterprise Campus BGP EVPN Drivers
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 10
Enterprise BGP EVPN Reference Architecture
DC– EVPN DC – ACI WAN Shared-Services DMZ
APIC
ACI ACI ACI ACI
-
VXLAN Constructs
SVI
X
VLAN X
L2VNI
VLAN A VLAN B VLAN C
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 13
VXLAN Constructs
SVI
X
VLAN X
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 13
VXLAN Constructs
SVI
X
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 13
MP-BGP EVPN Route Type(s)
Type 1
RFC 7432
Ethernet Auto-Discovery (A-D) route
Route
Bridge
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 17
MAC/IP Advertisement route
Route-Type 2
Route MAC, IP L2VNI Layer-3 VNI NH Encap Seq
Type (“VRF”)
• Host “A” attaches to Edge Device (VTEP)
2 MAC_A, IP_A 30001 50001 IP_V1 8:VXLAN 0
• VTEP V1 advertises Host “A” reachability
information
• MAC and L2VNI [mandatory]
• IP and L3VNI [optional]
• depending on ARP
Host A Host B
MAC_A / IP_A MAC_B / IP_B
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 18
Protocol Learning & Distribution
“Subnet Route Advertisement (Route-Type 5)”
Route MAC, IP Layer-3 VNI NH Encap
Type (“VRF”)
Host A Host B
MAC_A / IP_A MAC_B / IP_B
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 20
Host Advertisement
RR RR
Host A
MAC: 0000.1111.1111 MAC Host IP VNI VTEP
IP: 192.168.10.10 0000.1111.1111 192.168.10.10 VNI-1 VTEP-1
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 22
Packet Walk – ARP Request
RR RR
172.168.1.1 172.168.1.2
VTEP-1 VTEP-2
VLAN10 VLAN10
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 23
Packet Walk – ARP Request
RR RR
172.168.1.1 172.168.1.2
VTEP-1 VTEP-2
VLAN10 VLAN10
Host A Host B
MAC: 0010.9400.1002 MAC: 0010.9400.1003
IP: 10.10.10.2 IP: 10.10.10.3
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 24
Overlay Leaf Configuration – BGP EVPN Control Plane
Spine-1 Spine-2
Intermediate
Leaf-1 Leaf-2
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 25
VNI Configuration
Spine Spine
1 2
Spine
RR RR
Intermediate
Leaf
VTEP VTEP
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 24
VNI Configuration
Spine Spine
1 2
Spine
RR RR
Intermediate
Leaf
VTEP VTEP
Vlan 10 Vlan 10
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 24
VNI Configuration
Leaf-1 Leaf-2
Vlan 10 Vlan 10
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 24
VNI Configuration
Leaf-1 Leaf-2
Vlan 10 Vlan 10
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 24
VNI Configuration
Leaf-1 Leaf-2
Vlan 10 Vlan 10
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 24
VNI Configuration
Leaf-1 Leaf-2
Vlan 10 Vlan 10
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 24
VNI Configuration
Leaf-1 Leaf-2
Vlan 10 Vlan 10
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 24
NVE Configuration
Spine Spine
1 2
Spine
RR RR
Leaf-1
Leaf-1
interface nve1
no ip address
interface nve1
Intermediate no ip address
source-interface Loopback0
host-reachability protocol bgp source-interface Loopback0
host-reachability protocol bgp
member vni 102102 vrf S1-EVPN
member vni 101000 ingress-replication member vni 102102 vrf S1-EVPN
member vni 101000 ingress-replication
Leaf
VTEP VTEP
Vlan 10 Vlan 10
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 33
Efficient Layer 2 Broadcast domain
Ingress Replication Multicast Replication
Source
No Multicast in Underlay
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 34
Underlay Network
-
Underlay Design Considerations
Routed Access StackWise-Virtual Layer 2 | Layer 3 Distribution
Spine Spine
Spine
Layer 3
Leaf Leaf
SVL
Layer 2
Layer 2
Leaf
Layer 2 Layer 3
Spine Spine
Leaf Leaf
Layer 2
Active Standby
RR RR
AF: L2VPN | mVPN
AF: L2VPN | mVPN
65001
65003
IPv4 | IPv6
65002
IPv4 | IPv6
65001 65001
IPv4 | IPv6
IPv4 | IPv6
EVPN
Leaf
802.1Q EVPN
IPv4 | IPv6
Leaf
IPv4 | IPv6
CAPWAP CAPWAP
Control and Data Control
WLC WLC
AP’s AP’s
-
Flexible Routing and Bridging Overlay Types
Layer 3 Overlay
VTEP-1 VTEP-2
Vlan 10 Vlan 20
• Layer 3 overlay network allows host devices in different Layer 2 networks to send Layer 3 or routed traffic to
each other
• The network forwards the routed traffic using a Layer 3 virtual network instance (VNI) and an IP VRF.
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 42
Flexible Routing and Bridging Overlay Types
Layer 2 only Overlay
Leaf
L2 Overlay
VTEP-1 VTEP-2
Vlan Vlan
10 10
• The same anycast gateway virtual IP address and MAC address are configured on all VTEPs.
• Flexible workload placement, host mobility, and optimal traffic forwarding across the BGP EVPN VXLAN fabric.
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 44
Flexible Routing and Bridging Overlay Types
Centralized Gateway
Spine
RR RR
Border/Leaf
L2 Overlay
Vlan
10
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 45
Flexible Routing and Bridging Overlay Types
Centralized Gateway Centralized Gateway
interface Vlan101
vrf forwarding green L2 Overlay
ip address 10.1.101.1 255.255.255.0
! Leaf
interface Vlan102
vrf forwarding green
VTEP-1 VTEP-2
ip address 10.1.102.1 255.255.255.0
interface nve1
no ip address
source-interface Loopback0
host-reachability protocol bgp
member vni 10101 ingress-replication
member vni 10102 ingress-replication
!
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 46
Proxy – Layer 2 without flooding
Routed Layer 2 Overlay
L3 Overlay
B 10.1.1.2/32 B 10.1.1.1/32
ip local-proxy-arp ip local-proxy-arp
Spine
Leaf-1-Spoke: Leaf-3-Spoke:
vrf definition S1-EVPN vrf definition S1-EVPN
rd 2:2 rd 4:4
! !
address-family ipv4 address-family ipv4
route-target import 100:65121 stitching Intermediate route-target import 100:65121stitching
route-target export 65121:100 stitching route-target export 5121:100 stitching
exit-address-family exit-address-family
Leaf-1 Leaf-2
Leaf-3
Vlan20 Leaf-4
Leaf-2-Spoke: Leaf-4-Spoke:
vrf definition S1-EVPN vrf definition S1-EVPN
rd 3:3 rd 5:5
! VTEP !
VTEP VTEP VTEP
address-family ipv4 address-family ipv4
route-target import 100:65121 stitching route-target import 100:65121 stitching
route-target export 5121:100 stitching route-target export 5121:100 stitching
exit-address-family exit-address-family
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 48
Overlay Topologies – Hub-n-Spoke
B 21.101.15.0/28
B 21.101.15.16/28
Border VRF-A
B 21.101.15.32/28
B 21.101.15.48/28
Spine
Intermediate
B* B*
0.0.0.0/0 VTEP
0.0.0.0/0
VTEP VTEP VTEP
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 49
Single Cluster Fabric Architecture
DC– EVPN DC – ACI WAN Shared-Services DMZ
APIC
ACI ACI ACI ACI
Shared Spine
Spine • Single fabric domain with shared Spine system
across all network block
• Direct or multi-hop away iBGP or eBGP L2VPN
peer support
• Flexible overlay IPv4/v6 ECMP multipath
support
Leaf
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 50
Non-Hierarchical Fabric Design
DC– EVPN DC – ACI WAN Shared-Services DMZ
APIC
ACI ACI ACI ACI
Leaf
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 51
Multi Cluster Fabric Architecture
DC – EVPN DC – ACI WAN Shared - Services DMZ
APIC
Leaf
Distributed Reduce fault-domain with distributed RR & RRC clusters for high scale fabric
Spine Structured fabric control-plane architecture between distributed Spine and Super-Spine
Optimized fabric and system scale, performance and resiliency
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 52
Scalable Multi Cluster Fabric Architecture
DC – EVPN DC – ACI WAN Shared - Services DMZ
APIC
Border Spine
Layer 3 Overlay VXLAN Tunnels Layer 3 Overlay VXLAN Tunnels Layer 3 Overlay VXLAN Tunnels
Layer 2 Overlay VXLAN Tunnels Layer 2 Overlay VXLAN Tunnels Layer 2 Overlay VXLAN Tunnels
Leaf
L2 L2 L2
L3
Increase fabric domain scale with hierarchical dynamic overlay VXLAN tunnels per fabric cluster
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 53
SITE-1
Leaf
ACI APIC
Spine
Multi-Site Fabric
SITE-2
Architecture
Spine
WAN
Internet
Leaf
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 54
SITE-1
ACI APIC
Leaf
Layer 3 Overlay VXLAN Tunnels
Spine
Leaf
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 55
Segmentation Macro-Segmentation Micro-Segmentation
Logical Local Grouping Extended Group with EVPN Policy-Plane enforced fabric
11
15 12
11
VRF
15 12
VRF VRF
14 13
14 13
21 51 21
51
55 52 25 22
VRF VRF VRF VRF
55 52 EVPN 25 22
EVPN
VLAN VRF
VXLAN
VRF 54 53
VXLAN GBP
24 23
54 53
VLAN
VRF
EVPN
VXLANVXLANGBP
VRF
24 23
45
44
41
VRF
43
42 35
31
VRF
34
32
33
41 31
45 42 35 32
VRF VRF
44 43 34 33
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 56
Micro Segmentation
10
Finance
20
VXLAN GBP
Engineering Fabric Edge/
Leaf
Ethernet Frame
Underlay Transport Encapsulation Overlay Unicast Payload
30
UDP IP
Building
MAC IPv4
D PO RT : 4789
VXLAN MAC v4 | v6
Payload FCS
Management
VXLAN GBP Header
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 0 1 2 3 4 5 6 7 8 9 0 0 1 2 3 4 5 6 7 8 9 0 1
G R R R I R R R R D R R A R R R Group Policy ID
Classification
Enforcement
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 57
Multicast over VXLAN
-
Layer 3 Overlay Layer 3 Overlay
Distributed Anycast RP Fabric Border RP
RP
Border
SVL
Spine Spine
mVPN mVPN
65001 65001
RP RP RP RP RP RP
Leaf Leaf
IP
VRF RP IP MDT
Blue Anycast Lo1: 10.1.1.101 239.1.1.101
Yellow Anycast Lo2: 10.2.1.101 239.2.1.101
Green Anycast Lo3: 10.3.1.101 239.3.1.101
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 60
TRM Default MDT
Border
🗑 🗑 🗑 🗑
DROP DROP DROP DROP
Leaf
Challenges
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 62
TRM Data MDT
Border 🗑 🗑 🗑 🗑 vrf definition S1-EVPN
DROP DROP DROP DROP
rd 10:10
!
address-family ipv4
mdt auto-discovery vxlan inter-as
mdt default vxlan 239.1.1.1
EVPN TRM
mdt data vxlan 239.1.2.0 0.0.0.255 → MDT Data
Multicast Network
mdt data threshold 1
mdt overlay use-bgp spt-only
🗑 🗑 🗑 🗑
DROP DROP DROP DROP
Key Benefits
Leaf
Stateful L2 Multicast Overlay network
Industry-standard based control-plane
Applicable to Centralized Gateway or Cross-Connect
Overlay networks
Source Source Receiver Receiver
239.101.1.1 239.101.1.2 239.101.1.1 239.101.1.1 Scale. Performance. Security.
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 63
EVPN Fabric
Interworking
-
Layer – 2 Handoffs Options
L2 VLAN Handoff VPLS Handoff EVPN Fabric
Terminate Bridge Domain Interworking Bridge Domain Multi-Site L2 Extension
PE
EV PN
L2 L2
VPLS
L2 Border GW
Border
Border GW
Spine Spine
Leaf Leaf
L2 L2 L2
Multiple end-to-end seamless Layer 2 extensions supports across fabric and beyond
Seamless Terminate L2 overlays and perform simple Layer 2 trunk handoff to non-fabric devices, i.e., Firewalls
Layer 2
Handoff Integrated EVPN Border and VPLS PE function to extend multi-domain L2 for seamless migrations
Extendable Layer 2 EVPN domains with highly scalable Catalyst and Nexus 9000 Multisite Border Gateway
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 65
Layer – 3 Handoffs Options
IP VRF Handoff MPLS VPN Handoff EVPN Fabric
Terminating Routing Domain Interworking Overlay Domain Re-originating Fabric Domain
MPLS EVPN
L2 L2 L2 L3
L3 L3 L3
Border
Spine
Leaf
L3 L3 L3
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 66
Fabric Deployment
Options
-
Cisco Enterprise BGP EVPN Solution
Intent
EV PN
Infrastructure
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 68
Feature + Solution
BGP EVPN Automation – Ansible & Terraform
playbooks Inputs processing validation
EVPN Terraform Provider
Playbooks
S
❑ underlay ❑ inventory.yml S
❑ overlay ❑ group/all.yml H
❑ hosts/<node>.yml Modules Templates Preview
❑ access Commit
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 69
Q1CY25
Choose SD-Access
Your Fabric Control-Plane
Zero-Trust Workplace (LISP or BGP EVPN)
IBN based
workflows
Automation
Single Data-Plane
Vxlan
SD-Access for Assurance
Zero Trust
Macro/Micro
Segmentation
LAN Automation
DIY
Build your Underlay
DNAC Template
Programmable CLI
Editor
-
SDA with EVPN: BGP underlay is not supported BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 75
Leaf-Group Leaf-Group
s
Leaf Group
Leaf-Group Leaf-Group
3 4
Border
Spine Group
Spine
Border-Group Border-Group
1 2
Leaf s
Border Group
Border-Group Border-Group
3 4
Fabric Groups
Border Spine
Leaf
TECENS-2680 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 73
-
73
SD-Access with BGP EVPN: Overlay Topologies
Layer 3 Overlays Distributed Anycast Gateway
Spine Spine
Group Group
Leaf Leaf
Group Group
Leaf Group-1 Leaf Group-2 Leaf Group Leaf Group-1 Leaf Group-2 Leaf Group
-
TECENS-2680 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 74
SD-Access with BGP EVPN: TRM & Border Handoff
Tenant Routed Multicast Border Handoff BGP
Spine Spine
Spine Border
Group orGroup
Border
Group
Leaf Leaf
Group Group
R R R R R R
P P P P P P
Leaf Group-1 Leaf Group-2 Leaf Group-1 Leaf Group-2 Leaf Group-1 Leaf Group-2 Leaf Group-1 Leaf Group-2
Leaf Group-1 Leaf Group-2
-
TECENS-2680 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 75
SD-Access with BGP EVPN: Wireless
Deployments
Spine
Spine group
group
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 76
SD-Access with BGP EVPN: Assurance
Cisco Catalyst Center
Device Mgmt | 360 0. | Topology | Fabric Infrastructure | Fabric Site Connectivity | Base Automation | Network Profiles | SWIM
VNI Status
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 77
Webex App
Questions?
Use the Webex app to chat with the speaker
after the session
How
1 Find this session in the Cisco Events mobile app
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 78
Fill Out Your Session Surveys
Content Catalog
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 79
• Visit the Cisco Showcase
for related demos
-
BRKENS-2092 © 2025 Cisco and/or its affiliates. All rights reserved. Cisco Public 80
Thank you
-
-