analisi EPG-101 (vlan-101 10.79.224.15) between two datacenter
25.01 2023 | by massimilianoanalisi EPG-101 (vlan-101) between two datacenter Architettura di riferimento Onboarding Parameters: Parameter Site 1 Site […]
https://www.ingegnerianetworking.com/wp-content/uploads/2023/01/epg101-e35.png
analisi EPG-101 (vlan-101) between two datacenter
Architettura di riferimento
Onboarding Parameters:
Parameter |
Site 1 |
Site 2 |
Orchestrator |
Site Name |
RZ |
CM |
NDO |
Site ID |
1 |
2 |
NDO |
BGP AS |
65124 |
65123 |
NDO |
BGP peering type |
Full-Mesh |
Full-Mesh |
NDO |
EVPN-RID Spine 201 (CP-ETEP) |
10.1.1.1/32 |
10.2.2.1/32 |
NDO |
EVPN-RID Spine 202 (CP-ETEP) |
10.1.1.3/32 |
10.2.2.3/32 |
NDO |
O-UTEP (overlay unicast) |
10.1.1.5/32 |
10.2.2.5/32 |
NDO |
O-MTEP (overlay multicast bum) |
10.1.1.7/32 |
10.2.2.7/32 |
NDO |
OSPF area id |
0.0.0.0 |
0.0.0.0 |
NDO |
OSPF interface type |
P2P |
P2P |
NDO |
External TEP Pool (per Intersite L3Out) |
10.1.1.128/25 |
10.2.2.128/25 |
NDO |
Primo Link DWDM IP Address |
172.16.0.0/31 |
172.16.0.1/31 |
NDO |
Secondo Link DWDM IP Address |
172.16.0.2/31 |
172.16.0.3/31 |
NDO |
From DataCenter RZ
leaf101# show system internal epm vlan all | grep 101
195 FD vlan 802.1Q 101 12592 205 194 15
leaf102# show system internal epm vlan all | grep 101
199 FD vlan 802.1Q 101 16592 143 198 18
leaf103# show system internal epm vlan all | grep 101
144 FD vlan 802.1Q 101 16592 132 143 33
leaf104# show system internal epm vlan all | grep 101
145 FD vlan 802.1Q 101 16592 125 144 33
NOTA: il Leaf 101 presenta un valore di vxlan encap differente.
leaf101# show vlan id 195 extended
VLAN Name Encap Ports
—- ——————————– —————- ————————
195 common:default:101 vlan-101 Eth1/7, Eth1/8, Eth1/11,
Eth1/12, Eth1/17,
Eth1/18, Eth1/32, Po1,
Po2, Po3, Po4
leaf102# show vlan id 199 extended
VLAN Name Encap Ports
—- ——————————– —————- ————————
199 common:default:101 vlan-101 Eth1/7, Eth1/8, Eth1/11,
Eth1/12, Eth1/17,
Eth1/18, Eth1/32,
Eth1/36, Po1, Po2, Po3,
Po4
leaf103# show vlan id 144 extended
VLAN Name Encap Ports
—- ——————————– —————- ————————
144 common:default:101 vlan-101 Eth1/9, Eth1/10,
Eth1/19, Eth1/21,
Eth1/22, Eth1/37,
Eth1/38, Po5, Po6
leaf104# show vlan id 145 extended
VLAN Name Encap Ports
—- ——————————– —————- ————————
145 common:default:101 vlan-101 Eth1/9, Eth1/10,
Eth1/21, Eth1/22,
Eth1/37, Eth1/38, Po2,
Po4
leaf101# show system internal epm endpoint ip 10.79.224.15
MAC : 0000.0000.0000 ::: Num IPs : 1
IP# 0 : 10.79.224.15 ::: IP# 0 flags : ::: l3-sw-hit: No
Vlan id : 0 ::: Vlan vnid : 0 ::: VRF name : common:default
BD vnid : 0 ::: VRF vnid : 3047424
Phy If : 0 ::: Tunnel If : 0x18010012
Interface : Tunnel18
Flags : 0x80004400 ::: sclass : 5481 ::: Ref count : 3
EP Create Timestamp : 12/27/2021 19:35:28.733079
EP Update Timestamp : 12/28/2021 15:22:05.085931
EP Flags : IP|sclass|timer|
::::
leaf101# show interface tunnel 18
Tunnel18 is up
MTU 9000 bytes, BW 0 Kbit
Transport protocol is in VRF “overlay-1”
Tunnel protocol/transport is ivxlan
Tunnel source 10.171.126.228/32 (lo0)
Tunnel destination 10.2.2.5/32
Last clearing of “show interface” counters never
Tx
0 packets output, 1 minute output rate 0 packets/sec
Rx
0 packets input, 1 minute input rate 0 packets/sec
leaf102# show system internal epm endpoint ip 10.79.224.15
MAC : 0000.0000.0000 ::: Num IPs : 1
IP# 0 : 10.79.224.15 ::: IP# 0 flags : ::: l3-sw-hit: No
Vlan id : 0 ::: Vlan vnid : 0 ::: VRF name : common:default
BD vnid : 0 ::: VRF vnid : 3047424
Phy If : 0 ::: Tunnel If : 0x18010029
Interface : Tunnel41
Flags : 0x80004400 ::: sclass : 5481 ::: Ref count : 3
EP Create Timestamp : 12/27/2021 19:35:28.733079
EP Update Timestamp : 12/28/2021 15:25:30.685550
EP Flags : IP|sclass|timer|
::::
leaf102# show system internal epm endpoint ip 10.79.224.15
MAC : 0000.0000.0000 ::: Num IPs : 1
IP# 0 : 10.79.224.15 ::: IP# 0 flags : ::: l3-sw-hit: No
Vlan id : 0 ::: Vlan vnid : 0 ::: VRF name : common:default
BD vnid : 0 ::: VRF vnid : 3047424
Phy If : 0 ::: Tunnel If : 0x18010029
Interface : Tunnel41
Flags : 0x80004400 ::: sclass : 5481 ::: Ref count : 3
EP Create Timestamp : 12/27/2021 19:35:28.733079
EP Update Timestamp : 12/28/2021 15:25:30.685550
EP Flags : IP|sclass|timer|
::::
leaf102# show interface tunnel 41
Tunnel41 is up
MTU 9000 bytes, BW 0 Kbit
Transport protocol is in VRF “overlay-1”
Tunnel protocol/transport is ivxlan
Tunnel source 10.171.126.227/32 (lo0)
Tunnel destination 10.2.2.5/32
Last clearing of “show interface” counters never
Tx
0 packets output, 1 minute output rate 0 packets/sec
Rx
0 packets input, 1 minute input rate 0 packets/sec
leaf103# show system internal epm endpoint ip 10.79.224.15
MAC : 0000.0000.0000 ::: Num IPs : 1
IP# 0 : 10.79.224.15 ::: IP# 0 flags : ::: l3-sw-hit: No
Vlan id : 0 ::: Vlan vnid : 0 ::: VRF name : common:default
BD vnid : 0 ::: VRF vnid : 3047424
Phy If : 0 ::: Tunnel If : 0x18010011
Interface : Tunnel17
Flags : 0x80004400 ::: sclass : 5481 ::: Ref count : 3
EP Create Timestamp : 12/28/2021 12:52:34.906173
EP Update Timestamp : 12/28/2021 15:25:40.654539
EP Flags : IP|sclass|timer|
::::
leaf103# show int tunnel 17
Tunnel17 is up
MTU 9000 bytes, BW 0 Kbit
Transport protocol is in VRF “overlay-1”
Tunnel protocol/transport is ivxlan
Tunnel source 10.171.126.225/32 (lo0)
Tunnel destination 10.2.2.5/32
Last clearing of “show interface” counters never
Tx
0 packets output, 1 minute output rate 0 packets/sec
Rx
0 packets input, 1 minute input rate 0 packets/sec
leaf104# show system internal epm endpoint ip 10.79.224.15
MAC : 0000.0000.0000 ::: Num IPs : 1
IP# 0 : 10.79.224.15 ::: IP# 0 flags : ::: l3-sw-hit: No
Vlan id : 0 ::: Vlan vnid : 0 ::: VRF name : common:default
BD vnid : 0 ::: VRF vnid : 3047424
Phy If : 0 ::: Tunnel If : 0x18010011
Interface : Tunnel17
Flags : 0x80004400 ::: sclass : 5481 ::: Ref count : 3
EP Create Timestamp : 12/28/2021 12:52:34.906173
EP Update Timestamp : 12/28/2021 15:25:44.369460
EP Flags : IP|sclass|timer|
::::
leaf104# show interface tunnel 17
Tunnel17 is up
MTU 9000 bytes, BW 0 Kbit
Transport protocol is in VRF “overlay-1”
Tunnel protocol/transport is ivxlan
Tunnel source 10.171.126.160/32 (lo0)
Tunnel destination 10.2.2.5/32
Last clearing of “show interface” counters never
Tx
0 packets output, 1 minute output rate 0 packets/sec
Rx
0 packets input, 1 minute input rate 0 packets/sec
FROM SPINE RZ:
spine202# show bgp l2vpn evpn 10.79.224.15 vrf all
Route Distinguisher: 1:16777199 (L2VNI 1)
BGP routing table entry for [2]:[0]:[15204288]:[48]:[0050.56b3.fd3e]:[32]:[10.79.224.15]/272, version 65136 dest ptr 0xae96801e
MSITE RD: 1:31981504 (L2VNI 15204288)
Local Route Distinguisher: 1:16777199 (L2VNI 1)
Paths: (1 available, best #1)
Flags: (0x00021a 0x00000a) on xmit-list, is in rib/evpn, is not in HW, is in l2rib msite shard, is in l2rib
Multipath: eBGP iBGP
Advertised path-id 1
Path type: external 0xc0000028 0x2a0040 ref 56506 adv path ref 1, path is valid, is best path, remote site path, is in l2rib, remote nh not installed
Imported from 1:48594900:[2]:[0]:[0]:[48]:[0050.56b3.fd3e]:[32]:[10.79.224.15]/144
AS-Path: 65123 , path sourced external to AS
10.2.2.5 (metric 5) from 10.2.2.3 (10.2.2.3) –> remote VTEP IP address
Origin IGP, MED not set, localpref 100, weight 0
Received label 15040468 2850816 à L2VNI
Received path-id 1
Extcommunity:
RT:65123:48594900
SOO:65123:50331631
COST:pre-bestpath:166:2684354560
ENCAP:8 à encapsulation VXLAN
Router MAC:0200.0000.0000
Path-id 1 not advertised to any peer
Route Distinguisher: 1:31981504 (L2VNI 15204288)
BGP routing table entry for [2]:[0]:[15204288]:[48]:[0050.56b3.fd3e]:[32]:[10.79.224.15]/272, version 65136 dest ptr 0xae96801e
MSITE RD: 1:31981504 (L2VNI 15204288)
Local Route Distinguisher: 1:16777199 (L2VNI 1)
Paths: (1 available, best #1)
Flags: (0x00021a 0x00000a) on xmit-list, is in rib/evpn, is not in HW, is in l2rib msite shard, is in l2rib
Multipath: eBGP iBGP
Advertised path-id 1
Path type: external 0xc0000028 0x2a0040 ref 56506 adv path ref 1, path is valid, is best path, remote site path, is in l2rib, remote nh not installed
Imported from 1:48594900:[2]:[0]:[0]:[48]:[0050.56b3.fd3e]:[32]:[10.79.224.15]/144
AS-Path: 65123 , path sourced external to AS
10.2.2.5 (metric 5) from 10.2.2.3 (10.2.2.3)
Origin IGP, MED not set, localpref 100, weight 0
Received label 15040468 2850816
Received path-id 1
Extcommunity:
RT:65123:48594900
SOO:65123:50331631
COST:pre-bestpath:166:2684354560
ENCAP:8
Router MAC:0200.0000.0000
Path-id 1 not advertised to any peer
Route Distinguisher: 1:48594900
BGP routing table entry for [2]:[0]:[0]:[48]:[0050.56b3.fd3e]:[32]:[10.79.224.15]/272, version 64431 dest ptr 0xae96e9fe
Paths: (1 available, best #1)
Flags: (0x000202 00000000) on xmit-list, is not in rib/evpn, is not in HW, is locked
Multipath: eBGP iBGP
Advertised path-id 1
Path type: external 0x40000028 0x82040 ref 1 adv path ref 1, path is valid, is best path, remote site path, remote nh not installed
AS-Path: 65123 , path sourced external to AS
10.2.2.5 (metric 5) from 10.2.2.3 (10.2.2.3)
Origin IGP, MED not set, localpref 100, weight 0
Received label 15040468 2850816
Received path-id 1
Extcommunity:
RT:65123:48594900
SOO:65123:50331631
COST:pre-bestpath:166:2684354560
ENCAP:8
Router MAC:0200.0000.0000
Path-id 1 not advertised to any peer
spine202# show bgp l2vpn evpn neighbors 10.2.2.3 routes vrf all | grep 0050.56b3.fd3e
Route Distinguisher: 1:16777199 (L2VNI 1)
*>e[2]:[0]:[15204288]:[48]:[0050.56b3.fd3e]:[0]:[0.0.0.0]/216
*>e[2]:[0]:[15204288]:[48]:[0050.56b3.fd3e]:[32]:[10.79.224.15]/272
Route Distinguisher: 1:31981504 (L2VNI 15204288)
*>e[2]:[0]:[15204288]:[48]:[0050.56b3.fd3e]:[0]:[0.0.0.0]/216
*>e[2]:[0]:[15204288]:[48]:[0050.56b3.fd3e]:[32]:[10.79.224.15]/272
Route Distinguisher: 1:48594900
*>e[2]:[0]:[0]:[48]:[0050.56b3.fd3e]:[0]:[0.0.0.0]/216
*>e[2]:[0]:[0]:[48]:[0050.56b3.fd3e]:[32]:[10.79.224.15]/272
FROM SPINE-CM:
spine202# show bgp l2vpn evpn 10.79.224.15 vrf all
Route Distinguisher: 1:16777199 (L2VNI 1)
BGP routing table entry for [2]:[0]:[15040468]:[48]:[0050.56b3.fd3e]:[32]:[10.79.224.15]/272, version 50011 dest ptr 0xae968af2
MSITE RD: 1:48594900 (L2VNI 15040468)
Local Route Distinguisher: 1:16777199 (L2VNI 1)
Paths: (1 available, best #1)
Flags: (0x00010a 00000000) on xmit-list, is not in rib/evpn
Multipath: eBGP iBGP
Advertised path-id 1
Path type: local 0x4000008c 0x0 ref 0 adv path ref 1, path is valid, is best path
AS-Path: NONE, path locally originated
0.0.0.0 (metric 0) from 0.0.0.0 (10.2.2.3)
Origin IGP, MED not set, localpref 100, weight 32768
Received label 15040468 2850816
Extcommunity:
RT:65123:16777216
Path-id 1 advertised to peers:
10.1.1.3
Route Distinguisher: 1:48594900 (L2VNI 15040468)
BGP routing table entry for [2]:[0]:[15040468]:[48]:[0050.56b3.fd3e]:[32]:[10.79.224.15]/272, version 50011 dest ptr 0xae968af2
MSITE RD: 1:48594900 (L2VNI 15040468)
Local Route Distinguisher: 1:16777199 (L2VNI 1)
Paths: (1 available, best #1)
Flags: (0x00010a 00000000) on xmit-list, is not in rib/evpn
Multipath: eBGP iBGP
Advertised path-id 1
Path type: local 0x4000008c 0x0 ref 0 adv path ref 1, path is valid, is best path
AS-Path: NONE, path locally originated
0.0.0.0 (metric 0) from 0.0.0.0 (10.2.2.3)
Origin IGP, MED not set, localpref 100, weight 32768
Received label 15040468 2850816
Extcommunity:
RT:65123:16777216
Path-id 1 advertised to peers:
10.1.1.3
spine202# show bgp l2vpn evpn neighbors 10.1.1.3 advertised-routes vrf all | grep 0050.56b3.fd3e
Route Distinguisher: 1:16777199 (L2VNI 1)
*>l[2]:[0]:[15040468]:[48]:[0050.56b3.fd3e]:[0]:[0.0.0.0]/216
*>l[2]:[0]:[15040468]:[48]:[0050.56b3.fd3e]:[32]:[10.79.224.15]/272
Route Distinguisher: 1:48594900 (L2VNI 15040468)
*>l[2]:[0]:[15040468]:[48]:[0050.56b3.fd3e]:[0]:[0.0.0.0]/216
*>l[2]:[0]:[15040468]:[48]:[0050.56b3.fd3e]:[32]:[10.79.224.15]/272
FROM LEAF CM:
leaf101# show system internal epm vlan all | grep 101
194 FD vlan 802.1Q 101 8892 118 193 17
leaf101# show system internal epm endpoint ip 10.79.224.15
MAC : 0050.56b3.fd3e ::: Num IPs : 1
IP# 0 : 10.79.224.15 ::: IP# 0 flags : ::: l3-sw-hit: No
Vlan id : 194 ::: Vlan vnid : 8892 ::: VRF name : common:default
BD vnid : 15040468 ::: VRF vnid : 2850816
Phy If : 0x16000004 ::: Tunnel If : 0
Interface : port-channel5
Flags : 0x80005c05 ::: sclass : 16387 ::: Ref count : 5
EP Create Timestamp : 12/27/2021 17:06:37.909965
EP Update Timestamp : 12/28/2021 16:48:13.362056
EP Flags : local|vPC|IP|MAC|host-tracked|sclass|timer|
::::
leaf101# show vlan id 194 extended
VLAN Name Encap Ports
—- ——————————– —————- ————————
194 common:default:101 vlan-101 Eth1/7, Eth1/8, Eth1/11,
Eth1/12, Eth1/39, Po5,
Po7, Po17
leaf102# show system internal epm vlan all | grep 101
190 FD vlan 802.1Q 101 8892 112 104 18
leaf102# show system internal epm endpoint ip 10.79.224.15
MAC : 0050.56b3.fd3e ::: Num IPs : 1
IP# 0 : 10.79.224.15 ::: IP# 0 flags : ::: l3-sw-hit: No
Vlan id : 190 ::: Vlan vnid : 8892 ::: VRF name : common:default
BD vnid : 15040468 ::: VRF vnid : 2850816
Phy If : 0x16000001 ::: Tunnel If : 0
Interface : port-channel2
Flags : 0x80005c05 ::: sclass : 16387 ::: Ref count : 5
EP Create Timestamp : 12/27/2021 17:06:37.909965
EP Update Timestamp : 12/28/2021 16:50:41.337964
EP Flags : local|vPC|IP|MAC|host-tracked|sclass|timer|
::::
leaf102# show vlan id 190 extended
VLAN Name Encap Ports
—- ——————————– —————- ————————
190 common:default:101 vlan-101 Eth1/7, Eth1/8, Eth1/11,
Eth1/12, Eth1/39, Po2,
Po5, Po17
leaf103# show system internal epm vlan all | grep 101
128 FD vlan 802.1Q 101 19892 38 127 42
leaf103# show system internal epm endpoint ip 10.79.224.15
MAC : 0000.0000.0000 ::: Num IPs : 1
IP# 0 : 10.79.224.15 ::: IP# 0 flags : ::: l3-sw-hit: No
Vlan id : 0 ::: Vlan vnid : 0 ::: VRF name : common:default
BD vnid : 0 ::: VRF vnid : 2850816
Phy If : 0 ::: Tunnel If : 0x18010001
Interface : Tunnel1
Flags : 0x80004400 ::: sclass : 16387 ::: Ref count : 3
EP Create Timestamp : 12/28/2021 12:42:37.395796
EP Update Timestamp : 12/28/2021 16:51:41.559891
EP Flags : IP|sclass|timer|
::::
leaf103# show vlan id 128 extended
VLAN Name Encap Ports
—- ——————————– —————- ————————
128 common:default:101 vlan-101 Eth1/5, Eth1/14,
Eth1/29, Eth1/30,
Eth1/31, Eth1/32,
Eth1/33, Eth1/34,
Eth1/35, Eth1/36,
Eth1/42, Po1, Po2, Po4
leaf104# show system internal epm vlan all | grep 101
18 FD vlan 802.1Q 101 19892 23 17 42
leaf104# show system internal epm endpoint ip 10.79.224.15
MAC : 0000.0000.0000 ::: Num IPs : 1
IP# 0 : 10.79.224.15 ::: IP# 0 flags : ::: l3-sw-hit: No
Vlan id : 0 ::: Vlan vnid : 0 ::: VRF name : common:default
BD vnid : 0 ::: VRF vnid : 2850816
Phy If : 0 ::: Tunnel If : 0x18010002
Interface : Tunnel2
Flags : 0x80004400 ::: sclass : 16387 ::: Ref count : 3
EP Create Timestamp : 12/28/2021 12:42:37.395796
EP Update Timestamp : 12/28/2021 16:51:41.559891
EP Flags : IP|sclass|timer|
::::
leaf104# show vlan id 18 extended
VLAN Name Encap Ports
—- ——————————– —————- ————————
18 common:default:101 vlan-101 Eth1/14, Eth1/29,
Eth1/30, Eth1/31,
Eth1/32, Eth1/33,
Eth1/34, Eth1/35,
Eth1/36, Eth1/42, Po2,