Building and operating VXLAN BGP EVPN Fabrics with … MDS 9148S 9706 Scalable Capacity Virtualization & Cloud CapEx & OpEx Efficiencies Agility Security UNIFIED FABRIC Consistency

Building and operating VXLAN BGP EVPN Fabrics with Data Center Network Manager

Henrique Molina, Technical Marketing Engineer

Matthias Wessendorf, Technical Marketing Engineer

LTRDCT-2781

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Cisco Spark

Questions? Use Cisco Spark to communicate with the speaker after the session

1. Find this session in the Cisco Live Mobile App

2. Click “Join the Discussion”

3. Install Spark or go directly to the space

4. Enter messages/questions in the space

How

cs.co/ciscolivebot#LTRDCT-2781


If Clouds come to earth they are fog….”

LTRDCT-2781 4


Cloud == FOG??

LTRDCT-2781 5


The Cloud –

??

LTRDCT-2781 6


The Cloud –“Oh yes, We have a Button for That.”

??

LTRDCT-2781 7


So but it makes Sense to look under the Hood

LTRDCT-2781 8

• Introduction

• Programmable Fabric Overview

• Infrastructure Fabric

• Fabric Management

• Lab Setup

Agenda

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco PublicLTRDCT-2781 10

LAN / SANSAN

Cisco Data Center Switching Portfolio

Cisco Nexus 9000

Cisco Nexus 7000

Cisco Nexus 6000

Cisco Nexus 5600

Cisco Nexus 5500

CiscoNexus 3000

CiscoNexus 2000

Cisco MDS 9500

Cisco MDS 9222i

Cisco MDS 9148

Cisco MDS 9710

Cisco MDS 48x16G line-

rate FC Module

Cisco MDS 9250i

Cisco MDS 48x10G line-rate

FCoE Module

Cisco MDS 9706

Cisco MDS 9148S

Scalable Capacity

Virtualization & Cloud

CapEx & OpExEfficiencies

Agility

Security

UNIFIED

FABRIC

Consistency across physical, virtual,

and cloud environments.

STP based “Tiered” Design VPC based “Tiered” Design FabricPath Design

Data Center Network EvolutionJourney to Cisco SDN

2 or more

Spines

Leaf

Classis STP Limitation

50% of all Links not utilized

Complex to Harden

No STP Blocked Ports

Full Links Utilization

Faster Convergence

Macro for “best practice”

No STP

Simple to Configure

Higher Fabric Bandwidth

Consistent Latency

SpineScales to provide fabric bandwidth

LeafScales to provide access port density

Workload Mobility

Increased App Communication

Higher Server Port Density and Bandwidth


Programmable Fabric / VxLAN EVPN

Management

Infrastructure

• Automation of Underlay and Overlay

• Integration with Orchestrators and

Hypervisor Managers

• Physical and Virtual Switching

• Topology Virtualization

• DataCenter Interconnect

Programmability• Ready for DevOps

• Ease of Operations

LTRDCT-2781 12

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 13LTRDCT-2781

Programmable Fabric

Discover Fabric Topology

Image & Config Repository

Monitor Fabric

Common Point of Access

Open APIs

Switch# show vlan

Vlan

--------------------

DCNM

NX-API Rest API

Configuration Management

Consistent Fabric across Nexus 2k, 5k, 7k and 9k

FEX

Open BGP-EVPN VXLAN Fabric

Physical

VM

OS

VM

OS

Virtual Border Leaf

Infrastructure Domain

Administrators

vCenter

DevOps Operations /

Programmability

& Automation

VxLAN-EVPN Fabric

Configure Overlays (Physical and Virtual)

DCI/WAN

InfrastructureFabric


Programmable Fabric Attributes

VM Mobility

VLAN Extensibility

Any Subnet Anywhere

ANY

Distributed

Anycast GW

Distributed MP-

BGP Control Plane

Smaller failure domains

Multi-tenant Horizontal Scale

Minimize Bottlenecks

Simplified Networking with Flexibility and Efficiency at Scale


Programmable Fabric AttributesRapid Deployment of VM and Network

1Network Admin

defines Network Profile

Template for VMs/PMs

in projects

2Instances of Network Policies

are automatically created in

VTS (or DCNM) when a Server

Admin provisions VMs/PMs

3When a VM/PM pertaining to

a project is detected,

Network Policy is applied to

the leaf

4When VM moves, the Network

Policy is applied automatically

to the leaf

Subnet

QoS

Security

Policy-based

routing

Network

Profile

Server

Profiles

Network

Admin

Server

Admin


VXLAN Fabric With BGP-EVPN Control Plane

BGP Peers

Available across the Nexus Portfolio

Optimized MobilityIncreased Scale

Standards BasedFlexibility

VTEP VTEP VTEP VTEP VTEP

Route

Reflector

BGP-EVPN VXLAN Overlay

Route

Reflector


MP-BGP Scalable Multi-tenancy

EVPN Address Family: host MAC+IP, internal/external IP subnets

MP-BGP enhanced for fast convergence at large scale (100K+ routes)

Mobility extensions to BGP

Distributed GWY with Traffic Flow Symmetry

ARP Suppression

Route-Reflectors deployed for scaling purposes

iBGP Adjacencies

MP-BGP for VXLAN EVPN Control PlaneEVPN Control Plane – Overlay with optimized routing

VTEP VTEP VTEP VTEP VTEP

Route

Reflector

BGP-EVPN VXLAN Overlay

Route

Reflector

Route

Reflector

LTRDCT-2781 18

Fabric ManagementData Center Network Manager


Centralized - Database

• Tight integration with provisioning/management

• Limited scale

Fabric Management Strategy

Controller

ProvisioningOverlay CP

Controller

Provisioning

Overlay CP

OpenFlow OVSDB BGP/LISP

OpFlex, OVSDB.

NefConf-YANG

Distributed – Network Protocol

• Loose integration with provisioning/management

• Global Scale

LTRDCT-2781 20


Product Introduction


DCNM 10, What is It?

• Underlay/Overlay manager for VXLAN-

EVPN based IP Fabrics in NX-OS Mode

• Provisioning & Management of

FabricPath, STP/VPC networks

• Classic ‘FCAPs’ LAN manager

• SAN management for Nexus and MDS

platforms

• Flow Controller for IP Media Solutions

• Vertical market for Broadcast media

LTRDCT-2781 23

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco PublicLTRDCT-2781

DCNM Functional Areas

VXLAN- EVPN Programmable Fabric

Nexus 9K-7K-5K-3K-2K-1K

Day 0, Day 1, Day 2

LAN-Classic Management

Nexus 9K-7K-5K-3K-2K-1K

Professional Media Net

[PMN/Nexus 9K]

SAN

[MDS & Nexus]

DCNM 10

ok

24


DCNM 10: Functionality Dashboard

IP Media Net

ControllerVisualization and

TroubleshootingAlert/

Notifications

Host/Endpoint

Monitoring

Trend Analysis

and VM Analytics

Storage

Management

Configuration Automation

• VXLAN & Classic

• Image Management

• Backup / Restore

• Templates

• VXLAN & Classic

• Underlay (POAP)

• Overlay (VRF/VNI)

• REST APIs

• Discovery

• CPU/Mem/Temp

• Traffic

• Health-Monitor

• Link View

• VM-connectivity

• VM Lifecycle

• Network Location

• Fabric-Wide View

• Port Consumption

• VM Net Trace

• Monitor Graphs

• Trap & Syslog

• Events & Forwarding• Integrated Topology

• Search

• VXLAN-OAM

• Classic FC/FCOE

• SAN Analytics

• Digital Media Flow

Contol

• Endpoint Topology View

Inventory & Health

25LTRDCT-2781

Current Release


DCNM 10.2.x/10.3.x Recent Updates

Policy (Micro)

Templates

Simplified VXLAN

Overlay provisioning

Endpoint

Locator

VLAN

Editing

FEX Provisioning

IP Media

Controller

Updates

Network

Config Audit

Show Templates for

Customized Op’s

VXLAN Ingress-

Replication

LTRDCT-2781 27


DCNM 10.4.x Updates

External Fabric

Connectivity Provisioning

Software Telemetry

(Preview)

REST-APIs

for Fabric

Deployment

Brownfield

Migration

for EVPN

Enhanced

Installer Options

EVPN Multi-Site

Provisioning

VMM

Integration

(Preview)

LTRDCT-2781 28

DCNM for New or Existing Fabrics


Leveraging DCNM for New and Existing Fabrics

Create New VXLAN

Fabrics

Discover Existing

Fabrics / Networks

STP/VPC

DFA / FabricPath

Install / Use DCNM

(Virtual Appliance)

Bootstrap Devices

[POAP]

Manage New VXLAN Fabrics & Existing FabricPath or VLAN Fabrics

Maintain &

Operate

Deploy

Discover

Configure

30


Here is what that looks like in DCNM...

New VXLAN FabricExisting DFA/FP Fabric

31LTRDCT-2781

Getting Started with DCNM


VXLAN Underlay Bring-Up – DCNM Starting Point

Configure DCNM Fabric

Management

(OVA / ISO Setup)

-Management IP

-Fabric Management

subnet

Use Virtual

Appliance (VA)

-VA Includes Fabric

Infrastructure

Use POAP

--Generate POAP

definitions for the

switches

Bootstrap Switches

-Switch VTEP

Configures Automatically

during POAP

Fabric Underlay Installed

LTRDCT-2781 33


POAP Dashboard

Control DHCP, File Server, and POAP Template Definitions from Here

Exploring Dashboards & Topology Views


Exploring .. Summary Dashboards

Add & remove Dashlets

on demand

Customize for your

environment

LTRDCT-2781 36


Exploring Topology

• Dynamic Arrangement

• Multi-Fabric/Overlay

• Arrange by Tier

• [Core, Ag, Access Leaf, Spine etc..]

• Metadata Tags

• Show FEX links

• Device Pop-Over

• Side-By Side View

Hierarchical View

Depends on View Option

Consolidated Views

LTRDCT-2781 37


Exploring Topology .. Details

Search (overlays) Switch Role / HierarchyView Options

Clos or Traditional Network Roles

LTRDCT-2781 38


Exploring Topology



• Arrange by Tier


• Metadata Tags

• Show FEX links

• Device Pop-Over


Select A Device

LTRDCT-2781 39


Exploring Topology



• Arrange by Tier


• Metadata Tags

• Show FEX links

• Device Pop-Over


Metadata Tags

System & User-Defined

Activate Beacon

Switch Details

Switch Color Shows Health

Switch

Pop-Over


Exploring Topology



• Arrange by Tier


• Metadata Tags

• Show FEX links

• Device Pop-Over


Metadata Tags


Activate Beacon

Switch Details


Switch

Pop-Over


Exploring Topology



• Arrange by Tier


• Metadata Tags

• Show FEX links

• Device Pop-Over


Metadata Tags


Activate Beacon

Switch Details


Switch

Pop-Over


Exploring Topology



• Arrange by Tier


• Metadata Tags

• Show FEX links

• Device Pop-Over


Metadata Tags


Activate Beacon

Switch Details


Switch

Pop-Over


Exploring Topology



• Arrange by Tier


• Metadata Tags

• Show FEX links

• Device Pop-Over


Side-By-Side Views

LTRDCT-2781 44

VXLAN Functionality


Top Down Deployment

• Deploys Configuration Profile for VRF, Network or Interface to Switch

• Pushed from DCNM GUI or REST API

• Doesn’t Require Switch Auto-configuration

• Supports VXLAN-EVPN for N9K

-VRF

-VNI

-VLAN

-(Interface)

LTRDCT-2781 46


Adding A New VXLAN Fabric

1. Create a New VXLAN Fabric ‘on the fly’

2. Use or adjust default settings

3. Update Pools for this fabric as necessaryBoth Multicast & Ingress Replication Options

Supported

47


Creating A New Network

1) Use Default VNI or adjust

2) Add G/W to Define Net

1) Choose VRF or add new

48


Deploying The Network

1) Select Network

3) Deploy

2 ) Choose which Switches to Deploy toStaged Deployment is Blue

Yellow is “Deploying”

Green indicates Success

Red indicates failure

49


Deploying The Network – Selecting Switches

• Double Click the Switches where you want the network

• Select “Apply to Switch”

• Select Deploy

• Green indicates success

Double-Click Deploy to this switch

[De-Select to remove Network]

Select Ports if desired

(Not necessary if default is ‘trunk’)

Ready to Deploy

In Progress Deployed

50


Deploying the Network – Selecting Switches

51


Controls

Preview

Add Switches to

Fabric

Refresh

Auto-Refresh on/off

Deploy Details

Show / Troubleshoot Deployment

Multiselect on/off

52


Resource Manager

53

External Fabric Connectivity Provisioning


Border Node Deployments

• Setting up base and setup configuration

• Deploying VRFs

• Deploying VRF_LITE using sub-interfaces with pool management of dot1q IDs

• IPv4 & IPv6 support

• VPC Support

• Deploying Networks for vanilla VLAN hand-off

External Fabric Connectivity Provisioning

LTRDCT-2781 55


External Connectivity using VRF-LITE

LTRDCT-2781 56


Verifying External Connectivity using VRF-LITE

LTRDCT-2781 57

EVPN Multi-Site Provisioning


Support for Border Gateways

• Multi-Site Underlay & Overlay inter-fabric connection setup

• B2B and Route-Server based topology support

• Multi-Site Overlay extension

• Networks & VRFs

• Simultaneous VRF-LITE & Multi-Site support

EVPN Multi-Site Deployment

LTRDCT-2781 59


Multi-Site Inter-fabric Underlay and Overlay Connections

LTRDCT-2781 60


Extending a Network via Multi-Site

If a Layer-3 Network is extended, both VRF & Network are deployed on the

selected Border Gateways

LTRDCT-2781 61

Features for LAN Fabrics


Features in DCNM

Top-Down Provisioning

LTRDCT-2781 63


Topology Views

Real-Time

Search

Health Score

(color)

Link Pop-Up

Pop-Up Switch

Dashboard

Detected VTEP


Topology Views- VMM Integration (Preview)

Display connected

Physical Hosts

Display DVS/Vswitch

Display VMs

Display Host Details

Display Connectivity

Details

Display Port-Group

Details

Filter by VMM

LTRDCT-2781 65


• How many hosts on vlan 10 on eth1/1

on Leaf10 at 11/01/2017 between 2am -

3am?

• How many networks and VRFs are

active on leafs 1-10?

• Network activity heat-map

Graphical view of host life-cycle

on the network

Endpoint Locator

LTRDCT-2781 66

Lab Setup


Dcloud Lab Setup

LTRDCT-2781 68


Nexus Fabric Setup

LTRDCT-2781 69


Lab Walkthrough

70

• Familiarization with DCNM

• Using Endpoint Locator

• Deploying EVPN with Power-On Auto Provisioning

• Deploy Overlay to EVPN Fabric

• Optional: Explore REST-API of DCNM

• Optional: Run PoAP for existing Leaf

LTRDCT-2781


Accessing the Lab

• Lab is hosted in dcloud.cisco.com

• Proctors will distribute login data for anyconnect

71LTRDCT-2781


Cisco Spark

Questions? Use Cisco Spark to communicate with the speaker after the session

1. Find this session in the Cisco Live Mobile App

2. Click “Join the Discussion”

3. Install Spark or go directly to the space

4. Enter messages/questions in the space

How

cs.co/ciscolivebot#LTRDCT-2781


• Please complete your Online Session Evaluations after each session

• Complete 4 Session Evaluations & the Overall Conference Evaluation (available from Thursday) to receive your Cisco Live T-shirt

• All surveys can be completed via the Cisco Live Mobile App or the Communication Stations

Don’t forget: Cisco Live sessions will be available for viewing on-demand after the event at www.ciscolive.com/global/on-demand-library/.

Complete Your Online Session Evaluation

http://ciscolive.com/Online

http://www.ciscolive.com/global/on-demand-library/


Continue Your Education

• Demos in the Cisco campus

• Walk-in Self-Paced Labs

• Tech Circle

• Meet the Engineer 1:1 meetings

• Related sessions

74LTRDCT-2781

Thank you

Documents

Building and operating VXLAN BGP EVPN Fabrics with … MDS 9148S 9706 Scalable Capacity Virtualization & Cloud CapEx & OpEx Efficiencies Agility Security UNIFIED FABRIC Consistency