Network Function Virtualization (NFV) using IOS-XR

Rajendra Chayapathi & Syed Hassan

BRKSPG-2724

• Role of NFV in EPN

• NFV using IOS-XR:

• IOS XRv

• IOS XRv 9000 Router

• Use case

• Virtual Route Reflector & Virtual Provider Edge

• Deployment & Troubleshooting

• Summary

Agenda

http://www.sdncentral.com/whats-network-functions-virtualization-nfv/

decouples network functions

from proprietary hardware

virtualization

Customer Demand is Changing

On-Demand Bandwidth & Capacity

Big Data & AnalyticsRapid Deployment of New Business Applications

Anywhere/Anytime Secure Accessibility

User Experience, Delivered

Multi-Vendor Offerings; No Lock-In

Seamless Connectivity

Security & Compliance

Multi-Platform On-Demand Solutions

The New Customer Requirements

PAYG Models

Entering a New Era in the SP Network Evolution

Evolved Programmable Network

Open APIs

Evolved Programmable Network Infrastructure

SDN Control Resources Services

Evolved Services Platform

Applications and Services

Open APIs

Evolved Programmable

Network (EPN) Era

Network Function Virtualization

Software Defined Networking

Service Orchestration

Discontinuity #1:TDM limits new services, forces architectural shift

IP NGN Era

IP unleashes new wave of innovation and service revenues

Discontinuity #2:Commoditization of IP

services plus high traffic growth limits profitability, forces architectural shift

TDM Era

NFV in Evolved Programmable Network (EPN) Era

Network Function Virtualization

Open and Dynamic

Optimal resource utilization

Accelerated innovation

New services & revenues

Reduced costs

Reduced complexity

Software Defined Networking Service Orchestration

Evolved Programmable Network

Open APIs

Evolved Programmable Network Infrastructure

SDN Control Resources Services

Evolved Services Platform

Applications and Services

Open APIs

NFV across Cisco portfolioVirtualized Network Operating Systems

IOS-XR NX-OS IOS-XE

Virtualized in IOS XRv ,

IOS XRv 9000

Virtualized in Nexus 1000v

Virtualized in CSR1000v

ASA

Virtualized in ASAv

Cisco VNF Sample List …

CSR1Kv IOS-XRv

Available

IOS-XRv 9000

Announced

Nexus1000v

Available

VTF (vPE-F)

Available

vWAAS

Available

vWLC

Available

vNAM

AvailableAvailable

ASAv vSourceFire

Available

vESA

Available

vWSA

Available

vSCE

Available

vNX-OS

Available

X-Star(vBNG Control Plane /

NG XR Control Plane)

Radar

vMX(Meraki)

RadarAvailable

QvPC-SI(vEPC)

QvPC-DI(vEPC)

Available

VDS-IS

Available

Cloud DVR

Available

Unified Comms

Manager

Available

Unified Contact

Centre / CC Exp.

Available

DDoS Radware

Def. Pro / Arbor

Available

MCE8K(Video Conferencing)

AvailableAvailable

DC Controller

(XNC)APIC-EM

Available

ODL/CDL

Available

WAE NCS/NSO

Available

ESC APIC

Available

Prime Service

Catalog

AvailableAvailable

VTC CSM Prime Network

Available

Prime Performance

Manager

Available

Prime Network

Registrar

Available

Prime Optical

Available

Prime Provisioning

Available

Prime

Infrastructure

Available

Prime Access

RegistrarPrime IP Express,

Prime Home

Available

Cisco Multicast

Manager

Available

CTCM(Stratos/Diadem)

Available

Cisco Process

Orchestrator

Available

QvBN

Available

Quantum Policy

(BroadHop)

Available

Tidal Enterprise

Scheduler

AvailableAvailable

Network

Infrastructure,

Gateways,

Applications

Management and

OrchestrationIntelligent

Automation for

CloudPrime Central

Available

Prime Network

Service Controller

Available

Prime Fulfillment

Available

Cisco Configuration

Engine

Available

Prime Analytics

Available

CML (VIRL)

Available

UCS Director

AvailableAvailable

Available

Available Available

Available

Network Functions Virtualization

• Key Enabler: Cloud technology

• Hypervisor & x86 compute hardware

• Network Programmability APIs

• Network Automation / Orchestration

Apps &

Open

InnovationSDN

NFV

Network infrastructure/Service Functions run on

Virtualized x86 compute platforms

Network Functions VirtualizationWhere is SDN?

• SDN complementary, but not mandatory

• NFV is not SDN, though they have commonalities

• Complementary / Orthogonal concepts

SDN Software (CP)

Virtual Networks (DP)

Physical Network

VNF Software (CP)

Virtual Hardware (DP)

Physical IT Hardware

Programmability

Split Architecture

Abstraction

SDN NFV

Apps &

Open

InnovationSDN

NFV

CP: Central Processing

DP: Distributed Processing

SDN & NFVComparison

SDN NFV

SDN Controller :

Open Daylight, Open SDN Controller(OSC) etc.

Virtual network functions :

vFW, vRR, vCPE , vPE etc.

OpenFlow, NETCONF/Yang , Path computation

element protocol (PCEP)

VM to Host (socket, Taps etc.)

Involves end to end networking Involves single network entity

New network architecture Virtualization of existing architecture

Virtualizing Network FunctionsX86 versus Custom Network Processing Unit (NPU)

Network Forwarding (L0-3) Network Services (L4+)

BGP Route reflector, Firewall, DPI

Low to Med Throughput

Stateful functions

Unpredictable traffic

IPv6/v4, MPLS, VPNs, Optical

High throughput / BW

Stateless functions

Mostly predictable traffic

Better fit for NPU

Compute

Bandwidth

Better fit for x86

Compute

Bandwidth

Use-Cases Description

1 Virtual Route Reflector Virtualized BGP RR delivered on demand

2 Virtual PE Router Fully virtualized PE router delivered as an on demand cloud service

3 Virtual Private Cloud Single-tier, 2-tier, 3-tier applications with optional NFV service chaining attached

to customer L3 VPN

4 Virtualized Mobility Service vEPC, GiLAN delivered as cloud based service

5 Hosted Collaboration ServiceIntegrating HCS provisioning with VPN configuration for single click customer

deployment

6 Virtualized Video Headend Cloud DVR, CDN/streaming as a service

7 Routing-as-a-service Using CSR to deliver routing/BNG as a cloud service

8 Virtual BNG in the cloud High-scale (multi-million subscribers) BNG control plane in the cloud

9 Virtual Managed ServicesUsing CSR, ASAv to deliver managed services to enterprise customers

(attached to customer L3VPN)

10 vWLC, vWAAS, vNAM, vSCE .. .. ..

NFV Use-Cases

IOS XRv

Network Virtualization

• Applications and running using virtualized Hardware end CPUs

• Guest O/S running independently in each VM

• HyperVisor - isolated application providing VMs on the Host

• Basic host operating system

• Virtualization capable CPUs

Physical Host

Host O/S

Virtual Machines

HyperVisorQEMU/

Guest O/S

IOS XR

• Time tested for years

• CRS-1, CRS-3, CRS-X, ASR 9000

• High-scale control plane

• MicroKernel-based

• Modular Software

• Process Restartability

• PIE and SMU activation without reloading the VM

Physical Hardware:CPU, ASICs, NIC,

Consoles, Memory, HDD

QNX Kernel

IOS XR

IOS XRv

• IOS XR on x86 Virtualized environment

• Full Platform Independent IOS XR

• Same IOS XR software feature set

• Manageability

• Control Plane

• Routing

Physical Hardware:CPU, ASICs, NIC, Consoles, Memory, HDD

Host OS

HyperVisor

IOS XRv

Guest OS (32bit Linux)

IOS XRv

Physical Hardware:CPU, ASICs, NIC, Consoles, Memory, HDD

Host OS

HyperVisorHyperVisorHyperVisor

IOS XRv #1

Guest OS (32bit Linux)

IOS XRv #2

Guest OS (32bit Linux)

Other Guest OS

IOS XRv 9000

IOS XRv 9000

• Virtualized IOS XR with Control and Data plane Separation

• Linux Containers for Admin, Control and Data Planes

• Scalability through Flexible resource Allocation

• Data plane scalability.

• Control Plane scalability

Physical Hardware:CPU, ASICs, NIC, Consoles, Memory, HDD

Host OS

HyperVisor

IOS XRv

Guest OS (64bit Linux)

Cisco IOS XRv 9000Right sizing Scale and Throughput through Control and Data Planes

LC (Data Plane)

RP(Control Plane)

IOS XR

1xCPU : NxLCs

Routers + LCs

LC (Data Plane)

LC (Data Plane)

LC (Data Plane)

MxCPU : N x NPU

Virtual Routers

LC (Data Plane)

Compute Server

(Control Plane)

Compute Server

(Control Plane)

Compute Server

(Control Plane)

IOS XRv 9000Compute

Routers/Compute

Present Mode of Operation Future Mode of Operation

Cisco IOS XRv 9000Data Plane Controller & Agent

LC (Data Plane)

LC (Data Plane)

LC (Data Plane)

LC (Data Plane)

Compute

Compute

Compute

IOS XRv 9000

Compute

Routers/Compute

Data Plane Agent

(DPA)

Data Plane

Controller

(DPC)

Low level forwarding

objects

LC (Data Plane)

LC (Data Plane)

LC (Data Plane)

LC (Data Plane)

Compute

Compute

Compute

Compute

Cisco IOS XRv 9000Evolution through Data Plane Controller & Agent

IOS XR

DPC

IOS XR

DPC

IOS XR

DPC

IOS XR

DPC

Abstraction Layer (NetConf / YANG / SDN APIs)

Physical Dataplanes Virtual XR

DataplanesVirtual XR DP

Physical Merchant Silicon

DPA Forwarding Agent

Cisco IOS XRv 9000Design Trade Offs

Performance:

ACE, TM, &

Queues

Features

Physical XR Router

IOS XRv 9000

Virtual Router X

Possible to degrade

overall performance

by improving

performance for one

particular metric

IOS XRv 9000 PositioningCompleting the XR Edge Portfolio

2

8

32

128

512

2048

8192

32768

Virtual XR DP

IOS XRv 9000 ASR 9001ASR 9006

ASR 9904

ASR 9010

ASR 9912ASR 9922

Benefits & Use Cases

IOS XRv & IOS XRv 9000Benefits

Lower Opex

• Easy provisioning , configuration & deployment for VMs

Lower Capex

• IOS XRv on standard compute resources

Small Footprint

• Multiple XRs on same device

Greener

• low power consumption Lower carbon footprint

Flexible Growth

• CP & DP Separation and independent resource allocation

SDN Ready

• Independentcontrol and forwarding

Use Cases

Education and Training

Network Simulation

NetworkDeployment

Use Cases: `Training & Education

Virtualized OS

1 student : 10 routers

Scalable resources

OS on Hardware

10 students : 1 router

Limited hardware

XR

vX

R R

oute

rsStudents Need “Hands-On”

Experience

Use Cases: Network Simulation & modeling

Test & Try new control-plane capabilities

Evaluate network against failures

Equipment Cost

Setup Time

Cumbersome to change

Design & plan changes and new features

Lab validation XRv / 9000

Low Cost

Easy Orchestration

Quick setup & changes

Use Cases: Network Deployment (vRR & vPE)

• Consumption based model - Network growth to match needs

• Redundant devices provisioning without added cost

• Service segregation on same hardware

• Grow and scale VM’s server resources to match needs

vRR1

vPE1vRR2vPE2vRR

1

vPE1

Virtual Route Reflector (vRR)

&Virtual Provider Edge

(vPE)

IOS XRv as vRR

• Traditional Role of RR

• BGP peering

• Solve N*N full-mesh BGP interconnect

• Distribute BGP routes to PEs

NxN

Nx1

Nx1 + redundancy

Nx1 + Segregation

IOS XRv as vRR

RR role expanding -

centralized provision, services, and applications

Primary Backup

L3VPN RR

Vpnv4 RR

IPv6 RR

IPv4 RR

Per Service

Per Address Family

Redundant

Optimized Placement

Scalable

Easy Provisioning

L2VPN RR

IOS XRv as vRR

IPv4 RR

Vpnv4 RR

IPv6 RR

L2vpn vRR

Primary Backup

IPv4 vRR

Vpnv4 vRR

IPv6 vRR

L2vpn vRR

Primary Backup

8 Physical Devices2 Physical Devices

Virtualized RRs per AFI

Performance (Multi-Core)

Independent Operation

High

Availability

Same BGP Implementati

on (XR)

Without Compromising

Virtual XR DP

IOS XRv 9000

Virtual XR DP

Virtual XR DP

IOS XR

IOS XR

IOS XRv as vPE

Forwarding Performance (Multi-Core)

Consumption Based Growth

Control Plane

& High-Performance

Data Plane

High Availability

vRR & vPE using IOS XR

Performance (Multi-Core)

Independent Operation

High

Availability

IOS XR Based Implementation

Resource Allocation Flexibility

(CPU/Memory)

Portability & Agility

Route Scalability

(32/64b OS)

Management &

Orchestration

Lower Opex/Capex

Power Calculations based on

ASR9001 (Max Power)

UCS C240 M3 SFF with Intel E5-2643 v2 3.30 GHz/130W 6C/25MB Cache/DDR3 1866MHz with 96 GB Mem, 4 HDD

with RAID, and 1 Adapters.

vRR & vPE using IOS XRPrimary Backup Primary Backup

Physical Router VRR on UCS Server

Max. Power consumption ~425W Max Power consumption ~410W

Total power for 8 instance ~3.4kW Total power for 8 instances ~820W

Power/Year = 29,785 KWh Power/Year = 7,182 KWh

Power Cost/Year = $5,659

(19c/kWh)

Power Cost/Year= $1,364

(19c/KWh)

Physical Network Device vs NFVConsumption Based Deployment

CP

U,

GB

, bps

Physical Network Device NFV

CP

U,

GB

, bps

IOS XRv Deployment

IOS XRv Flavors• XR Familiarization

• Free

• Limited Performance (2Mbps Rate Limit)

• Anti-Security (Hard Coded AAA Users)

• No Support

Demo

• Network Modeling

• 1-3 years license

• Enhanced Performance (50Mbps Rate Limit)

• TAC Supported

Simulation

• Deploy as product

• vRR Application

• 1-3 years license

• Full Performance (no Rate Limit)

• TAC Supported

Production

iosxrv[-k9]-demo.vmdk/ova

iosxrv[-k9].vmdk/ova

iosxrv[-k9].vmdk/ova

https://upload.cisco.com/cgi-bin/swc/fileexg/main.cgi?CONTYPES=Cisco-IOS-XRv

Training &

Education

Staging &

Testing

Production

IOS XRv LicensesTerm

Length

1 year

3 years

Address Family Feature Sets

Base:BGP, IPv4/v6,

Mcast

Advanced:

MP-BGP, MPLS-VPN, Mcast VPN

Scale

Low(1M)

Medium (4M)

High (No limit)

L-XRV-RR-A-L-1YR

IOS XRv Hardware/Software Requirements

• Hardware

• Any x86-based server capable of virtualization• e.g. Intel® CPUs with VT-x support

• Hypervisor

• VMWare ESXi 5.x , QEMU/KVM 1.0

Parameter Minimum

CPU (Cores) 1

Memory (RAM) 3GB

Hard Disk 1x 2GB

Serial Port 1 (for console)

NIC Port (E1000/VirtIO) 1

IOS XRv 9000 Hardware/Software Requirements

• Hardware

• Any x86-based server capable of virtualization• e.g. Intel® CPUs with VT-x support

• Hypervisor

• VMWare ESXi 5.5 , QEMU/KVM 1.0

Parameter Minimum

CPU (Cores) 2

Memory (RAM) 12GB

Hard Disk 5GB

Serial Port 1 (for console)

NIC Port (E1000/VirtIO/Niantic 10G

)

2

IOS XRv Features

• IOS XR Manageability & Control Plane

• PIE/SMU Upgrades

• NTP, EIGRP, ISIS, OSPF, MPLS (LDP/TE)….

• BGP

• AFI / SAFI • Unicast, Mcast, LS, MDT(mVPN), VPLS, L3VPN ….

• Multi-Instance BGP

• Route Policy Language (RPL)

IOS XRv 9000 Features

• OSPF/ISIS,

• MP-BGP/eBGP , BGP 3107

• BFD

• LDP/MPLS, 6PE, 6vPE, RFC 3107 (3 labels), L3VPN

• IPv4 ACL (chained), uRPFv4/v6, LPTS

• Netconf/YANG & SNMP

• Hierarchical QoS policing, WRED

• EFD

• Lawful Intercept

(Bidirectional Forwarding Detection)

(Early Fast Discard)

XRv Example ScaleAddress

Family

eBGP Sessions Routes per Session Total Routes

IPv4 200 4000 800,000

IPv6 50 4000 200,000

Address

Family

Sessions Routes per Session Total Routes

VPNv4 250 8400 2,100,000

VPNv6 50 2000 100,000

IOS XRv : version 5.1.1

XRv 9000 Example ScaleAddress

Family

eBGP Sessions OSPF Routes Total Routes

IPv4 5000 40,000 4,000,000

IPv6 2000 - 2,000,000

IOS XRv 9000 : subjected to change

IOS XRv 9000 Performance

XRv CP

2015 2016+

Single Core Multi-Core Multi-Socket Multi-Server

2015

XRv CP XRv CP XRv CP

8GPBS

?GPBS

40GPBS

XRv CPXRv CP XRv CP XRv CP

40GPBS

160GPBS

?GPBS

Vanilla IPv4

IMIX traffic packet size

with features enabled

IOS XRv Bring-Up

Host

Copy XRv 9000 image (.iso/.vmdk)

on server

Create Virtual (Tap) interfaces

Start simulation

Eth0

Eth1

Eth2

Tap 01

Tap 02

Tap 03

Virtual InterfaceVirtual Interface

Mgmt

Bridge

Data

Bridge-1

Physical Interfaces

Mgmt

G0/0/0/0

G0/0/0/1

G0/0/0/2

XRv

Virtual Machine

Data

Bridge-2

Passthrough vs Device Emulation

Guest OS (VM)

Hypervisor

Hardware Platform

Guest OS(VM)

Hypervisor

Hardware Platform

Physical driver

Physical device

Emulated device

Guest driverPhysical driver

Physical device

Pa

ssth

rou

gh

XRv 9000 Bring-Up

Host

Copy XRv 9000 image (.iso/.vmdk)

on server

Create Virtual (Tap) interfaces

Start simulation

Eth0

Eth1

Eth2

Tap 01

Tap 02

Tap 03

Data Plane

Control Plane

Admin PlaneVirtual InterfaceVirtual Interface

Mgmt

Bridge

Data

Bridge-1

Physical Interfaces

Mgmt

G0/0/0/0

G0/0/0/1

G0/0/0/2

XR (DPC)

Sysadmin

XR (DPA)

Virtual Machine

Hypervisor Interface

IOS XRv Bring-upCreating TAP and Bridge

cisco@epn-sjcj-ucs1:~$ sudo tunctl -t Tap1

Set 'Tap1' persistent and owned by uid 0

cisco@epn-sjcj-ucs1:~$ sudo tunctl -t Tap2

Set 'Tap2' persistent and owned by uid 0

cisco@epn-sjcj-ucs1:~$ sudo ifconfig Tap1 up

cisco@epn-sjcj-ucs1:~$ sudo ifconfig Tap2 up

cisco@epn-sjcj-ucs1:~$ sudo brctl addbr vRR-bridge

cisco@epn-sjcj-ucs1:~$ sudo brctl addif vRR-bridge Tap1

cisco@epn-sjcj-ucs1:~$ sudo brctl addif vRR-bridge Tap1

cisco@epn-sjcj-ucs1:~$ brctl show

bridge name bridge id STP enabled interfaces

vRR-bridge 8000.72ee4e89d284 no Tap1

Tap2

IOS XRv Bring-upLaunching the IOS XRv Virtual Machine

cisco@epn-sjcj-ucs1:~$ sudo /usr/bin/qemu-system-x86_64 \\

-m 4024 \\

-name XRv-Test-Launch \\

-hda /home/cisco/iosxrv-k9.vmdk-5.1.1-3 \\

-serial telnet:0.0.0.0:2345,server,nowait \\

-device e1000,netdev=first-intf \\

-netdev tap,ifname=Tap1,script=no,downscript=no,id=first-intf \\

-device e1000,netdev=second-intf \\

-netdev tap,ifname=Tap2,script=no,downscript=no,id=second-intf \\

-nographic -no-kvm

4G Memory

XRv Instance

XRv Image File

Console port

Ethernet (Mgmt)

Ethernet (GigE)

IOS XRv Bring-upAccessing the IOS XRv Virtual Machine

cisco@epn-sjcj-ucs1:~$ telnet 10.29.212.225 2345

IOS XRv DeploymentAccessing the IOS XRv Virtual Machine

cisco@epn-sjcj-ucs1:~$ telnet 10.29.212.225 2345

RP/0/0/CPU0:Apr 13 22:17:30.093 : ike[226]: %SECURITY-IKE-4-WARNING : You may want to

configure a domain-name

!!!!!!!!!!!!!!!!!!!! NO root-system username is configured. Need to configure root-

system username. !!!!!!!!!!!!!!!!!!!!

--- Administrative User Dialog ---

Enter root-system username: test-user

Enter secret:

Use the 'admin' mode 'configure' command to modify this configuration.

IMPORTANT: READ CAREFULLY

Welcome to the Demo Version of Cisco IOS XRv (the "Software").

The Software is subject to and governed by the terms and conditions

IOS XRv DeploymentConfiguring and accepting production license

RP/0/0/CPU0:ios#conf t

RP/0/0/CPU0:ios(config)#platform mode production accept-eula

RP/0/0/CPU0:ios(config)#commit

Sun Apr 13 22:21:38.316 UTC

RP/0/0/CPU0:Apr 13 22:21:38.526 : xrvr_lic_mgr[397]: %OS-IOSXRV_LIC_MGR-3-EULA_ACCEPTED

: End User License Agreement accepted. Welcome to the Production Version of Cisco IOS

XRv.

RP/0/0/CPU0:ios(config)#end

………

Press RETURN to get started.

IMPORTANT: READ CAREFULLY

Welcome to the Production Version of Cisco IOS XRv (the "Software").

The Software is subject to and governed by the terms and conditions

IOS XRv DeploymentShow Commands

RP/0/0/CPU0:ios#show ver

Cisco IOS XR Software, Version 5.1.1[Default]

Copyright (c) 2014 by Cisco Systems, Inc.

ROM: GRUB, Version 1.99(0), DEV RELEASE

ios uptime is 39 minutes

System image file is "bootflash:disk0/xrvr-os-mbi-5.1.1/mbixrvr-rp.vm"

cisco IOS XRv Series (AMD 686 F6M2S3) processor with 4120177K bytes of memory.

AMD 686 F6M2S3 processor at 2820MHz, Revision 2.174

IOS XRv Chassis

2 GigabitEthernet

1 Management Ethernet

96050k bytes of non-volatile configuration memory.

866M bytes of hard disk.

IOS XRv DeploymentShow Commands

RP/0/0/CPU0:ios#show platform

Sun Apr 13 21:11:31.862 UTC

Node Type PLIM State Config State

-----------------------------------------------------------------------------

0/0/CPU0 RP N/A IOS XR RUN PWR,NSHUT,MON

RP/0/0/CPU0:ios#show ipv4 int br

Sun Apr 13 21:11:35.772 UTC

Interface IP-Address Status Protocol

MgmtEth0/0/CPU0/0 unassigned Shutdown Down

GigabitEthernet0/0/0/0 unassigned Shutdown Down

GigabitEthernet0/0/0/1 unassigned Shutdown Down

RP/0/0/CPU0:ios#

Single RP. No LineCard

IOS XRv Other Deployment Methods

• vSphere for ESXi management

• Virt-manager on Ubuntu

IOS XRv Deployment on ESXi

Image UploadCreate new guest OS

Network interface

XR Virtual DiskCreating Serial Interface

IOS XRv Deployment on ESXi

• Telnet to the IOS-XRv VM port

• telnet <esxi_host_ip> <port_number>

• Will go through TURBOBOOT process on first boot up and reload

• Only happens once, during the first bootup.

• Create Username and Password

• Login and start configuring!

Accessing the IOS-XRv VM

Cisco IOS XR Software for the Cisco XR IOSXRv, Version 4.3.2Copyright (c) 2013 by Cisco Systems, Inc.Sep 26 23:46:24.067: Install Setup: Booting with committed softwareSep 26 23:46:39.886 : TURBOBOOT: Turboboot process startedSep 26 23:46:39.906 : TURBOBOOT: Checking size of device disk0:Sep 26 23:46:39.906 : TURBOBOOT: OKSep 26 23:46:39.916 : TURBOBOOT: Checking size of MBI device bootflash:Sep 26 23:46:39.916 : TURBOBOOT: OKSep 26 23:46:39.926 : TURBOBOOT: Waiting for Admin Config to complete

<output snipped>

Sep 26 23:47:19.574 : TURBOBOOT: All node preparations complete:Node 0/0/CPU0 successfully completed the preparation.

Sep 26 23:47:19.584 : TURBOBOOT: Resetting TURBOBOOT rommon variable to (TURBOBOOT=).Sep 26 23:47:19.594 : TURBOBOOT: Setting config-register to autobootthe router and disable send break.Sep 26 23:47:19.614 : TURBOBOOT: Turboboot completed successfully: the router will now reload from disk

Sep 26 23:47:19.624 : TURBOBOOT: *** RESETTING IN 30 SECONDS ***

Calling platform_kd_reboot ...

<output snipped>

!!!!!!!!!!!!!!!!!!!! NO root-system username is configured. Need to configure root-system username. !!!!!!!!!!!!!!!!!!!!

--- Administrative User Dialog ---

Enter root-system username: ciscoEnter secret:

Use the 'admin' mode 'configure' command to modify this configuration.

Using ESXi Hypervisor

• Creating XRv Virtual Machine using vSphere GUIParameters Recommendation

Configuration Custom

Name and Location as with any other VM

Storage as with any other VM

Virtual Machine Version "Virtual Machine Version 8 or 9” *

Guest Operating System "Other", version "Other (32-bit)"

CPUs Max 8 cores

Memory Min 3 GB, Max 8 GB

Network 1-4 NICs, each NIC must use "E1000" adapter type.

First NIC will be MgmtEthernet0/0/CPU0/0 while subsequent

NICs will be GigabitEthernet

Using ESXi Hypervisor

• Creating XRv Virtual Machine using vSphere GUI (Con’t)

•

• Start the VM. Telnet to the configured serial port(s) to interact with and configure the VM

Parameters Recommendation

SCI Controller LSI Logic Parallel (default)

Select a disk "Use an existing virtual disk"

Select Existing Disk select XRv VMDK image

Advanced Options Must be an IDE disk

Ready to Complete select "Edit the virtual machine settings before completion”

"Virtual Machine Properties" window – add 2 serial ports as: Under "Hardware", click "Add..."

Select "Serial Port"

Select "Connect via Network"

Select "Server" and enter a telnet URI with an unused port (e.g.,

telnet://<host IP address>:5001) - each VM and each serial port

must use a unique port number.

Repeat this to add a second serial port. The first serial port will be

the console port, and the second will be the aux port.

IOS XRv Troubleshooting

IOS XRv Troubleshooting

IOS XRvHypervisor

interface

Host

Physical Interface Virtual Bridge

Management

Domain

Data Domain

IOS XRv Troubleshooting Hierarchy

• Regular IOS XR troubleshooting methods

IOS XRv Virtual Machine

• Hypervisor specific troubleshooting commands/views

Hypervisor

• Unix/Linux troubleshooting

Host OS

• Regular x86 Server troubleshooting

Hardware

IOS XRv TroubleshootingHypervisor Commands

(qemu) info status

VM status: running

(qemu) info network

Devices not on any VLAN:

e1000.0: type=nic,model=e1000,macaddr=52:54:00:12:34:56

\ first-intf: type=tap,ifname=Tap1,script=no,downscript=no

e1000.1: type=nic,model=e1000,macaddr=52:54:00:12:34:57

\ second-intf: type=tap,ifname=Tap2,script=no,downscript=no

(qemu) info chardev

parallel0: filename=null

serial0: filename=telnet:0.0.0.0:2345,server

compat_monitor0: filename=stdio

(qemu)

Status verification of Guest OS

IOS XRv TroubleshootingHypervisor Common mistakes

• Multiple XRv using same disk image

– Each instance needs a separate disk

• Multiple XRv using same console

$ qemu-system-x86_64 -serial telnet::2345,server,nowait <...snip...>

inet_listen_opts: bind(ipv4,0.0.0.0,2345): Address already in use

inet_listen_opts: FAILED

chardev: opening backend "socket" failed: Address already in use

qemu: could not open serial device 'telnet:0.0.0.0:2345,server,nowait': Address already

in use

IOS XRv TroubleshootingHost Commands

cisco@epn-sjcj-ucs1:~$ ps -ef | grep XRv

root 6614 6436 0 04:32 pts/1 00:00:00 sudo /usr/bin/qemu-system-x86_64 -m

4024 -name XRv-Test-Launch -hda /home/cisco/iosxrv-k9.vmdk-5.1.1-5 -serial

telnet:0.0.0.0:2345,server,nowait -device e1000,netdev=first-intf -netdev

tap,ifname=Tap1,script=no,downscript=no,id=first-intf -device e1000,netdev=second-intf

-netdev tap,ifname=Tap2,script=no,downscript=no,id=second-intf -nographic -no-kvm -

device e1000,netdev=third-intf -netdev

tap,ifname=Tap3,script=no,downscript=no,id=third-intf

top - 09:26:59 up 13 days, 58 min, 2 users, load average: 0.49, 0.47, 0.50

Tasks: 325 total, 2 running, 322 sleeping, 0 stopped, 1 zombie

Cpu(s): 1.6%us, 0.4%sy, 0.1%ni, 98.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st

Mem: 181507016k total, 8715152k used, 172791864k free, 146552k buffers

Swap: 134143996k total, 0k used, 134143996k free, 4476556k cached

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND

5477 cisco 20 0 50460 26m 3808 R 39 0.0 4843:57 Xtightvnc

31187 libvirt- 20 0 5972m 1.9g 7640 S 9 1.1 377:28.36 qemu-system-x86

34605 libvirt- 20 0 5972m 1.8g 7628 S 7 1.0 348:28.40 qemu-system-x86

24982 cisco 30 10 32068 1844 1488 S 4 0.0 0:05.99 fuzzyflakes

Process & CPU Status

IOS XRv TroubleshootingHost OS Common Issues

• Missing qemu/KVM package

– apt-get install qemu-kvm; mobprobe kvm

• Not able to create TAP interface:

– apt-get install uml-utilities (required for tap interface for bridge to physical)

• Virtualization not enabled:

– Ensure VT-x flag (or equivalent) is exposed to operating system• egrep -c '(vmx|svm)' /proc/cpuinfo

• Ensure that user is added to ‘kvm’ group

– sudo addgroup `id -un` kvm

Service Orchestration for NFV

Architecture, Tools & Processes

Stitching of software and hardware components

Automating of work flows

Service Catalog and Workflow

Service Orchestration

VM/Storage Control

Network Control

Orchestration

Catalog

vR

R

vR

R

vR

R

Ap

ps

Ap

ps

Ap

ps

Service Orchestration for NFV

Network Function Virtualization Software Defined Networking Service Orchestration

NFV with IOS XRRight Sizing Your Deployment

Choose your Service Size up your Data Plane Adapt your Control Plane

Core / Transport

Peering

DCI

PE

Subscriber Services

Virtual PE (vPE)

Virtual RR (vRR)

NCS 6000

ASR 9000 Tomahawk

CRS-X

CRS

ASR 9000 Typhoon

IOS-XRv 9K

Multichassis NCS 6000

Multichassis CRS-X

Data Plane

Low

High

Today’s IOS-XR

on box Control

Plane

Virtualized CP or

Expansion CP from

Physical System

Choose

between

On-box,

Hybrid or

Pure

Virtual CP

Based on

Use Case

Control Plane

Low

High

NFV using IOS XRCompleting Portfolio

IOS-XR

Edge Routing

ASR 9000 Portfolio

CRS Portfolio NCS 6000

Single & Multi

Chassis

Virtual XR DP

X86 Virtual Router

NFV Virtual Router

IOS-XRv

vPE, vRR

Putting it all together…

Virtual FunctionsStorage

BSS

OSS

HypervisorsCompute Network

IOS XRv

SMU-ability

Low Capex Flexible

ScalableOpex Saving

Carrier Class

High

Availability

Multi-

threaded

• Role of NFV in EPN?

• Introducing IOS XRv & XRv 9000

• vRR and vPE Use Cases

• Deployment & Troubleshooting

• Summary

Re-cap

Participate in the “My Favorite Speaker” Contest

• Promote your favorite speaker through Twitter and you could win $200 of Cisco Press products (@CiscoPress)

• Send a tweet and include

• Your favorite speaker’s Twitter handle

• Two hashtags: #CLUS #MyFavoriteSpeaker

• You can submit an entry for more than one of your “favorite” speakers

• Don’t forget to follow @CiscoLive and @CiscoPress

• View the official rules at http://bit.ly/CLUSwin

Promote Your Favorite Speaker and You Could Be a Winner

Complete Your Online Session Evaluation

Don’t forget: Cisco Live sessions will be available for viewing on-demand after the event at CiscoLive.com/Online

• Give us your feedback to be entered into a Daily Survey Drawing. A daily winner will receive a $750 Amazon gift card.

• Complete your session surveys though the Cisco Live mobile app or your computer on Cisco Live Connect.

Continue Your Education

• Demos in the Cisco campus

• Walk-in Self-Paced Labs

• Table Topics

• Meet the Engineer 1:1 meetings

• Related sessions:• BRKSDN-2063 - SDN/NFV for Service Provider IP/MPLS Networks

• BRKSDN-2065 - NFV Architecture & Orchestration for Cloud based Virtual Managed Services

• BRKCRS-3447 - Network Function Virtualization for Enterprise Networks

• BRKRST-2319 - Network Service Chaining Solutions

• CISSOL-1019 - Business Transformation with Evolved Services Platform and Evolved Programmable Network

Thank you