16
June 2023, 2016 | Berlin, Germany

Summit 16: Deploying Virtualized Mobile Infrastructures on Openstack

  • Upload
    opnfv

  • View
    231

  • Download
    1

Embed Size (px)

Citation preview

Page 1: Summit 16: Deploying Virtualized Mobile Infrastructures on Openstack

June 20ndash23 2016 | Berlin Germany

Deploying Virtualized Mobile Infrastructures on Openstack

Prakash Suthar psutharciscocom Principal Architect Cisco System Inc

Ajay Simha asimharedhatcom NFV ArchitectSenior Principal Engineer Red Hat Inc

Abstract

Mobile SP are transforming their existing purpose built-hardware based mobile packet core to virtualized NFV based solutions to reduce complexities and lower TCO The biggest challenge of decide right NFV technology which is SP grade agile and capable of scaling at lower cost We have put together SP grade NFV solution which is being trialed with large mobile operators The speaker will share their experience about design optimize and tune performance at NFV infrastructures and orchestration layers using technologies from Cisco (VNF Manager and NFVO) Redhat (NFVI) Openstack and block storage using CEPH technology Participants will be able to understand complexities of mobile packet core evolution NFV based solution which is framework for 5G mobile packet core

Agenda

Mobile Networks Characterization and Use Cases

Deploying Mobile Core on Virtualized Infrastructure

Summary

QampA

Mobile Network Changing Dynamics

Old Normal New Normal

User

Access

Services

Usage

Architecture

People

Homogeneous

Voice amp Data

Predictable

Static

People amp Things

Heterogeneous

Experiences

Unpredictable

Elastic

Introducing NFV in SP Network

Management and OrchestrationM

an

ag

em

en

t

Service Resource Control

VNFMVNFM VNFMVNFM

NFV Orchestration

Catalog Workflow

SystemMgmt

NetworkControl

ComputeControl

StorageControl

Virtual Infrastructure Manager

Data CenterIntelligent Transport AccessUser

Orchestrated Virtualized Infrastructure

VNF VNFVNFVNF

FuncFunc

Virtualized Infra

Storage

Compute

Network

VPC Solution Overview

ETSI GS NFV002 V111 (2013-10)

NFV ReferenceArchitectural Framework

Ciscoreg VNFM

Elastic Service Controller

(ESC)

Ciscoreg

Network Services Orchestrator

(NSO)

VIM

Ciscoreg UCS Nexus

Ciscoreg NFVI

GiLAN

VNF

PCRF

VNF

FW

VNF

Ciscoreg Element Manager

VPC

VNFhellip

How does it work

MME

S11Control Plane

GTP Demux

Session Manager

IP Address Manager

AAA Manager

Policy and Charging

AAA PCRF OCS

Diameter (Gx Gy S6b)

eNB

S1-C

User Plane Forwarder

S1-U

OpenFlow

SGiUE

Session Request

Profile Request

Policy RequestIP AddrRequestQuota

RequestProgram

UPF

SessionCreated

Dimensions of Workload Scale

CPU ndash Intel x86

IO

Memory

Video

Policy

Control

VM VM

VM

M2M

IOT

VoLT

E

Unified Fabric

SDN

Technologies

Virtualized Adapter

Industry Trend

Increased core countBig Data

Analytics

Detailed

Billing

High Density Blades

Session Disk Caching

Virtualization

Small Packets require

More IO capacity

M2M solutions require massive

amounts of sessions with

minimal throughput-

requiring additional memory

Operations like Deep Packet Inspection

Advanced Analytics Policy controlled sessions etc

Require additional CPU capacity

Mobile Packet Core Characteristics

Critical Parameters Values

Number of sessions ~ 1 to 10 Millions

Gateway total bandwidth ~ 10 to 100 Gbps

Bandwidthusers 10-50 Mbps

Packet loss ~ 1

Jitter 10 ndash 30 ms

Data Plane Latency for critical Apps

~50 ms

Initial session attach ~500 ms

Critical Parameters Values

Encryption support Desired in hardware

Control plane eventssec

~ 5000sec

User plane packet sec ~5 Million Packetsec

Packet size Varies ( typically 64 to 1500)

QoS classes to support different traffic types

gt5 (3GPP defines 9 classes)

httpssupportixiacomcomsitesdefaultfilesresourceswhitepapermobile-

broadband-networks-breakingpointpdf

VPC Inside Look

vPC Network ndash Internal network (Private L2

VLAN) interconnecting all VMs in an instance

2 CF VMs

act as 11

Up to 48 SF VMs User IO for service context ports Protocol

Signaling and Session Processing tasks

VPC VNF - Group of VMs acting as a single

manageable unit with single service address

Standby

VPC Networking

bull ManagementProvisioning also used for PXE booting servers

bull API network for Openstack (Best Practice)

bull Horizon Dashboard

bull Externally routable

bull Tenant Networks

bull VM to VM traffic

bull Uses VXLAN

bull Storage Network

bull Needed for optimal access to storage

Cisco Servers Profile

UCS B200 M4 Blade Servers

2 Intel Xeon processors EF-2680 v3 (or better)

12 cores per processor 24 cores per server

2 threads per core 24 threads per processor

16 strips of 16GB DDR4 RAM

Cisco 1340 VIC

Dual 20GE ports

Supports up to 256 vNICs

Supports SR-IOV

2 x 300 GB HDD

Per VM Server Requirements

CPU 8 to 24 vCPU

Memory 16 to 64GB RAM

NIC ~4 vNIC

Disk 16 GB vHDD (Min)

SR-IOV Yes

CPU Pinning Yes

Host Layout

Hardware

Cisco Servers (UCS) Cisco NFVI Installer Bare metal

Non-Cisco Servers Red Hat Openstack Director Bare metal

Host OS RHEL

Openstack OSP Cisco NFVi uses Docker

containers

VPC PerformanceHigh Availability amp Performance Optimizations

Performance Optimization

Huge Page

NUMA nodes

CPU Pinning

SR-IOV

Jumbo packets support

for Network (Internal communication)

High Availability

Single chassis (active and standby control

functionmodule

Multi-chassis (one control functionmodule per

chassis to accommodate chassis failure

Infrastructure

Multi-chassis

Geo-redundancya

BFD (Failure detection)

Application Level

Inter-chassis session recovery (stateful

redundancy)

Load balancing (ECMP using BGP

sessions over each SF)

Summary

Virtualization Benefits

Enable new uses cases

Improve TCO ndash CapexOpex

Virtualization Growing Trends

Mobile Packet Core

GiLAN services

C-RAN

5G Architecture

Key Learnings

Maturity and interoperability of VIM VNFM

Infrastructure Performance tuning need automation

Page 2: Summit 16: Deploying Virtualized Mobile Infrastructures on Openstack

Deploying Virtualized Mobile Infrastructures on Openstack

Prakash Suthar psutharciscocom Principal Architect Cisco System Inc

Ajay Simha asimharedhatcom NFV ArchitectSenior Principal Engineer Red Hat Inc

Abstract

Mobile SP are transforming their existing purpose built-hardware based mobile packet core to virtualized NFV based solutions to reduce complexities and lower TCO The biggest challenge of decide right NFV technology which is SP grade agile and capable of scaling at lower cost We have put together SP grade NFV solution which is being trialed with large mobile operators The speaker will share their experience about design optimize and tune performance at NFV infrastructures and orchestration layers using technologies from Cisco (VNF Manager and NFVO) Redhat (NFVI) Openstack and block storage using CEPH technology Participants will be able to understand complexities of mobile packet core evolution NFV based solution which is framework for 5G mobile packet core

Agenda

Mobile Networks Characterization and Use Cases

Deploying Mobile Core on Virtualized Infrastructure

Summary

QampA

Mobile Network Changing Dynamics

Old Normal New Normal

User

Access

Services

Usage

Architecture

People

Homogeneous

Voice amp Data

Predictable

Static

People amp Things

Heterogeneous

Experiences

Unpredictable

Elastic

Introducing NFV in SP Network

Management and OrchestrationM

an

ag

em

en

t

Service Resource Control

VNFMVNFM VNFMVNFM

NFV Orchestration

Catalog Workflow

SystemMgmt

NetworkControl

ComputeControl

StorageControl

Virtual Infrastructure Manager

Data CenterIntelligent Transport AccessUser

Orchestrated Virtualized Infrastructure

VNF VNFVNFVNF

FuncFunc

Virtualized Infra

Storage

Compute

Network

VPC Solution Overview

ETSI GS NFV002 V111 (2013-10)

NFV ReferenceArchitectural Framework

Ciscoreg VNFM

Elastic Service Controller

(ESC)

Ciscoreg

Network Services Orchestrator

(NSO)

VIM

Ciscoreg UCS Nexus

Ciscoreg NFVI

GiLAN

VNF

PCRF

VNF

FW

VNF

Ciscoreg Element Manager

VPC

VNFhellip

How does it work

MME

S11Control Plane

GTP Demux

Session Manager

IP Address Manager

AAA Manager

Policy and Charging

AAA PCRF OCS

Diameter (Gx Gy S6b)

eNB

S1-C

User Plane Forwarder

S1-U

OpenFlow

SGiUE

Session Request

Profile Request

Policy RequestIP AddrRequestQuota

RequestProgram

UPF

SessionCreated

Dimensions of Workload Scale

CPU ndash Intel x86

IO

Memory

Video

Policy

Control

VM VM

VM

M2M

IOT

VoLT

E

Unified Fabric

SDN

Technologies

Virtualized Adapter

Industry Trend

Increased core countBig Data

Analytics

Detailed

Billing

High Density Blades

Session Disk Caching

Virtualization

Small Packets require

More IO capacity

M2M solutions require massive

amounts of sessions with

minimal throughput-

requiring additional memory

Operations like Deep Packet Inspection

Advanced Analytics Policy controlled sessions etc

Require additional CPU capacity

Mobile Packet Core Characteristics

Critical Parameters Values

Number of sessions ~ 1 to 10 Millions

Gateway total bandwidth ~ 10 to 100 Gbps

Bandwidthusers 10-50 Mbps

Packet loss ~ 1

Jitter 10 ndash 30 ms

Data Plane Latency for critical Apps

~50 ms

Initial session attach ~500 ms

Critical Parameters Values

Encryption support Desired in hardware

Control plane eventssec

~ 5000sec

User plane packet sec ~5 Million Packetsec

Packet size Varies ( typically 64 to 1500)

QoS classes to support different traffic types

gt5 (3GPP defines 9 classes)

httpssupportixiacomcomsitesdefaultfilesresourceswhitepapermobile-

broadband-networks-breakingpointpdf

VPC Inside Look

vPC Network ndash Internal network (Private L2

VLAN) interconnecting all VMs in an instance

2 CF VMs

act as 11

Up to 48 SF VMs User IO for service context ports Protocol

Signaling and Session Processing tasks

VPC VNF - Group of VMs acting as a single

manageable unit with single service address

Standby

VPC Networking

bull ManagementProvisioning also used for PXE booting servers

bull API network for Openstack (Best Practice)

bull Horizon Dashboard

bull Externally routable

bull Tenant Networks

bull VM to VM traffic

bull Uses VXLAN

bull Storage Network

bull Needed for optimal access to storage

Cisco Servers Profile

UCS B200 M4 Blade Servers

2 Intel Xeon processors EF-2680 v3 (or better)

12 cores per processor 24 cores per server

2 threads per core 24 threads per processor

16 strips of 16GB DDR4 RAM

Cisco 1340 VIC

Dual 20GE ports

Supports up to 256 vNICs

Supports SR-IOV

2 x 300 GB HDD

Per VM Server Requirements

CPU 8 to 24 vCPU

Memory 16 to 64GB RAM

NIC ~4 vNIC

Disk 16 GB vHDD (Min)

SR-IOV Yes

CPU Pinning Yes

Host Layout

Hardware

Cisco Servers (UCS) Cisco NFVI Installer Bare metal

Non-Cisco Servers Red Hat Openstack Director Bare metal

Host OS RHEL

Openstack OSP Cisco NFVi uses Docker

containers

VPC PerformanceHigh Availability amp Performance Optimizations

Performance Optimization

Huge Page

NUMA nodes

CPU Pinning

SR-IOV

Jumbo packets support

for Network (Internal communication)

High Availability

Single chassis (active and standby control

functionmodule

Multi-chassis (one control functionmodule per

chassis to accommodate chassis failure

Infrastructure

Multi-chassis

Geo-redundancya

BFD (Failure detection)

Application Level

Inter-chassis session recovery (stateful

redundancy)

Load balancing (ECMP using BGP

sessions over each SF)

Summary

Virtualization Benefits

Enable new uses cases

Improve TCO ndash CapexOpex

Virtualization Growing Trends

Mobile Packet Core

GiLAN services

C-RAN

5G Architecture

Key Learnings

Maturity and interoperability of VIM VNFM

Infrastructure Performance tuning need automation

Page 3: Summit 16: Deploying Virtualized Mobile Infrastructures on Openstack

Abstract

Mobile SP are transforming their existing purpose built-hardware based mobile packet core to virtualized NFV based solutions to reduce complexities and lower TCO The biggest challenge of decide right NFV technology which is SP grade agile and capable of scaling at lower cost We have put together SP grade NFV solution which is being trialed with large mobile operators The speaker will share their experience about design optimize and tune performance at NFV infrastructures and orchestration layers using technologies from Cisco (VNF Manager and NFVO) Redhat (NFVI) Openstack and block storage using CEPH technology Participants will be able to understand complexities of mobile packet core evolution NFV based solution which is framework for 5G mobile packet core

Agenda

Mobile Networks Characterization and Use Cases

Deploying Mobile Core on Virtualized Infrastructure

Summary

QampA

Mobile Network Changing Dynamics

Old Normal New Normal

User

Access

Services

Usage

Architecture

People

Homogeneous

Voice amp Data

Predictable

Static

People amp Things

Heterogeneous

Experiences

Unpredictable

Elastic

Introducing NFV in SP Network

Management and OrchestrationM

an

ag

em

en

t

Service Resource Control

VNFMVNFM VNFMVNFM

NFV Orchestration

Catalog Workflow

SystemMgmt

NetworkControl

ComputeControl

StorageControl

Virtual Infrastructure Manager

Data CenterIntelligent Transport AccessUser

Orchestrated Virtualized Infrastructure

VNF VNFVNFVNF

FuncFunc

Virtualized Infra

Storage

Compute

Network

VPC Solution Overview

ETSI GS NFV002 V111 (2013-10)

NFV ReferenceArchitectural Framework

Ciscoreg VNFM

Elastic Service Controller

(ESC)

Ciscoreg

Network Services Orchestrator

(NSO)

VIM

Ciscoreg UCS Nexus

Ciscoreg NFVI

GiLAN

VNF

PCRF

VNF

FW

VNF

Ciscoreg Element Manager

VPC

VNFhellip

How does it work

MME

S11Control Plane

GTP Demux

Session Manager

IP Address Manager

AAA Manager

Policy and Charging

AAA PCRF OCS

Diameter (Gx Gy S6b)

eNB

S1-C

User Plane Forwarder

S1-U

OpenFlow

SGiUE

Session Request

Profile Request

Policy RequestIP AddrRequestQuota

RequestProgram

UPF

SessionCreated

Dimensions of Workload Scale

CPU ndash Intel x86

IO

Memory

Video

Policy

Control

VM VM

VM

M2M

IOT

VoLT

E

Unified Fabric

SDN

Technologies

Virtualized Adapter

Industry Trend

Increased core countBig Data

Analytics

Detailed

Billing

High Density Blades

Session Disk Caching

Virtualization

Small Packets require

More IO capacity

M2M solutions require massive

amounts of sessions with

minimal throughput-

requiring additional memory

Operations like Deep Packet Inspection

Advanced Analytics Policy controlled sessions etc

Require additional CPU capacity

Mobile Packet Core Characteristics

Critical Parameters Values

Number of sessions ~ 1 to 10 Millions

Gateway total bandwidth ~ 10 to 100 Gbps

Bandwidthusers 10-50 Mbps

Packet loss ~ 1

Jitter 10 ndash 30 ms

Data Plane Latency for critical Apps

~50 ms

Initial session attach ~500 ms

Critical Parameters Values

Encryption support Desired in hardware

Control plane eventssec

~ 5000sec

User plane packet sec ~5 Million Packetsec

Packet size Varies ( typically 64 to 1500)

QoS classes to support different traffic types

gt5 (3GPP defines 9 classes)

httpssupportixiacomcomsitesdefaultfilesresourceswhitepapermobile-

broadband-networks-breakingpointpdf

VPC Inside Look

vPC Network ndash Internal network (Private L2

VLAN) interconnecting all VMs in an instance

2 CF VMs

act as 11

Up to 48 SF VMs User IO for service context ports Protocol

Signaling and Session Processing tasks

VPC VNF - Group of VMs acting as a single

manageable unit with single service address

Standby

VPC Networking

bull ManagementProvisioning also used for PXE booting servers

bull API network for Openstack (Best Practice)

bull Horizon Dashboard

bull Externally routable

bull Tenant Networks

bull VM to VM traffic

bull Uses VXLAN

bull Storage Network

bull Needed for optimal access to storage

Cisco Servers Profile

UCS B200 M4 Blade Servers

2 Intel Xeon processors EF-2680 v3 (or better)

12 cores per processor 24 cores per server

2 threads per core 24 threads per processor

16 strips of 16GB DDR4 RAM

Cisco 1340 VIC

Dual 20GE ports

Supports up to 256 vNICs

Supports SR-IOV

2 x 300 GB HDD

Per VM Server Requirements

CPU 8 to 24 vCPU

Memory 16 to 64GB RAM

NIC ~4 vNIC

Disk 16 GB vHDD (Min)

SR-IOV Yes

CPU Pinning Yes

Host Layout

Hardware

Cisco Servers (UCS) Cisco NFVI Installer Bare metal

Non-Cisco Servers Red Hat Openstack Director Bare metal

Host OS RHEL

Openstack OSP Cisco NFVi uses Docker

containers

VPC PerformanceHigh Availability amp Performance Optimizations

Performance Optimization

Huge Page

NUMA nodes

CPU Pinning

SR-IOV

Jumbo packets support

for Network (Internal communication)

High Availability

Single chassis (active and standby control

functionmodule

Multi-chassis (one control functionmodule per

chassis to accommodate chassis failure

Infrastructure

Multi-chassis

Geo-redundancya

BFD (Failure detection)

Application Level

Inter-chassis session recovery (stateful

redundancy)

Load balancing (ECMP using BGP

sessions over each SF)

Summary

Virtualization Benefits

Enable new uses cases

Improve TCO ndash CapexOpex

Virtualization Growing Trends

Mobile Packet Core

GiLAN services

C-RAN

5G Architecture

Key Learnings

Maturity and interoperability of VIM VNFM

Infrastructure Performance tuning need automation

Page 4: Summit 16: Deploying Virtualized Mobile Infrastructures on Openstack

Agenda

Mobile Networks Characterization and Use Cases

Deploying Mobile Core on Virtualized Infrastructure

Summary

QampA

Mobile Network Changing Dynamics

Old Normal New Normal

User

Access

Services

Usage

Architecture

People

Homogeneous

Voice amp Data

Predictable

Static

People amp Things

Heterogeneous

Experiences

Unpredictable

Elastic

Introducing NFV in SP Network

Management and OrchestrationM

an

ag

em

en

t

Service Resource Control

VNFMVNFM VNFMVNFM

NFV Orchestration

Catalog Workflow

SystemMgmt

NetworkControl

ComputeControl

StorageControl

Virtual Infrastructure Manager

Data CenterIntelligent Transport AccessUser

Orchestrated Virtualized Infrastructure

VNF VNFVNFVNF

FuncFunc

Virtualized Infra

Storage

Compute

Network

VPC Solution Overview

ETSI GS NFV002 V111 (2013-10)

NFV ReferenceArchitectural Framework

Ciscoreg VNFM

Elastic Service Controller

(ESC)

Ciscoreg

Network Services Orchestrator

(NSO)

VIM

Ciscoreg UCS Nexus

Ciscoreg NFVI

GiLAN

VNF

PCRF

VNF

FW

VNF

Ciscoreg Element Manager

VPC

VNFhellip

How does it work

MME

S11Control Plane

GTP Demux

Session Manager

IP Address Manager

AAA Manager

Policy and Charging

AAA PCRF OCS

Diameter (Gx Gy S6b)

eNB

S1-C

User Plane Forwarder

S1-U

OpenFlow

SGiUE

Session Request

Profile Request

Policy RequestIP AddrRequestQuota

RequestProgram

UPF

SessionCreated

Dimensions of Workload Scale

CPU ndash Intel x86

IO

Memory

Video

Policy

Control

VM VM

VM

M2M

IOT

VoLT

E

Unified Fabric

SDN

Technologies

Virtualized Adapter

Industry Trend

Increased core countBig Data

Analytics

Detailed

Billing

High Density Blades

Session Disk Caching

Virtualization

Small Packets require

More IO capacity

M2M solutions require massive

amounts of sessions with

minimal throughput-

requiring additional memory

Operations like Deep Packet Inspection

Advanced Analytics Policy controlled sessions etc

Require additional CPU capacity

Mobile Packet Core Characteristics

Critical Parameters Values

Number of sessions ~ 1 to 10 Millions

Gateway total bandwidth ~ 10 to 100 Gbps

Bandwidthusers 10-50 Mbps

Packet loss ~ 1

Jitter 10 ndash 30 ms

Data Plane Latency for critical Apps

~50 ms

Initial session attach ~500 ms

Critical Parameters Values

Encryption support Desired in hardware

Control plane eventssec

~ 5000sec

User plane packet sec ~5 Million Packetsec

Packet size Varies ( typically 64 to 1500)

QoS classes to support different traffic types

gt5 (3GPP defines 9 classes)

httpssupportixiacomcomsitesdefaultfilesresourceswhitepapermobile-

broadband-networks-breakingpointpdf

VPC Inside Look

vPC Network ndash Internal network (Private L2

VLAN) interconnecting all VMs in an instance

2 CF VMs

act as 11

Up to 48 SF VMs User IO for service context ports Protocol

Signaling and Session Processing tasks

VPC VNF - Group of VMs acting as a single

manageable unit with single service address

Standby

VPC Networking

bull ManagementProvisioning also used for PXE booting servers

bull API network for Openstack (Best Practice)

bull Horizon Dashboard

bull Externally routable

bull Tenant Networks

bull VM to VM traffic

bull Uses VXLAN

bull Storage Network

bull Needed for optimal access to storage

Cisco Servers Profile

UCS B200 M4 Blade Servers

2 Intel Xeon processors EF-2680 v3 (or better)

12 cores per processor 24 cores per server

2 threads per core 24 threads per processor

16 strips of 16GB DDR4 RAM

Cisco 1340 VIC

Dual 20GE ports

Supports up to 256 vNICs

Supports SR-IOV

2 x 300 GB HDD

Per VM Server Requirements

CPU 8 to 24 vCPU

Memory 16 to 64GB RAM

NIC ~4 vNIC

Disk 16 GB vHDD (Min)

SR-IOV Yes

CPU Pinning Yes

Host Layout

Hardware

Cisco Servers (UCS) Cisco NFVI Installer Bare metal

Non-Cisco Servers Red Hat Openstack Director Bare metal

Host OS RHEL

Openstack OSP Cisco NFVi uses Docker

containers

VPC PerformanceHigh Availability amp Performance Optimizations

Performance Optimization

Huge Page

NUMA nodes

CPU Pinning

SR-IOV

Jumbo packets support

for Network (Internal communication)

High Availability

Single chassis (active and standby control

functionmodule

Multi-chassis (one control functionmodule per

chassis to accommodate chassis failure

Infrastructure

Multi-chassis

Geo-redundancya

BFD (Failure detection)

Application Level

Inter-chassis session recovery (stateful

redundancy)

Load balancing (ECMP using BGP

sessions over each SF)

Summary

Virtualization Benefits

Enable new uses cases

Improve TCO ndash CapexOpex

Virtualization Growing Trends

Mobile Packet Core

GiLAN services

C-RAN

5G Architecture

Key Learnings

Maturity and interoperability of VIM VNFM

Infrastructure Performance tuning need automation

Page 5: Summit 16: Deploying Virtualized Mobile Infrastructures on Openstack

Mobile Network Changing Dynamics

Old Normal New Normal

User

Access

Services

Usage

Architecture

People

Homogeneous

Voice amp Data

Predictable

Static

People amp Things

Heterogeneous

Experiences

Unpredictable

Elastic

Introducing NFV in SP Network

Management and OrchestrationM

an

ag

em

en

t

Service Resource Control

VNFMVNFM VNFMVNFM

NFV Orchestration

Catalog Workflow

SystemMgmt

NetworkControl

ComputeControl

StorageControl

Virtual Infrastructure Manager

Data CenterIntelligent Transport AccessUser

Orchestrated Virtualized Infrastructure

VNF VNFVNFVNF

FuncFunc

Virtualized Infra

Storage

Compute

Network

VPC Solution Overview

ETSI GS NFV002 V111 (2013-10)

NFV ReferenceArchitectural Framework

Ciscoreg VNFM

Elastic Service Controller

(ESC)

Ciscoreg

Network Services Orchestrator

(NSO)

VIM

Ciscoreg UCS Nexus

Ciscoreg NFVI

GiLAN

VNF

PCRF

VNF

FW

VNF

Ciscoreg Element Manager

VPC

VNFhellip

How does it work

MME

S11Control Plane

GTP Demux

Session Manager

IP Address Manager

AAA Manager

Policy and Charging

AAA PCRF OCS

Diameter (Gx Gy S6b)

eNB

S1-C

User Plane Forwarder

S1-U

OpenFlow

SGiUE

Session Request

Profile Request

Policy RequestIP AddrRequestQuota

RequestProgram

UPF

SessionCreated

Dimensions of Workload Scale

CPU ndash Intel x86

IO

Memory

Video

Policy

Control

VM VM

VM

M2M

IOT

VoLT

E

Unified Fabric

SDN

Technologies

Virtualized Adapter

Industry Trend

Increased core countBig Data

Analytics

Detailed

Billing

High Density Blades

Session Disk Caching

Virtualization

Small Packets require

More IO capacity

M2M solutions require massive

amounts of sessions with

minimal throughput-

requiring additional memory

Operations like Deep Packet Inspection

Advanced Analytics Policy controlled sessions etc

Require additional CPU capacity

Mobile Packet Core Characteristics

Critical Parameters Values

Number of sessions ~ 1 to 10 Millions

Gateway total bandwidth ~ 10 to 100 Gbps

Bandwidthusers 10-50 Mbps

Packet loss ~ 1

Jitter 10 ndash 30 ms

Data Plane Latency for critical Apps

~50 ms

Initial session attach ~500 ms

Critical Parameters Values

Encryption support Desired in hardware

Control plane eventssec

~ 5000sec

User plane packet sec ~5 Million Packetsec

Packet size Varies ( typically 64 to 1500)

QoS classes to support different traffic types

gt5 (3GPP defines 9 classes)

httpssupportixiacomcomsitesdefaultfilesresourceswhitepapermobile-

broadband-networks-breakingpointpdf

VPC Inside Look

vPC Network ndash Internal network (Private L2

VLAN) interconnecting all VMs in an instance

2 CF VMs

act as 11

Up to 48 SF VMs User IO for service context ports Protocol

Signaling and Session Processing tasks

VPC VNF - Group of VMs acting as a single

manageable unit with single service address

Standby

VPC Networking

bull ManagementProvisioning also used for PXE booting servers

bull API network for Openstack (Best Practice)

bull Horizon Dashboard

bull Externally routable

bull Tenant Networks

bull VM to VM traffic

bull Uses VXLAN

bull Storage Network

bull Needed for optimal access to storage

Cisco Servers Profile

UCS B200 M4 Blade Servers

2 Intel Xeon processors EF-2680 v3 (or better)

12 cores per processor 24 cores per server

2 threads per core 24 threads per processor

16 strips of 16GB DDR4 RAM

Cisco 1340 VIC

Dual 20GE ports

Supports up to 256 vNICs

Supports SR-IOV

2 x 300 GB HDD

Per VM Server Requirements

CPU 8 to 24 vCPU

Memory 16 to 64GB RAM

NIC ~4 vNIC

Disk 16 GB vHDD (Min)

SR-IOV Yes

CPU Pinning Yes

Host Layout

Hardware

Cisco Servers (UCS) Cisco NFVI Installer Bare metal

Non-Cisco Servers Red Hat Openstack Director Bare metal

Host OS RHEL

Openstack OSP Cisco NFVi uses Docker

containers

VPC PerformanceHigh Availability amp Performance Optimizations

Performance Optimization

Huge Page

NUMA nodes

CPU Pinning

SR-IOV

Jumbo packets support

for Network (Internal communication)

High Availability

Single chassis (active and standby control

functionmodule

Multi-chassis (one control functionmodule per

chassis to accommodate chassis failure

Infrastructure

Multi-chassis

Geo-redundancya

BFD (Failure detection)

Application Level

Inter-chassis session recovery (stateful

redundancy)

Load balancing (ECMP using BGP

sessions over each SF)

Summary

Virtualization Benefits

Enable new uses cases

Improve TCO ndash CapexOpex

Virtualization Growing Trends

Mobile Packet Core

GiLAN services

C-RAN

5G Architecture

Key Learnings

Maturity and interoperability of VIM VNFM

Infrastructure Performance tuning need automation

Page 6: Summit 16: Deploying Virtualized Mobile Infrastructures on Openstack

Introducing NFV in SP Network

Management and OrchestrationM

an

ag

em

en

t

Service Resource Control

VNFMVNFM VNFMVNFM

NFV Orchestration

Catalog Workflow

SystemMgmt

NetworkControl

ComputeControl

StorageControl

Virtual Infrastructure Manager

Data CenterIntelligent Transport AccessUser

Orchestrated Virtualized Infrastructure

VNF VNFVNFVNF

FuncFunc

Virtualized Infra

Storage

Compute

Network

VPC Solution Overview

ETSI GS NFV002 V111 (2013-10)

NFV ReferenceArchitectural Framework

Ciscoreg VNFM

Elastic Service Controller

(ESC)

Ciscoreg

Network Services Orchestrator

(NSO)

VIM

Ciscoreg UCS Nexus

Ciscoreg NFVI

GiLAN

VNF

PCRF

VNF

FW

VNF

Ciscoreg Element Manager

VPC

VNFhellip

How does it work

MME

S11Control Plane

GTP Demux

Session Manager

IP Address Manager

AAA Manager

Policy and Charging

AAA PCRF OCS

Diameter (Gx Gy S6b)

eNB

S1-C

User Plane Forwarder

S1-U

OpenFlow

SGiUE

Session Request

Profile Request

Policy RequestIP AddrRequestQuota

RequestProgram

UPF

SessionCreated

Dimensions of Workload Scale

CPU ndash Intel x86

IO

Memory

Video

Policy

Control

VM VM

VM

M2M

IOT

VoLT

E

Unified Fabric

SDN

Technologies

Virtualized Adapter

Industry Trend

Increased core countBig Data

Analytics

Detailed

Billing

High Density Blades

Session Disk Caching

Virtualization

Small Packets require

More IO capacity

M2M solutions require massive

amounts of sessions with

minimal throughput-

requiring additional memory

Operations like Deep Packet Inspection

Advanced Analytics Policy controlled sessions etc

Require additional CPU capacity

Mobile Packet Core Characteristics

Critical Parameters Values

Number of sessions ~ 1 to 10 Millions

Gateway total bandwidth ~ 10 to 100 Gbps

Bandwidthusers 10-50 Mbps

Packet loss ~ 1

Jitter 10 ndash 30 ms

Data Plane Latency for critical Apps

~50 ms

Initial session attach ~500 ms

Critical Parameters Values

Encryption support Desired in hardware

Control plane eventssec

~ 5000sec

User plane packet sec ~5 Million Packetsec

Packet size Varies ( typically 64 to 1500)

QoS classes to support different traffic types

gt5 (3GPP defines 9 classes)

httpssupportixiacomcomsitesdefaultfilesresourceswhitepapermobile-

broadband-networks-breakingpointpdf

VPC Inside Look

vPC Network ndash Internal network (Private L2

VLAN) interconnecting all VMs in an instance

2 CF VMs

act as 11

Up to 48 SF VMs User IO for service context ports Protocol

Signaling and Session Processing tasks

VPC VNF - Group of VMs acting as a single

manageable unit with single service address

Standby

VPC Networking

bull ManagementProvisioning also used for PXE booting servers

bull API network for Openstack (Best Practice)

bull Horizon Dashboard

bull Externally routable

bull Tenant Networks

bull VM to VM traffic

bull Uses VXLAN

bull Storage Network

bull Needed for optimal access to storage

Cisco Servers Profile

UCS B200 M4 Blade Servers

2 Intel Xeon processors EF-2680 v3 (or better)

12 cores per processor 24 cores per server

2 threads per core 24 threads per processor

16 strips of 16GB DDR4 RAM

Cisco 1340 VIC

Dual 20GE ports

Supports up to 256 vNICs

Supports SR-IOV

2 x 300 GB HDD

Per VM Server Requirements

CPU 8 to 24 vCPU

Memory 16 to 64GB RAM

NIC ~4 vNIC

Disk 16 GB vHDD (Min)

SR-IOV Yes

CPU Pinning Yes

Host Layout

Hardware

Cisco Servers (UCS) Cisco NFVI Installer Bare metal

Non-Cisco Servers Red Hat Openstack Director Bare metal

Host OS RHEL

Openstack OSP Cisco NFVi uses Docker

containers

VPC PerformanceHigh Availability amp Performance Optimizations

Performance Optimization

Huge Page

NUMA nodes

CPU Pinning

SR-IOV

Jumbo packets support

for Network (Internal communication)

High Availability

Single chassis (active and standby control

functionmodule

Multi-chassis (one control functionmodule per

chassis to accommodate chassis failure

Infrastructure

Multi-chassis

Geo-redundancya

BFD (Failure detection)

Application Level

Inter-chassis session recovery (stateful

redundancy)

Load balancing (ECMP using BGP

sessions over each SF)

Summary

Virtualization Benefits

Enable new uses cases

Improve TCO ndash CapexOpex

Virtualization Growing Trends

Mobile Packet Core

GiLAN services

C-RAN

5G Architecture

Key Learnings

Maturity and interoperability of VIM VNFM

Infrastructure Performance tuning need automation

Page 7: Summit 16: Deploying Virtualized Mobile Infrastructures on Openstack

VPC Solution Overview

ETSI GS NFV002 V111 (2013-10)

NFV ReferenceArchitectural Framework

Ciscoreg VNFM

Elastic Service Controller

(ESC)

Ciscoreg

Network Services Orchestrator

(NSO)

VIM

Ciscoreg UCS Nexus

Ciscoreg NFVI

GiLAN

VNF

PCRF

VNF

FW

VNF

Ciscoreg Element Manager

VPC

VNFhellip

How does it work

MME

S11Control Plane

GTP Demux

Session Manager

IP Address Manager

AAA Manager

Policy and Charging

AAA PCRF OCS

Diameter (Gx Gy S6b)

eNB

S1-C

User Plane Forwarder

S1-U

OpenFlow

SGiUE

Session Request

Profile Request

Policy RequestIP AddrRequestQuota

RequestProgram

UPF

SessionCreated

Dimensions of Workload Scale

CPU ndash Intel x86

IO

Memory

Video

Policy

Control

VM VM

VM

M2M

IOT

VoLT

E

Unified Fabric

SDN

Technologies

Virtualized Adapter

Industry Trend

Increased core countBig Data

Analytics

Detailed

Billing

High Density Blades

Session Disk Caching

Virtualization

Small Packets require

More IO capacity

M2M solutions require massive

amounts of sessions with

minimal throughput-

requiring additional memory

Operations like Deep Packet Inspection

Advanced Analytics Policy controlled sessions etc

Require additional CPU capacity

Mobile Packet Core Characteristics

Critical Parameters Values

Number of sessions ~ 1 to 10 Millions

Gateway total bandwidth ~ 10 to 100 Gbps

Bandwidthusers 10-50 Mbps

Packet loss ~ 1

Jitter 10 ndash 30 ms

Data Plane Latency for critical Apps

~50 ms

Initial session attach ~500 ms

Critical Parameters Values

Encryption support Desired in hardware

Control plane eventssec

~ 5000sec

User plane packet sec ~5 Million Packetsec

Packet size Varies ( typically 64 to 1500)

QoS classes to support different traffic types

gt5 (3GPP defines 9 classes)

httpssupportixiacomcomsitesdefaultfilesresourceswhitepapermobile-

broadband-networks-breakingpointpdf

VPC Inside Look

vPC Network ndash Internal network (Private L2

VLAN) interconnecting all VMs in an instance

2 CF VMs

act as 11

Up to 48 SF VMs User IO for service context ports Protocol

Signaling and Session Processing tasks

VPC VNF - Group of VMs acting as a single

manageable unit with single service address

Standby

VPC Networking

bull ManagementProvisioning also used for PXE booting servers

bull API network for Openstack (Best Practice)

bull Horizon Dashboard

bull Externally routable

bull Tenant Networks

bull VM to VM traffic

bull Uses VXLAN

bull Storage Network

bull Needed for optimal access to storage

Cisco Servers Profile

UCS B200 M4 Blade Servers

2 Intel Xeon processors EF-2680 v3 (or better)

12 cores per processor 24 cores per server

2 threads per core 24 threads per processor

16 strips of 16GB DDR4 RAM

Cisco 1340 VIC

Dual 20GE ports

Supports up to 256 vNICs

Supports SR-IOV

2 x 300 GB HDD

Per VM Server Requirements

CPU 8 to 24 vCPU

Memory 16 to 64GB RAM

NIC ~4 vNIC

Disk 16 GB vHDD (Min)

SR-IOV Yes

CPU Pinning Yes

Host Layout

Hardware

Cisco Servers (UCS) Cisco NFVI Installer Bare metal

Non-Cisco Servers Red Hat Openstack Director Bare metal

Host OS RHEL

Openstack OSP Cisco NFVi uses Docker

containers

VPC PerformanceHigh Availability amp Performance Optimizations

Performance Optimization

Huge Page

NUMA nodes

CPU Pinning

SR-IOV

Jumbo packets support

for Network (Internal communication)

High Availability

Single chassis (active and standby control

functionmodule

Multi-chassis (one control functionmodule per

chassis to accommodate chassis failure

Infrastructure

Multi-chassis

Geo-redundancya

BFD (Failure detection)

Application Level

Inter-chassis session recovery (stateful

redundancy)

Load balancing (ECMP using BGP

sessions over each SF)

Summary

Virtualization Benefits

Enable new uses cases

Improve TCO ndash CapexOpex

Virtualization Growing Trends

Mobile Packet Core

GiLAN services

C-RAN

5G Architecture

Key Learnings

Maturity and interoperability of VIM VNFM

Infrastructure Performance tuning need automation

Page 8: Summit 16: Deploying Virtualized Mobile Infrastructures on Openstack

How does it work

MME

S11Control Plane

GTP Demux

Session Manager

IP Address Manager

AAA Manager

Policy and Charging

AAA PCRF OCS

Diameter (Gx Gy S6b)

eNB

S1-C

User Plane Forwarder

S1-U

OpenFlow

SGiUE

Session Request

Profile Request

Policy RequestIP AddrRequestQuota

RequestProgram

UPF

SessionCreated

Dimensions of Workload Scale

CPU ndash Intel x86

IO

Memory

Video

Policy

Control

VM VM

VM

M2M

IOT

VoLT

E

Unified Fabric

SDN

Technologies

Virtualized Adapter

Industry Trend

Increased core countBig Data

Analytics

Detailed

Billing

High Density Blades

Session Disk Caching

Virtualization

Small Packets require

More IO capacity

M2M solutions require massive

amounts of sessions with

minimal throughput-

requiring additional memory

Operations like Deep Packet Inspection

Advanced Analytics Policy controlled sessions etc

Require additional CPU capacity

Mobile Packet Core Characteristics

Critical Parameters Values

Number of sessions ~ 1 to 10 Millions

Gateway total bandwidth ~ 10 to 100 Gbps

Bandwidthusers 10-50 Mbps

Packet loss ~ 1

Jitter 10 ndash 30 ms

Data Plane Latency for critical Apps

~50 ms

Initial session attach ~500 ms

Critical Parameters Values

Encryption support Desired in hardware

Control plane eventssec

~ 5000sec

User plane packet sec ~5 Million Packetsec

Packet size Varies ( typically 64 to 1500)

QoS classes to support different traffic types

gt5 (3GPP defines 9 classes)

httpssupportixiacomcomsitesdefaultfilesresourceswhitepapermobile-

broadband-networks-breakingpointpdf

VPC Inside Look

vPC Network ndash Internal network (Private L2

VLAN) interconnecting all VMs in an instance

2 CF VMs

act as 11

Up to 48 SF VMs User IO for service context ports Protocol

Signaling and Session Processing tasks

VPC VNF - Group of VMs acting as a single

manageable unit with single service address

Standby

VPC Networking

bull ManagementProvisioning also used for PXE booting servers

bull API network for Openstack (Best Practice)

bull Horizon Dashboard

bull Externally routable

bull Tenant Networks

bull VM to VM traffic

bull Uses VXLAN

bull Storage Network

bull Needed for optimal access to storage

Cisco Servers Profile

UCS B200 M4 Blade Servers

2 Intel Xeon processors EF-2680 v3 (or better)

12 cores per processor 24 cores per server

2 threads per core 24 threads per processor

16 strips of 16GB DDR4 RAM

Cisco 1340 VIC

Dual 20GE ports

Supports up to 256 vNICs

Supports SR-IOV

2 x 300 GB HDD

Per VM Server Requirements

CPU 8 to 24 vCPU

Memory 16 to 64GB RAM

NIC ~4 vNIC

Disk 16 GB vHDD (Min)

SR-IOV Yes

CPU Pinning Yes

Host Layout

Hardware

Cisco Servers (UCS) Cisco NFVI Installer Bare metal

Non-Cisco Servers Red Hat Openstack Director Bare metal

Host OS RHEL

Openstack OSP Cisco NFVi uses Docker

containers

VPC PerformanceHigh Availability amp Performance Optimizations

Performance Optimization

Huge Page

NUMA nodes

CPU Pinning

SR-IOV

Jumbo packets support

for Network (Internal communication)

High Availability

Single chassis (active and standby control

functionmodule

Multi-chassis (one control functionmodule per

chassis to accommodate chassis failure

Infrastructure

Multi-chassis

Geo-redundancya

BFD (Failure detection)

Application Level

Inter-chassis session recovery (stateful

redundancy)

Load balancing (ECMP using BGP

sessions over each SF)

Summary

Virtualization Benefits

Enable new uses cases

Improve TCO ndash CapexOpex

Virtualization Growing Trends

Mobile Packet Core

GiLAN services

C-RAN

5G Architecture

Key Learnings

Maturity and interoperability of VIM VNFM

Infrastructure Performance tuning need automation

Page 9: Summit 16: Deploying Virtualized Mobile Infrastructures on Openstack

Dimensions of Workload Scale

CPU ndash Intel x86

IO

Memory

Video

Policy

Control

VM VM

VM

M2M

IOT

VoLT

E

Unified Fabric

SDN

Technologies

Virtualized Adapter

Industry Trend

Increased core countBig Data

Analytics

Detailed

Billing

High Density Blades

Session Disk Caching

Virtualization

Small Packets require

More IO capacity

M2M solutions require massive

amounts of sessions with

minimal throughput-

requiring additional memory

Operations like Deep Packet Inspection

Advanced Analytics Policy controlled sessions etc

Require additional CPU capacity

Mobile Packet Core Characteristics

Critical Parameters Values

Number of sessions ~ 1 to 10 Millions

Gateway total bandwidth ~ 10 to 100 Gbps

Bandwidthusers 10-50 Mbps

Packet loss ~ 1

Jitter 10 ndash 30 ms

Data Plane Latency for critical Apps

~50 ms

Initial session attach ~500 ms

Critical Parameters Values

Encryption support Desired in hardware

Control plane eventssec

~ 5000sec

User plane packet sec ~5 Million Packetsec

Packet size Varies ( typically 64 to 1500)

QoS classes to support different traffic types

gt5 (3GPP defines 9 classes)

httpssupportixiacomcomsitesdefaultfilesresourceswhitepapermobile-

broadband-networks-breakingpointpdf

VPC Inside Look

vPC Network ndash Internal network (Private L2

VLAN) interconnecting all VMs in an instance

2 CF VMs

act as 11

Up to 48 SF VMs User IO for service context ports Protocol

Signaling and Session Processing tasks

VPC VNF - Group of VMs acting as a single

manageable unit with single service address

Standby

VPC Networking

bull ManagementProvisioning also used for PXE booting servers

bull API network for Openstack (Best Practice)

bull Horizon Dashboard

bull Externally routable

bull Tenant Networks

bull VM to VM traffic

bull Uses VXLAN

bull Storage Network

bull Needed for optimal access to storage

Cisco Servers Profile

UCS B200 M4 Blade Servers

2 Intel Xeon processors EF-2680 v3 (or better)

12 cores per processor 24 cores per server

2 threads per core 24 threads per processor

16 strips of 16GB DDR4 RAM

Cisco 1340 VIC

Dual 20GE ports

Supports up to 256 vNICs

Supports SR-IOV

2 x 300 GB HDD

Per VM Server Requirements

CPU 8 to 24 vCPU

Memory 16 to 64GB RAM

NIC ~4 vNIC

Disk 16 GB vHDD (Min)

SR-IOV Yes

CPU Pinning Yes

Host Layout

Hardware

Cisco Servers (UCS) Cisco NFVI Installer Bare metal

Non-Cisco Servers Red Hat Openstack Director Bare metal

Host OS RHEL

Openstack OSP Cisco NFVi uses Docker

containers

VPC PerformanceHigh Availability amp Performance Optimizations

Performance Optimization

Huge Page

NUMA nodes

CPU Pinning

SR-IOV

Jumbo packets support

for Network (Internal communication)

High Availability

Single chassis (active and standby control

functionmodule

Multi-chassis (one control functionmodule per

chassis to accommodate chassis failure

Infrastructure

Multi-chassis

Geo-redundancya

BFD (Failure detection)

Application Level

Inter-chassis session recovery (stateful

redundancy)

Load balancing (ECMP using BGP

sessions over each SF)

Summary

Virtualization Benefits

Enable new uses cases

Improve TCO ndash CapexOpex

Virtualization Growing Trends

Mobile Packet Core

GiLAN services

C-RAN

5G Architecture

Key Learnings

Maturity and interoperability of VIM VNFM

Infrastructure Performance tuning need automation

Page 10: Summit 16: Deploying Virtualized Mobile Infrastructures on Openstack

Mobile Packet Core Characteristics

Critical Parameters Values

Number of sessions ~ 1 to 10 Millions

Gateway total bandwidth ~ 10 to 100 Gbps

Bandwidthusers 10-50 Mbps

Packet loss ~ 1

Jitter 10 ndash 30 ms

Data Plane Latency for critical Apps

~50 ms

Initial session attach ~500 ms

Critical Parameters Values

Encryption support Desired in hardware

Control plane eventssec

~ 5000sec

User plane packet sec ~5 Million Packetsec

Packet size Varies ( typically 64 to 1500)

QoS classes to support different traffic types

gt5 (3GPP defines 9 classes)

httpssupportixiacomcomsitesdefaultfilesresourceswhitepapermobile-

broadband-networks-breakingpointpdf

VPC Inside Look

vPC Network ndash Internal network (Private L2

VLAN) interconnecting all VMs in an instance

2 CF VMs

act as 11

Up to 48 SF VMs User IO for service context ports Protocol

Signaling and Session Processing tasks

VPC VNF - Group of VMs acting as a single

manageable unit with single service address

Standby

VPC Networking

bull ManagementProvisioning also used for PXE booting servers

bull API network for Openstack (Best Practice)

bull Horizon Dashboard

bull Externally routable

bull Tenant Networks

bull VM to VM traffic

bull Uses VXLAN

bull Storage Network

bull Needed for optimal access to storage

Cisco Servers Profile

UCS B200 M4 Blade Servers

2 Intel Xeon processors EF-2680 v3 (or better)

12 cores per processor 24 cores per server

2 threads per core 24 threads per processor

16 strips of 16GB DDR4 RAM

Cisco 1340 VIC

Dual 20GE ports

Supports up to 256 vNICs

Supports SR-IOV

2 x 300 GB HDD

Per VM Server Requirements

CPU 8 to 24 vCPU

Memory 16 to 64GB RAM

NIC ~4 vNIC

Disk 16 GB vHDD (Min)

SR-IOV Yes

CPU Pinning Yes

Host Layout

Hardware

Cisco Servers (UCS) Cisco NFVI Installer Bare metal

Non-Cisco Servers Red Hat Openstack Director Bare metal

Host OS RHEL

Openstack OSP Cisco NFVi uses Docker

containers

VPC PerformanceHigh Availability amp Performance Optimizations

Performance Optimization

Huge Page

NUMA nodes

CPU Pinning

SR-IOV

Jumbo packets support

for Network (Internal communication)

High Availability

Single chassis (active and standby control

functionmodule

Multi-chassis (one control functionmodule per

chassis to accommodate chassis failure

Infrastructure

Multi-chassis

Geo-redundancya

BFD (Failure detection)

Application Level

Inter-chassis session recovery (stateful

redundancy)

Load balancing (ECMP using BGP

sessions over each SF)

Summary

Virtualization Benefits

Enable new uses cases

Improve TCO ndash CapexOpex

Virtualization Growing Trends

Mobile Packet Core

GiLAN services

C-RAN

5G Architecture

Key Learnings

Maturity and interoperability of VIM VNFM

Infrastructure Performance tuning need automation

Page 11: Summit 16: Deploying Virtualized Mobile Infrastructures on Openstack

VPC Inside Look

vPC Network ndash Internal network (Private L2

VLAN) interconnecting all VMs in an instance

2 CF VMs

act as 11

Up to 48 SF VMs User IO for service context ports Protocol

Signaling and Session Processing tasks

VPC VNF - Group of VMs acting as a single

manageable unit with single service address

Standby

VPC Networking

bull ManagementProvisioning also used for PXE booting servers

bull API network for Openstack (Best Practice)

bull Horizon Dashboard

bull Externally routable

bull Tenant Networks

bull VM to VM traffic

bull Uses VXLAN

bull Storage Network

bull Needed for optimal access to storage

Cisco Servers Profile

UCS B200 M4 Blade Servers

2 Intel Xeon processors EF-2680 v3 (or better)

12 cores per processor 24 cores per server

2 threads per core 24 threads per processor

16 strips of 16GB DDR4 RAM

Cisco 1340 VIC

Dual 20GE ports

Supports up to 256 vNICs

Supports SR-IOV

2 x 300 GB HDD

Per VM Server Requirements

CPU 8 to 24 vCPU

Memory 16 to 64GB RAM

NIC ~4 vNIC

Disk 16 GB vHDD (Min)

SR-IOV Yes

CPU Pinning Yes

Host Layout

Hardware

Cisco Servers (UCS) Cisco NFVI Installer Bare metal

Non-Cisco Servers Red Hat Openstack Director Bare metal

Host OS RHEL

Openstack OSP Cisco NFVi uses Docker

containers

VPC PerformanceHigh Availability amp Performance Optimizations

Performance Optimization

Huge Page

NUMA nodes

CPU Pinning

SR-IOV

Jumbo packets support

for Network (Internal communication)

High Availability

Single chassis (active and standby control

functionmodule

Multi-chassis (one control functionmodule per

chassis to accommodate chassis failure

Infrastructure

Multi-chassis

Geo-redundancya

BFD (Failure detection)

Application Level

Inter-chassis session recovery (stateful

redundancy)

Load balancing (ECMP using BGP

sessions over each SF)

Summary

Virtualization Benefits

Enable new uses cases

Improve TCO ndash CapexOpex

Virtualization Growing Trends

Mobile Packet Core

GiLAN services

C-RAN

5G Architecture

Key Learnings

Maturity and interoperability of VIM VNFM

Infrastructure Performance tuning need automation

Page 12: Summit 16: Deploying Virtualized Mobile Infrastructures on Openstack

VPC Networking

bull ManagementProvisioning also used for PXE booting servers

bull API network for Openstack (Best Practice)

bull Horizon Dashboard

bull Externally routable

bull Tenant Networks

bull VM to VM traffic

bull Uses VXLAN

bull Storage Network

bull Needed for optimal access to storage

Cisco Servers Profile

UCS B200 M4 Blade Servers

2 Intel Xeon processors EF-2680 v3 (or better)

12 cores per processor 24 cores per server

2 threads per core 24 threads per processor

16 strips of 16GB DDR4 RAM

Cisco 1340 VIC

Dual 20GE ports

Supports up to 256 vNICs

Supports SR-IOV

2 x 300 GB HDD

Per VM Server Requirements

CPU 8 to 24 vCPU

Memory 16 to 64GB RAM

NIC ~4 vNIC

Disk 16 GB vHDD (Min)

SR-IOV Yes

CPU Pinning Yes

Host Layout

Hardware

Cisco Servers (UCS) Cisco NFVI Installer Bare metal

Non-Cisco Servers Red Hat Openstack Director Bare metal

Host OS RHEL

Openstack OSP Cisco NFVi uses Docker

containers

VPC PerformanceHigh Availability amp Performance Optimizations

Performance Optimization

Huge Page

NUMA nodes

CPU Pinning

SR-IOV

Jumbo packets support

for Network (Internal communication)

High Availability

Single chassis (active and standby control

functionmodule

Multi-chassis (one control functionmodule per

chassis to accommodate chassis failure

Infrastructure

Multi-chassis

Geo-redundancya

BFD (Failure detection)

Application Level

Inter-chassis session recovery (stateful

redundancy)

Load balancing (ECMP using BGP

sessions over each SF)

Summary

Virtualization Benefits

Enable new uses cases

Improve TCO ndash CapexOpex

Virtualization Growing Trends

Mobile Packet Core

GiLAN services

C-RAN

5G Architecture

Key Learnings

Maturity and interoperability of VIM VNFM

Infrastructure Performance tuning need automation

Page 13: Summit 16: Deploying Virtualized Mobile Infrastructures on Openstack

Cisco Servers Profile

UCS B200 M4 Blade Servers

2 Intel Xeon processors EF-2680 v3 (or better)

12 cores per processor 24 cores per server

2 threads per core 24 threads per processor

16 strips of 16GB DDR4 RAM

Cisco 1340 VIC

Dual 20GE ports

Supports up to 256 vNICs

Supports SR-IOV

2 x 300 GB HDD

Per VM Server Requirements

CPU 8 to 24 vCPU

Memory 16 to 64GB RAM

NIC ~4 vNIC

Disk 16 GB vHDD (Min)

SR-IOV Yes

CPU Pinning Yes

Host Layout

Hardware

Cisco Servers (UCS) Cisco NFVI Installer Bare metal

Non-Cisco Servers Red Hat Openstack Director Bare metal

Host OS RHEL

Openstack OSP Cisco NFVi uses Docker

containers

VPC PerformanceHigh Availability amp Performance Optimizations

Performance Optimization

Huge Page

NUMA nodes

CPU Pinning

SR-IOV

Jumbo packets support

for Network (Internal communication)

High Availability

Single chassis (active and standby control

functionmodule

Multi-chassis (one control functionmodule per

chassis to accommodate chassis failure

Infrastructure

Multi-chassis

Geo-redundancya

BFD (Failure detection)

Application Level

Inter-chassis session recovery (stateful

redundancy)

Load balancing (ECMP using BGP

sessions over each SF)

Summary

Virtualization Benefits

Enable new uses cases

Improve TCO ndash CapexOpex

Virtualization Growing Trends

Mobile Packet Core

GiLAN services

C-RAN

5G Architecture

Key Learnings

Maturity and interoperability of VIM VNFM

Infrastructure Performance tuning need automation

Page 14: Summit 16: Deploying Virtualized Mobile Infrastructures on Openstack

Host Layout

Hardware

Cisco Servers (UCS) Cisco NFVI Installer Bare metal

Non-Cisco Servers Red Hat Openstack Director Bare metal

Host OS RHEL

Openstack OSP Cisco NFVi uses Docker

containers

VPC PerformanceHigh Availability amp Performance Optimizations

Performance Optimization

Huge Page

NUMA nodes

CPU Pinning

SR-IOV

Jumbo packets support

for Network (Internal communication)

High Availability

Single chassis (active and standby control

functionmodule

Multi-chassis (one control functionmodule per

chassis to accommodate chassis failure

Infrastructure

Multi-chassis

Geo-redundancya

BFD (Failure detection)

Application Level

Inter-chassis session recovery (stateful

redundancy)

Load balancing (ECMP using BGP

sessions over each SF)

Summary

Virtualization Benefits

Enable new uses cases

Improve TCO ndash CapexOpex

Virtualization Growing Trends

Mobile Packet Core

GiLAN services

C-RAN

5G Architecture

Key Learnings

Maturity and interoperability of VIM VNFM

Infrastructure Performance tuning need automation

Page 15: Summit 16: Deploying Virtualized Mobile Infrastructures on Openstack

VPC PerformanceHigh Availability amp Performance Optimizations

Performance Optimization

Huge Page

NUMA nodes

CPU Pinning

SR-IOV

Jumbo packets support

for Network (Internal communication)

High Availability

Single chassis (active and standby control

functionmodule

Multi-chassis (one control functionmodule per

chassis to accommodate chassis failure

Infrastructure

Multi-chassis

Geo-redundancya

BFD (Failure detection)

Application Level

Inter-chassis session recovery (stateful

redundancy)

Load balancing (ECMP using BGP

sessions over each SF)

Summary

Virtualization Benefits

Enable new uses cases

Improve TCO ndash CapexOpex

Virtualization Growing Trends

Mobile Packet Core

GiLAN services

C-RAN

5G Architecture

Key Learnings

Maturity and interoperability of VIM VNFM

Infrastructure Performance tuning need automation

Page 16: Summit 16: Deploying Virtualized Mobile Infrastructures on Openstack

Summary

Virtualization Benefits

Enable new uses cases

Improve TCO ndash CapexOpex

Virtualization Growing Trends

Mobile Packet Core

GiLAN services

C-RAN

5G Architecture

Key Learnings

Maturity and interoperability of VIM VNFM

Infrastructure Performance tuning need automation