Shared networks to support VNF high availability across OpenStack multi-region deployment

Shared Networks to Support VNF

High Availability Across OpenStack

Multi Region Deployment

Speakers

Chaoyi Huang

OpenStack Tricircle PTL:

https://wiki.openstack.org/wiki/Tricircle

OPNFV Multisite PTL:

https://wiki.opnfv.org/display/multisite/

Multisite

Valentin Boucher

OPNFV Functest committer:

https://wiki.opnfv.org/display/functest

OPNFV Multisite committer:

https://wiki.opnfv.org/display/multisite

Vikram Dham

OPNFV OVN4NFV PTL:

https://wiki.opnfv.org/display/PROJ/Ov

OPNFV Multisite Committer:

https://wiki.opnfv.org/display/multisite/

Multisite

Agenda

Lab introduction

Video Conference in multisite

vIMS in multisite

How Tricricle help the networking

Lab introduction

Laptop Laptop

BeiJing

LangFang

DongGuang

Huawei Cloud Open Lab

Lab introduction ( Chaoyi )

LangFang

BeiJing

OpenStack

RegionOne

OpenStack

RegionThree

OpenStack

RegionTwo

JITSI TricirclevIMS

Mixed release environment

Tricricle + Neutron Server: Pike release

Three OpenStack clouds: Newton release

Multiparty Video Conference VNF

Multiparty Video Conference architecture

Jitsi Demo - Architecture

Why TriCircle for Jitsi?

Secure logical L2 private network between Jitsi Controller and Jitsi Video Bridges

Multisite Jitsi Deployment using TriCircle

vIMS - Software Architecture

MetaSwitch Clearwater

IMS architecture before

May 2017

vIMS - Demo Architecture

vIMS - Network Architecture+-----------------------+ +-----------------------+ +----------------------+

| +-------+ | | +-------+ | | +--+---+ |

| +---+---+ | | +---+---+ | | +----+--+ |

| | R1 | | | | R2 | | | | R3 | |

| +--+----+ | | +--+----+ | | +--+----+ |

| | net1 | | | net2 | | net3 | |

| +---+--+---+-+ | | +---+--+---+-+ | | ++-----+--+---+ |

| | | | | | | | | | | |

| +---------+-+ | | | +---------+-+ | | | | +--+--------+ |

| +-----------+ | | | +-----------+ | | | | +-----------+ |

| +----+--+ | | +----+--+ | | +-+-----+ |

| | R4(1) | | | | R4(2) | | | | R4(3) | |

| +-----+-+ | | +---+---+ | | +----+--+ |

| | | | | | | | |

+-----------------------+ +-----------------------+ +----------------------+

| bridge-net | |

+------------------------+------------------+

vIMS - Limitation & Evolution

Limitation :

VNF support only 2 sites for the moment

No HA for MANO component in the demo (but cloudify 4.0 support HA)

Possible next steps :

Support multisite into Functest/cloudify_ims test-case

Support multisite/tricircle in ONAP

Neutron Server

Tricircle

Nova Cinder Neutron Server

OpenStack(Region One)

Cinder Nova

OpenStack(Region Two)

Tricircle Central

Neutron Plugin

Tricircle Local

Neutron PluginReal Core Plugin

Neutron Server

Tricircle Local

Create cross Neutron logical network

topology through central Neutron1

Neutron Server

Tricircle

Cinder Nova

Tricircle Central

Neutron Plugin

Tricircle Local

Neutron Server

Tricircle Local

Boot VM

in Nova2

Boot VM

in Nova2

Neutron Server

Tricircle

Cinder Nova

Tricircle Central

Neutron Plugin

Tricircle Local

Neutron Server

Tricircle Local

Boot VM

in Nova2

Boot VM

in Nova2

33 Attach network Attach network

Neutron Server

Tricircle

Cinder Nova

Tricircle Central

Neutron Plugin

Tricircle Local

Neutron Server

Tricircle Local

Trigger networking

automationTrigger networking

automation4 4

Neutron Server

Tricircle

Cinder Nova

Tricircle Central

Neutron Plugin

Tricircle Local

Neutron Server

Tricircle Local

Cross Neutron

networking automation

Cross Neutron

networking automation

● Long duration networking automation job will be done by XJOB asynchronously

● Different SDN controller could be integrated as Neutron backend as ML2 driver or core plugin

L2 networking -

Shadow Port, Shadow Agent, ARP Proxy

Shadow

Host1Host2

Port1’s VTEP

Port2’s VTEP

Port1’s VTEP

Shadow Port: a virtual object to represent a port in another cloud

Shadow Agent: a virtual object to represent VTEP of the shadow port, L2GW mode supported too.

ARP Proxy: configure L2 Population and ARP responder to enable APR proxy in compute node to

reduce MAC learning

Cross Neutron L2 Network: VxLAN, VLAN, Flat supported.

How Shadow Agent, Shadow Port go to another cloud

Neutron Server

Tricircle

Cinder Nova

Tricircle Central

Neutron Plugin

Tricircle Local

Neutron Server

Tricircle Local

1.Port update, port1(host1)

Neutron Server

Tricircle

Cinder Nova

Tricircle Central

Neutron Plugin

Tricircle Local

Neutron Server

Tricircle Local

2.Port update, port1(host1, VTEP)

Neutron Server

Tricircle

Cinder Nova

Tricircle Central

Neutron Plugin

Tricircle Local

Neutron Server

Tricircle Local

3.save shadow agent

4. Trigger async. job to setup

shadow port/agent

Neutron Server

Tricircle

Cinder Nova

Tricircle Central

Neutron Plugin

Tricircle Local

Neutron Server

Tricircle Local

OpenStack(Region Three)

5. Create shadow port

with VTEP info in profile

Neutron Server

Tricircle

Cinder Nova

Tricircle Central

Neutron Plugin

Tricircle Local

Neutron Server

Tricircle Local

6. Create shadow

agent/ port

Neutron Server

Tricircle

Cinder Nova

Tricircle Central

Neutron Plugin

Tricircle Local

Neutron Server

Tricircle Local

7. update shadow port to

up state

Neutron Server

Tricircle

Cinder Nova

Tricircle Central

Neutron Plugin

Tricircle Local

Neutron Server

Tricircle Local

8. Call real core plugin

for shadow port up. If

L2-population is

configured, L2pop

happened.

SDN Controller can be supported if it’s configured to the real core plugin

L3 networking -

Shadow Port, Shadow Agent, ARP Proxy

Shadow Port2

Gateway Port1Gateway Port2

Shadow Port1

Bridge Network: a network used to connect routers in different cloud.

VxLAN, VLAN, Flat supported

Bridge Network

Site to site VPN or dedicated line for securityTenant1

Tenant

Tenant level isolated

L2/L3 networking

Security and Isolation between clouds

Tricricle: networking elements

Local network

A network will only reside

in one OpenStack

cloud.

Network type could be

VLAN, VxLAN, Flat

Local router

A router will only reside in

one OpenStack cloud

Net1 Net2

Region One Region Two

● neutron net-create --availability-zone-hint RegionOne Net1

● neutron net-create --availability-zone-hint RegionTwo Net2

● neutron router-create --availability-zone-hint RegionOne R1

● neutron router-create --availability-zone-hint RegionTwo R2

Neutron Server

Tricircle Central

Neutron Plugin

Tricricle: networking elements

Region One Region Two

● neutron net-create --availability-zone-hint RegionOne --

availability-zone-hint RegionTwo Net3

● neutron router-create --availability-zone-hint RegionOne --

availability-zone-hint RegionTwo R3 Neutron Server

Tricircle Central

Neutron Plugin

Bridge-Net

Cross Neutron L2 network

A network can be presented in more

than one OpenStack cloud.

Network type could be VLAN,

VxLAN, Flat

Non local router

A router can be presented in more

than one OpenStack cloud

Inter-connected via bridge network,

could be VLAN, VxLAN or Flat.

Tricricle: typical networking topology

+-----------------+ +-----------------+

|RegionOne | |RegionTwo |

| | | |

| phy_net1 | | phy_net2 |

| +--+---------+ | | +--+---------+ |

| | | | | |

| +--+--------+ | | +--+--------+ |

| | | | | | | |

| +------+----+ | | +------+----+ |

| | | | | |

| | net1 | | |

| +------+--------------------+---+ |

| | | |

+-----------------+ +-----------------+

| RegionOne | | RegionTwo |

| ext_net1 | | ext_net2 |

| +-----+-----+ | | +-----+-----+ |

| | | | | |

| +--+--+ | | +--+--+ |

| | R1 | | | | R2 | |

| +--+--+ | | +--+--+ |

| | | | | |

| +---+-+-+ | | +---+-+-+ |

| net1 | | | net2 | |

| +--------+--+ | | +--------+--+ |

| +-----------+ | | +-----------+ |

| | | net3 | |

| +------+---------------------+----+ |

| | | |

+-----------------+ +-----------------+

Multiple North-South Gateways

Instances plugged into cross Neutron L2 network

Direct Provider Networks

Instances plugged into cross Neutron L2 network

Cross Neutron L2 network Cross Neutron L2 network

Tricricle: typical networking topology

Centralized North-South Traffic with East-

West L3 networking enabled

Non local router

Multi- North-South Gateways with East-

West L3 networking enabled

Non local router

Tricircle - downtime risk?

If Tricircle and the central Neutron server are

down, the existing networking and applications

can still work, each OpenStack Neutron still run,

only new network topology provisioning and

topology change will be affected.

Document: https://docs.openstack.org/developer/tricircle/

Code navigate: https://wiki.openstack.org/wiki/TricircleHowToReadCode

Wiki: https://wiki.openstack.org/wiki/Tricircle

Code base: https://github.com/openstack/tricircle/

Learn, use and contribute

Thank You

Shared networks to support VNF high availability across OpenStack multi-region deployment

Software

VNF DESCRIPTOR (VNFD) & VNF PACKAGE OVERVIEW · • VNF Provider includes files containing necessary information (e.g. test description) Licensing Information for released VNF •

OpenStack Control Plane High Availability

Building High Availability in OpenStack Sergii Golovatiuk Mirantis

PowerPoint 演示文稿 - ETSI · NOKIA Operator's Cloud VNF DB Operator's Cloud VNF DB Operator's Cloud VNF DB Telcommunication systems EPC VNF VM MME Hyperviso VNF VM VNF VM NFV

OPENSTACK AT 99.999% AVAILABILITY WITH CEPH · Which availability? Server Network Datacenter Cloud Application/Service End-to-End availability most interesting 6 availability downtime/year

OpenStack Queens Roadmap for web€¦ · OpenStack Masakari What is it: This is another new project. Masakari helps OpenStack clouds achieve high availability from various vmfailure

OpenStack High Availability Jakub Pavlik. About me Jakub Pavlík Cloud Platform Engineer 3 years in Cloud 2 years in OpenStack

OpenStack Service High Availabilityopenstackpakistan.github.io/web/resources/meetup_2nd_HA.pdf · OpenStack Service High Availability Openstack Pakistan meetup, April 2016 ... Both

Livnat Peer & Arthur Berezin, Red Hat - Neutron High Availability - OpenStack Israel 2015

Brocade vCPEソリューションと OpenStackTackerによる VNFマ … · Brocade vEPC Brocade vRouter VNF 1 VIM (compute/network /storage) Mgmt driver OpenStack Nova, neutron VM

High Availability for OpenStack

OpenStackTage Cologne - OpenStack at 99.999% availability with Ceph

Virtual Network Functions Manager Installation and User Guide Install... · 2019-01-02 · An OpenStack instance, Mitaka version. 2. One OpenStack tenant per DSR Signaling VNF. The

OSM Architecture Workshop...VMware vCD Conn OpenStack Conn AWS Conn ONOS ODL Flood light User Interface Launchpad VNF Package Generator Account Mgr. VNF/NS Catalog Composer OSM Client

High Availability in OpenStack Cloud

OSM Hackfest Session 2 Creating a basic VNF and NS...Editing the VNF descriptor vnfd: - id: hackfest1-vnf name: hackfest1-vnf... mgmt-interface: cp: vnf-cp0 vdu: - id: hackfest1_vnfd-VM

Red Hat OpenStack Platform 12 Understanding Red Hat ... · High Availability Understanding, deploying, and managing High Availability in Red Hat OpenStack ... CHAPTER 1. OVERVIEW

Accelerate OpenStack* Together - 01.org | Intel Open Source … · 2019-06-27 · Neutron Nova Cinder Glance Swift Openstack NBI API’s Service Catalog NSD VNF VLAN Trunk NUMA Topology

High availability and fault tolerance of openstack

Stacking up with OpenStack: Building for High Availability