27
Arm Rallying the Ecosystem Around FD.io Tina Tsou Enterprise Architect Arm

Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

Arm Rallyingthe Ecosystem Around FDio

Tina Tsou

Enterprise Architect

Arm

Outline for Todayrsquos Session

FDioOverview

Arm goals with VPP in

the FDio community

Performance Optimization

Overview

Use Cases for Optimization with ODP amp Arm SoCs

Security GatewaySmart NIC

Impact of FDio

projects in an OPNFV

Environment

2December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Acknowledgements

3

Honnappa Nagarahalli Francois Ozog Song ZhuBrian Brooks Sachin Saxena

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

FDio ishellip

bull A Project at The Linux Foundationbull Multi-party

bull Multi-project

bull A Software Dataplanebull High throughput

bull Low Latency

bull Feature Rich

bull Resource Efficient

bull Bare MetalVMContainer

bull Multiplatform

FDio Scope

Bare MetalVMContainer

Dataplane Management AgentControlPlane

Packet ProcessingClassifyTransformPrioritizeForwardTerminate

Network IONICvNIC lt-gt coresthreads

4December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

FDio in the Overall Stack

Hardware

Network Controller

Orchestration

Operating System

Data Plane Services

Application LayerApp Server

Packet Processing Network IODataplane Management Agent

5December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Support for Arm-based SoCs

Arm Goals with VPP amp the FDIO CommunityvRoutervSwitchbull Carrier NFV demands a high performance scalable alternative and VPP fills this gap

bull The Arm ecosystem was seeking an alternative to get behind

1st Tier Supportbull Across all relevant open source communitiesconsortia Arm is driving 1st Tier Architecture status

bull Unified Official Implementation

bull Running in the CI Loop with an official maintainer

bull Available as part of all official releases

Accelerationbull High performance power optimized high core-count ARM Partner SoCs

bull Working with SoC partners and Linaro to drive OpenDataPlane (ODP)- based acceleration and offload

Carrier Grade

Data Plane

Common

Aarch64

Layer

Hardware

Offload

7December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Goal 1st Tier Architecture Status

8

Arm is driving participation in FDio CSIT

Pulling together a common Aarch64 build and CI test

integration

Upstream Integration underway

Coordinating Arm porting- No Fragmentation

Running Unit tests

Creating deb rpm packaging

CSIT functional and performance tests

01

10

0

0 11

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Goal Performance Tuning

Two Performance tracksbull General and OpenDataPlane (ODP)-specific

We have created the ODP4VPP Projectbull Subject of the 2nd half of this webinar

We also drive general performance optimization - iebull Support for 64B 128B cache line sizes

bull NEON enablement

bull Hashing algorithm and memcpy() analysis

bull ldquodualquad looprdquo tuning on Cortex-A processors

9

Flexible video

transcoding

Speech recognition

advanced audio processing

Computer Vision

ARVR

Machine and deep

learning

Gaming advanced

user interface

Enhanced capture

video

NEONtrade

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Security Gateway Use Case

Security Gateways in Networks

Evolved Packet Core

IPsec backhauling

enodeB

BranchOffices

Secure SD-WAN connectionCloud

Service

11December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

VPP Interfaces to Acceleration

ODP to provide VPP with various accelerators support

As accelerators to some VPP graph nodes (crypto)

As partial graph offload

12

VPP IPsec

IPsec options

Custom behavior of odp-input node

Accelerator of VPP IPsec node

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

13

ODP ConceptApplications are hardware-agnostic and portable

Vendors provide optimal implementations of ODP APIs on their platforms

ODP API Boundary

Application Developer Expertise

Hardware Vendor Expertise

ODP Application

VPP Application

ODP Implementation

Platform Features and Accelerators

ODP4VPP Plugin

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP4VPP Project Goals

14

Provide transparent access

to ODP acceleration for

VPP applications

Packaged as a VPP pluginAllow VPP applications to

leverage ODP capabilities

without change

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP Plug-in for VPP

0 1 32 hellip n

ethernet-input

dpdk-input vhost-user-input af-packet-input

ip4-inputip6-input arp-input

ip6-lookup ip4-lookup

ip6-localip6-rewrite ip4-rewriteip4-local

mpls-input

hellip

hellip

custom-1

custom-2 custom-3

Packet

Processing

Graph

Graph Node

Input Graph Node

Plugin usrlibvpp_pluginsfooso

ODP4VPP

Plugin

Skip few nodes

where work is done by

hardware already

odp-input w

IPSec offload

15December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Look-aside Processing

PacketApplication

IPsec Offload

Packet

Application touches packet 3 times

Receive encrypted packet

Pass encrypted packet to IPsec engine receive decrypted result

Process decrypted packet (work application wants to do)

Pass result packet to IPsec engine receive encrypted result

Transmit encrypted packet

RX

TX

16December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Inline Processing

PacketApplication

IPsec Offload

Packet

Application touches packet only once

Receive encrypted packet which is decrypted as part of RX path

Process decrypted packet (work application wants to do)

Transmit result packet which is encrypted as part of TX path

RX

TX

3x lookaside performance

17December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Linaro Connect 3Qrsquo17 Demos

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

ODP + ODP-IPsec (408B)

ODP + VPP-OPENSSL (408B)

18

1000 Kbps

3400Mbps

220Kpps750Mbps

18

bull VPP ODP IPsec node (Demoed by NXP)bull Skip a few nodes in VPP Graph where work is done by NXP

hardware Accelerator already

bull The packet is received from a given ODP device Interface and analyzed directly for IPSecCrypto processing

bull On the basis of analysis packet is submitted to HW accelerator via ODP IPSec lookaside APIs

bull Post HW accelerator processing packet further moves in VPP graph nodes for forwarding processing

bull Seen excellent IPSec throughput when compared to VPP OpenSSL based IPSec processing

bull NXP vCPE accelerated demo of IPsec routing(Host and VM sides)

bull CaviumNokia joint demo of 5G IPsec backhauling

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

SmartNICUse Case

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

bull Examplesbull Cavium Octeon TX

bull Marvell OCP SolidNet Adapter

20

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

21

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

VPP IPC over packetIO for host-

SmartNIC communications

VPP single-node multi-

instance management

bull Honeycomb

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Impact of FDio projects in an OPNFV Environment

Architecture - Containerized VNFs

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Host 1 Host 2Kubernetes Multusvhost-user CNI

VPP-ODPDPDK VPP-ODPDPDK

vhost vhost vhost

VXLAN Overlay

23December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

virtio

OPNFV Container4NFV Project

ODPDPDK vhost-

uservirtio_userfor container networking

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America 24

Containerized VNFs on Arm NFV

infrastructure

Kubernetes as Virtual

Infrastructure Manager (VIM)

Multiple networking interfaces supported

in container

VPP for switching and

routing

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 2: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

Outline for Todayrsquos Session

FDioOverview

Arm goals with VPP in

the FDio community

Performance Optimization

Overview

Use Cases for Optimization with ODP amp Arm SoCs

Security GatewaySmart NIC

Impact of FDio

projects in an OPNFV

Environment

2December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Acknowledgements

3

Honnappa Nagarahalli Francois Ozog Song ZhuBrian Brooks Sachin Saxena

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

FDio ishellip

bull A Project at The Linux Foundationbull Multi-party

bull Multi-project

bull A Software Dataplanebull High throughput

bull Low Latency

bull Feature Rich

bull Resource Efficient

bull Bare MetalVMContainer

bull Multiplatform

FDio Scope

Bare MetalVMContainer

Dataplane Management AgentControlPlane

Packet ProcessingClassifyTransformPrioritizeForwardTerminate

Network IONICvNIC lt-gt coresthreads

4December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

FDio in the Overall Stack

Hardware

Network Controller

Orchestration

Operating System

Data Plane Services

Application LayerApp Server

Packet Processing Network IODataplane Management Agent

5December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Support for Arm-based SoCs

Arm Goals with VPP amp the FDIO CommunityvRoutervSwitchbull Carrier NFV demands a high performance scalable alternative and VPP fills this gap

bull The Arm ecosystem was seeking an alternative to get behind

1st Tier Supportbull Across all relevant open source communitiesconsortia Arm is driving 1st Tier Architecture status

bull Unified Official Implementation

bull Running in the CI Loop with an official maintainer

bull Available as part of all official releases

Accelerationbull High performance power optimized high core-count ARM Partner SoCs

bull Working with SoC partners and Linaro to drive OpenDataPlane (ODP)- based acceleration and offload

Carrier Grade

Data Plane

Common

Aarch64

Layer

Hardware

Offload

7December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Goal 1st Tier Architecture Status

8

Arm is driving participation in FDio CSIT

Pulling together a common Aarch64 build and CI test

integration

Upstream Integration underway

Coordinating Arm porting- No Fragmentation

Running Unit tests

Creating deb rpm packaging

CSIT functional and performance tests

01

10

0

0 11

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Goal Performance Tuning

Two Performance tracksbull General and OpenDataPlane (ODP)-specific

We have created the ODP4VPP Projectbull Subject of the 2nd half of this webinar

We also drive general performance optimization - iebull Support for 64B 128B cache line sizes

bull NEON enablement

bull Hashing algorithm and memcpy() analysis

bull ldquodualquad looprdquo tuning on Cortex-A processors

9

Flexible video

transcoding

Speech recognition

advanced audio processing

Computer Vision

ARVR

Machine and deep

learning

Gaming advanced

user interface

Enhanced capture

video

NEONtrade

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Security Gateway Use Case

Security Gateways in Networks

Evolved Packet Core

IPsec backhauling

enodeB

BranchOffices

Secure SD-WAN connectionCloud

Service

11December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

VPP Interfaces to Acceleration

ODP to provide VPP with various accelerators support

As accelerators to some VPP graph nodes (crypto)

As partial graph offload

12

VPP IPsec

IPsec options

Custom behavior of odp-input node

Accelerator of VPP IPsec node

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

13

ODP ConceptApplications are hardware-agnostic and portable

Vendors provide optimal implementations of ODP APIs on their platforms

ODP API Boundary

Application Developer Expertise

Hardware Vendor Expertise

ODP Application

VPP Application

ODP Implementation

Platform Features and Accelerators

ODP4VPP Plugin

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP4VPP Project Goals

14

Provide transparent access

to ODP acceleration for

VPP applications

Packaged as a VPP pluginAllow VPP applications to

leverage ODP capabilities

without change

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP Plug-in for VPP

0 1 32 hellip n

ethernet-input

dpdk-input vhost-user-input af-packet-input

ip4-inputip6-input arp-input

ip6-lookup ip4-lookup

ip6-localip6-rewrite ip4-rewriteip4-local

mpls-input

hellip

hellip

custom-1

custom-2 custom-3

Packet

Processing

Graph

Graph Node

Input Graph Node

Plugin usrlibvpp_pluginsfooso

ODP4VPP

Plugin

Skip few nodes

where work is done by

hardware already

odp-input w

IPSec offload

15December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Look-aside Processing

PacketApplication

IPsec Offload

Packet

Application touches packet 3 times

Receive encrypted packet

Pass encrypted packet to IPsec engine receive decrypted result

Process decrypted packet (work application wants to do)

Pass result packet to IPsec engine receive encrypted result

Transmit encrypted packet

RX

TX

16December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Inline Processing

PacketApplication

IPsec Offload

Packet

Application touches packet only once

Receive encrypted packet which is decrypted as part of RX path

Process decrypted packet (work application wants to do)

Transmit result packet which is encrypted as part of TX path

RX

TX

3x lookaside performance

17December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Linaro Connect 3Qrsquo17 Demos

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

ODP + ODP-IPsec (408B)

ODP + VPP-OPENSSL (408B)

18

1000 Kbps

3400Mbps

220Kpps750Mbps

18

bull VPP ODP IPsec node (Demoed by NXP)bull Skip a few nodes in VPP Graph where work is done by NXP

hardware Accelerator already

bull The packet is received from a given ODP device Interface and analyzed directly for IPSecCrypto processing

bull On the basis of analysis packet is submitted to HW accelerator via ODP IPSec lookaside APIs

bull Post HW accelerator processing packet further moves in VPP graph nodes for forwarding processing

bull Seen excellent IPSec throughput when compared to VPP OpenSSL based IPSec processing

bull NXP vCPE accelerated demo of IPsec routing(Host and VM sides)

bull CaviumNokia joint demo of 5G IPsec backhauling

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

SmartNICUse Case

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

bull Examplesbull Cavium Octeon TX

bull Marvell OCP SolidNet Adapter

20

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

21

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

VPP IPC over packetIO for host-

SmartNIC communications

VPP single-node multi-

instance management

bull Honeycomb

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Impact of FDio projects in an OPNFV Environment

Architecture - Containerized VNFs

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Host 1 Host 2Kubernetes Multusvhost-user CNI

VPP-ODPDPDK VPP-ODPDPDK

vhost vhost vhost

VXLAN Overlay

23December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

virtio

OPNFV Container4NFV Project

ODPDPDK vhost-

uservirtio_userfor container networking

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America 24

Containerized VNFs on Arm NFV

infrastructure

Kubernetes as Virtual

Infrastructure Manager (VIM)

Multiple networking interfaces supported

in container

VPP for switching and

routing

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 3: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

Acknowledgements

3

Honnappa Nagarahalli Francois Ozog Song ZhuBrian Brooks Sachin Saxena

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

FDio ishellip

bull A Project at The Linux Foundationbull Multi-party

bull Multi-project

bull A Software Dataplanebull High throughput

bull Low Latency

bull Feature Rich

bull Resource Efficient

bull Bare MetalVMContainer

bull Multiplatform

FDio Scope

Bare MetalVMContainer

Dataplane Management AgentControlPlane

Packet ProcessingClassifyTransformPrioritizeForwardTerminate

Network IONICvNIC lt-gt coresthreads

4December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

FDio in the Overall Stack

Hardware

Network Controller

Orchestration

Operating System

Data Plane Services

Application LayerApp Server

Packet Processing Network IODataplane Management Agent

5December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Support for Arm-based SoCs

Arm Goals with VPP amp the FDIO CommunityvRoutervSwitchbull Carrier NFV demands a high performance scalable alternative and VPP fills this gap

bull The Arm ecosystem was seeking an alternative to get behind

1st Tier Supportbull Across all relevant open source communitiesconsortia Arm is driving 1st Tier Architecture status

bull Unified Official Implementation

bull Running in the CI Loop with an official maintainer

bull Available as part of all official releases

Accelerationbull High performance power optimized high core-count ARM Partner SoCs

bull Working with SoC partners and Linaro to drive OpenDataPlane (ODP)- based acceleration and offload

Carrier Grade

Data Plane

Common

Aarch64

Layer

Hardware

Offload

7December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Goal 1st Tier Architecture Status

8

Arm is driving participation in FDio CSIT

Pulling together a common Aarch64 build and CI test

integration

Upstream Integration underway

Coordinating Arm porting- No Fragmentation

Running Unit tests

Creating deb rpm packaging

CSIT functional and performance tests

01

10

0

0 11

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Goal Performance Tuning

Two Performance tracksbull General and OpenDataPlane (ODP)-specific

We have created the ODP4VPP Projectbull Subject of the 2nd half of this webinar

We also drive general performance optimization - iebull Support for 64B 128B cache line sizes

bull NEON enablement

bull Hashing algorithm and memcpy() analysis

bull ldquodualquad looprdquo tuning on Cortex-A processors

9

Flexible video

transcoding

Speech recognition

advanced audio processing

Computer Vision

ARVR

Machine and deep

learning

Gaming advanced

user interface

Enhanced capture

video

NEONtrade

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Security Gateway Use Case

Security Gateways in Networks

Evolved Packet Core

IPsec backhauling

enodeB

BranchOffices

Secure SD-WAN connectionCloud

Service

11December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

VPP Interfaces to Acceleration

ODP to provide VPP with various accelerators support

As accelerators to some VPP graph nodes (crypto)

As partial graph offload

12

VPP IPsec

IPsec options

Custom behavior of odp-input node

Accelerator of VPP IPsec node

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

13

ODP ConceptApplications are hardware-agnostic and portable

Vendors provide optimal implementations of ODP APIs on their platforms

ODP API Boundary

Application Developer Expertise

Hardware Vendor Expertise

ODP Application

VPP Application

ODP Implementation

Platform Features and Accelerators

ODP4VPP Plugin

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP4VPP Project Goals

14

Provide transparent access

to ODP acceleration for

VPP applications

Packaged as a VPP pluginAllow VPP applications to

leverage ODP capabilities

without change

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP Plug-in for VPP

0 1 32 hellip n

ethernet-input

dpdk-input vhost-user-input af-packet-input

ip4-inputip6-input arp-input

ip6-lookup ip4-lookup

ip6-localip6-rewrite ip4-rewriteip4-local

mpls-input

hellip

hellip

custom-1

custom-2 custom-3

Packet

Processing

Graph

Graph Node

Input Graph Node

Plugin usrlibvpp_pluginsfooso

ODP4VPP

Plugin

Skip few nodes

where work is done by

hardware already

odp-input w

IPSec offload

15December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Look-aside Processing

PacketApplication

IPsec Offload

Packet

Application touches packet 3 times

Receive encrypted packet

Pass encrypted packet to IPsec engine receive decrypted result

Process decrypted packet (work application wants to do)

Pass result packet to IPsec engine receive encrypted result

Transmit encrypted packet

RX

TX

16December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Inline Processing

PacketApplication

IPsec Offload

Packet

Application touches packet only once

Receive encrypted packet which is decrypted as part of RX path

Process decrypted packet (work application wants to do)

Transmit result packet which is encrypted as part of TX path

RX

TX

3x lookaside performance

17December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Linaro Connect 3Qrsquo17 Demos

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

ODP + ODP-IPsec (408B)

ODP + VPP-OPENSSL (408B)

18

1000 Kbps

3400Mbps

220Kpps750Mbps

18

bull VPP ODP IPsec node (Demoed by NXP)bull Skip a few nodes in VPP Graph where work is done by NXP

hardware Accelerator already

bull The packet is received from a given ODP device Interface and analyzed directly for IPSecCrypto processing

bull On the basis of analysis packet is submitted to HW accelerator via ODP IPSec lookaside APIs

bull Post HW accelerator processing packet further moves in VPP graph nodes for forwarding processing

bull Seen excellent IPSec throughput when compared to VPP OpenSSL based IPSec processing

bull NXP vCPE accelerated demo of IPsec routing(Host and VM sides)

bull CaviumNokia joint demo of 5G IPsec backhauling

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

SmartNICUse Case

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

bull Examplesbull Cavium Octeon TX

bull Marvell OCP SolidNet Adapter

20

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

21

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

VPP IPC over packetIO for host-

SmartNIC communications

VPP single-node multi-

instance management

bull Honeycomb

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Impact of FDio projects in an OPNFV Environment

Architecture - Containerized VNFs

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Host 1 Host 2Kubernetes Multusvhost-user CNI

VPP-ODPDPDK VPP-ODPDPDK

vhost vhost vhost

VXLAN Overlay

23December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

virtio

OPNFV Container4NFV Project

ODPDPDK vhost-

uservirtio_userfor container networking

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America 24

Containerized VNFs on Arm NFV

infrastructure

Kubernetes as Virtual

Infrastructure Manager (VIM)

Multiple networking interfaces supported

in container

VPP for switching and

routing

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 4: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

FDio ishellip

bull A Project at The Linux Foundationbull Multi-party

bull Multi-project

bull A Software Dataplanebull High throughput

bull Low Latency

bull Feature Rich

bull Resource Efficient

bull Bare MetalVMContainer

bull Multiplatform

FDio Scope

Bare MetalVMContainer

Dataplane Management AgentControlPlane

Packet ProcessingClassifyTransformPrioritizeForwardTerminate

Network IONICvNIC lt-gt coresthreads

4December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

FDio in the Overall Stack

Hardware

Network Controller

Orchestration

Operating System

Data Plane Services

Application LayerApp Server

Packet Processing Network IODataplane Management Agent

5December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Support for Arm-based SoCs

Arm Goals with VPP amp the FDIO CommunityvRoutervSwitchbull Carrier NFV demands a high performance scalable alternative and VPP fills this gap

bull The Arm ecosystem was seeking an alternative to get behind

1st Tier Supportbull Across all relevant open source communitiesconsortia Arm is driving 1st Tier Architecture status

bull Unified Official Implementation

bull Running in the CI Loop with an official maintainer

bull Available as part of all official releases

Accelerationbull High performance power optimized high core-count ARM Partner SoCs

bull Working with SoC partners and Linaro to drive OpenDataPlane (ODP)- based acceleration and offload

Carrier Grade

Data Plane

Common

Aarch64

Layer

Hardware

Offload

7December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Goal 1st Tier Architecture Status

8

Arm is driving participation in FDio CSIT

Pulling together a common Aarch64 build and CI test

integration

Upstream Integration underway

Coordinating Arm porting- No Fragmentation

Running Unit tests

Creating deb rpm packaging

CSIT functional and performance tests

01

10

0

0 11

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Goal Performance Tuning

Two Performance tracksbull General and OpenDataPlane (ODP)-specific

We have created the ODP4VPP Projectbull Subject of the 2nd half of this webinar

We also drive general performance optimization - iebull Support for 64B 128B cache line sizes

bull NEON enablement

bull Hashing algorithm and memcpy() analysis

bull ldquodualquad looprdquo tuning on Cortex-A processors

9

Flexible video

transcoding

Speech recognition

advanced audio processing

Computer Vision

ARVR

Machine and deep

learning

Gaming advanced

user interface

Enhanced capture

video

NEONtrade

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Security Gateway Use Case

Security Gateways in Networks

Evolved Packet Core

IPsec backhauling

enodeB

BranchOffices

Secure SD-WAN connectionCloud

Service

11December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

VPP Interfaces to Acceleration

ODP to provide VPP with various accelerators support

As accelerators to some VPP graph nodes (crypto)

As partial graph offload

12

VPP IPsec

IPsec options

Custom behavior of odp-input node

Accelerator of VPP IPsec node

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

13

ODP ConceptApplications are hardware-agnostic and portable

Vendors provide optimal implementations of ODP APIs on their platforms

ODP API Boundary

Application Developer Expertise

Hardware Vendor Expertise

ODP Application

VPP Application

ODP Implementation

Platform Features and Accelerators

ODP4VPP Plugin

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP4VPP Project Goals

14

Provide transparent access

to ODP acceleration for

VPP applications

Packaged as a VPP pluginAllow VPP applications to

leverage ODP capabilities

without change

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP Plug-in for VPP

0 1 32 hellip n

ethernet-input

dpdk-input vhost-user-input af-packet-input

ip4-inputip6-input arp-input

ip6-lookup ip4-lookup

ip6-localip6-rewrite ip4-rewriteip4-local

mpls-input

hellip

hellip

custom-1

custom-2 custom-3

Packet

Processing

Graph

Graph Node

Input Graph Node

Plugin usrlibvpp_pluginsfooso

ODP4VPP

Plugin

Skip few nodes

where work is done by

hardware already

odp-input w

IPSec offload

15December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Look-aside Processing

PacketApplication

IPsec Offload

Packet

Application touches packet 3 times

Receive encrypted packet

Pass encrypted packet to IPsec engine receive decrypted result

Process decrypted packet (work application wants to do)

Pass result packet to IPsec engine receive encrypted result

Transmit encrypted packet

RX

TX

16December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Inline Processing

PacketApplication

IPsec Offload

Packet

Application touches packet only once

Receive encrypted packet which is decrypted as part of RX path

Process decrypted packet (work application wants to do)

Transmit result packet which is encrypted as part of TX path

RX

TX

3x lookaside performance

17December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Linaro Connect 3Qrsquo17 Demos

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

ODP + ODP-IPsec (408B)

ODP + VPP-OPENSSL (408B)

18

1000 Kbps

3400Mbps

220Kpps750Mbps

18

bull VPP ODP IPsec node (Demoed by NXP)bull Skip a few nodes in VPP Graph where work is done by NXP

hardware Accelerator already

bull The packet is received from a given ODP device Interface and analyzed directly for IPSecCrypto processing

bull On the basis of analysis packet is submitted to HW accelerator via ODP IPSec lookaside APIs

bull Post HW accelerator processing packet further moves in VPP graph nodes for forwarding processing

bull Seen excellent IPSec throughput when compared to VPP OpenSSL based IPSec processing

bull NXP vCPE accelerated demo of IPsec routing(Host and VM sides)

bull CaviumNokia joint demo of 5G IPsec backhauling

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

SmartNICUse Case

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

bull Examplesbull Cavium Octeon TX

bull Marvell OCP SolidNet Adapter

20

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

21

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

VPP IPC over packetIO for host-

SmartNIC communications

VPP single-node multi-

instance management

bull Honeycomb

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Impact of FDio projects in an OPNFV Environment

Architecture - Containerized VNFs

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Host 1 Host 2Kubernetes Multusvhost-user CNI

VPP-ODPDPDK VPP-ODPDPDK

vhost vhost vhost

VXLAN Overlay

23December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

virtio

OPNFV Container4NFV Project

ODPDPDK vhost-

uservirtio_userfor container networking

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America 24

Containerized VNFs on Arm NFV

infrastructure

Kubernetes as Virtual

Infrastructure Manager (VIM)

Multiple networking interfaces supported

in container

VPP for switching and

routing

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 5: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

FDio in the Overall Stack

Hardware

Network Controller

Orchestration

Operating System

Data Plane Services

Application LayerApp Server

Packet Processing Network IODataplane Management Agent

5December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Support for Arm-based SoCs

Arm Goals with VPP amp the FDIO CommunityvRoutervSwitchbull Carrier NFV demands a high performance scalable alternative and VPP fills this gap

bull The Arm ecosystem was seeking an alternative to get behind

1st Tier Supportbull Across all relevant open source communitiesconsortia Arm is driving 1st Tier Architecture status

bull Unified Official Implementation

bull Running in the CI Loop with an official maintainer

bull Available as part of all official releases

Accelerationbull High performance power optimized high core-count ARM Partner SoCs

bull Working with SoC partners and Linaro to drive OpenDataPlane (ODP)- based acceleration and offload

Carrier Grade

Data Plane

Common

Aarch64

Layer

Hardware

Offload

7December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Goal 1st Tier Architecture Status

8

Arm is driving participation in FDio CSIT

Pulling together a common Aarch64 build and CI test

integration

Upstream Integration underway

Coordinating Arm porting- No Fragmentation

Running Unit tests

Creating deb rpm packaging

CSIT functional and performance tests

01

10

0

0 11

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Goal Performance Tuning

Two Performance tracksbull General and OpenDataPlane (ODP)-specific

We have created the ODP4VPP Projectbull Subject of the 2nd half of this webinar

We also drive general performance optimization - iebull Support for 64B 128B cache line sizes

bull NEON enablement

bull Hashing algorithm and memcpy() analysis

bull ldquodualquad looprdquo tuning on Cortex-A processors

9

Flexible video

transcoding

Speech recognition

advanced audio processing

Computer Vision

ARVR

Machine and deep

learning

Gaming advanced

user interface

Enhanced capture

video

NEONtrade

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Security Gateway Use Case

Security Gateways in Networks

Evolved Packet Core

IPsec backhauling

enodeB

BranchOffices

Secure SD-WAN connectionCloud

Service

11December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

VPP Interfaces to Acceleration

ODP to provide VPP with various accelerators support

As accelerators to some VPP graph nodes (crypto)

As partial graph offload

12

VPP IPsec

IPsec options

Custom behavior of odp-input node

Accelerator of VPP IPsec node

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

13

ODP ConceptApplications are hardware-agnostic and portable

Vendors provide optimal implementations of ODP APIs on their platforms

ODP API Boundary

Application Developer Expertise

Hardware Vendor Expertise

ODP Application

VPP Application

ODP Implementation

Platform Features and Accelerators

ODP4VPP Plugin

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP4VPP Project Goals

14

Provide transparent access

to ODP acceleration for

VPP applications

Packaged as a VPP pluginAllow VPP applications to

leverage ODP capabilities

without change

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP Plug-in for VPP

0 1 32 hellip n

ethernet-input

dpdk-input vhost-user-input af-packet-input

ip4-inputip6-input arp-input

ip6-lookup ip4-lookup

ip6-localip6-rewrite ip4-rewriteip4-local

mpls-input

hellip

hellip

custom-1

custom-2 custom-3

Packet

Processing

Graph

Graph Node

Input Graph Node

Plugin usrlibvpp_pluginsfooso

ODP4VPP

Plugin

Skip few nodes

where work is done by

hardware already

odp-input w

IPSec offload

15December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Look-aside Processing

PacketApplication

IPsec Offload

Packet

Application touches packet 3 times

Receive encrypted packet

Pass encrypted packet to IPsec engine receive decrypted result

Process decrypted packet (work application wants to do)

Pass result packet to IPsec engine receive encrypted result

Transmit encrypted packet

RX

TX

16December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Inline Processing

PacketApplication

IPsec Offload

Packet

Application touches packet only once

Receive encrypted packet which is decrypted as part of RX path

Process decrypted packet (work application wants to do)

Transmit result packet which is encrypted as part of TX path

RX

TX

3x lookaside performance

17December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Linaro Connect 3Qrsquo17 Demos

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

ODP + ODP-IPsec (408B)

ODP + VPP-OPENSSL (408B)

18

1000 Kbps

3400Mbps

220Kpps750Mbps

18

bull VPP ODP IPsec node (Demoed by NXP)bull Skip a few nodes in VPP Graph where work is done by NXP

hardware Accelerator already

bull The packet is received from a given ODP device Interface and analyzed directly for IPSecCrypto processing

bull On the basis of analysis packet is submitted to HW accelerator via ODP IPSec lookaside APIs

bull Post HW accelerator processing packet further moves in VPP graph nodes for forwarding processing

bull Seen excellent IPSec throughput when compared to VPP OpenSSL based IPSec processing

bull NXP vCPE accelerated demo of IPsec routing(Host and VM sides)

bull CaviumNokia joint demo of 5G IPsec backhauling

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

SmartNICUse Case

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

bull Examplesbull Cavium Octeon TX

bull Marvell OCP SolidNet Adapter

20

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

21

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

VPP IPC over packetIO for host-

SmartNIC communications

VPP single-node multi-

instance management

bull Honeycomb

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Impact of FDio projects in an OPNFV Environment

Architecture - Containerized VNFs

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Host 1 Host 2Kubernetes Multusvhost-user CNI

VPP-ODPDPDK VPP-ODPDPDK

vhost vhost vhost

VXLAN Overlay

23December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

virtio

OPNFV Container4NFV Project

ODPDPDK vhost-

uservirtio_userfor container networking

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America 24

Containerized VNFs on Arm NFV

infrastructure

Kubernetes as Virtual

Infrastructure Manager (VIM)

Multiple networking interfaces supported

in container

VPP for switching and

routing

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 6: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

Support for Arm-based SoCs

Arm Goals with VPP amp the FDIO CommunityvRoutervSwitchbull Carrier NFV demands a high performance scalable alternative and VPP fills this gap

bull The Arm ecosystem was seeking an alternative to get behind

1st Tier Supportbull Across all relevant open source communitiesconsortia Arm is driving 1st Tier Architecture status

bull Unified Official Implementation

bull Running in the CI Loop with an official maintainer

bull Available as part of all official releases

Accelerationbull High performance power optimized high core-count ARM Partner SoCs

bull Working with SoC partners and Linaro to drive OpenDataPlane (ODP)- based acceleration and offload

Carrier Grade

Data Plane

Common

Aarch64

Layer

Hardware

Offload

7December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Goal 1st Tier Architecture Status

8

Arm is driving participation in FDio CSIT

Pulling together a common Aarch64 build and CI test

integration

Upstream Integration underway

Coordinating Arm porting- No Fragmentation

Running Unit tests

Creating deb rpm packaging

CSIT functional and performance tests

01

10

0

0 11

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Goal Performance Tuning

Two Performance tracksbull General and OpenDataPlane (ODP)-specific

We have created the ODP4VPP Projectbull Subject of the 2nd half of this webinar

We also drive general performance optimization - iebull Support for 64B 128B cache line sizes

bull NEON enablement

bull Hashing algorithm and memcpy() analysis

bull ldquodualquad looprdquo tuning on Cortex-A processors

9

Flexible video

transcoding

Speech recognition

advanced audio processing

Computer Vision

ARVR

Machine and deep

learning

Gaming advanced

user interface

Enhanced capture

video

NEONtrade

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Security Gateway Use Case

Security Gateways in Networks

Evolved Packet Core

IPsec backhauling

enodeB

BranchOffices

Secure SD-WAN connectionCloud

Service

11December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

VPP Interfaces to Acceleration

ODP to provide VPP with various accelerators support

As accelerators to some VPP graph nodes (crypto)

As partial graph offload

12

VPP IPsec

IPsec options

Custom behavior of odp-input node

Accelerator of VPP IPsec node

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

13

ODP ConceptApplications are hardware-agnostic and portable

Vendors provide optimal implementations of ODP APIs on their platforms

ODP API Boundary

Application Developer Expertise

Hardware Vendor Expertise

ODP Application

VPP Application

ODP Implementation

Platform Features and Accelerators

ODP4VPP Plugin

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP4VPP Project Goals

14

Provide transparent access

to ODP acceleration for

VPP applications

Packaged as a VPP pluginAllow VPP applications to

leverage ODP capabilities

without change

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP Plug-in for VPP

0 1 32 hellip n

ethernet-input

dpdk-input vhost-user-input af-packet-input

ip4-inputip6-input arp-input

ip6-lookup ip4-lookup

ip6-localip6-rewrite ip4-rewriteip4-local

mpls-input

hellip

hellip

custom-1

custom-2 custom-3

Packet

Processing

Graph

Graph Node

Input Graph Node

Plugin usrlibvpp_pluginsfooso

ODP4VPP

Plugin

Skip few nodes

where work is done by

hardware already

odp-input w

IPSec offload

15December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Look-aside Processing

PacketApplication

IPsec Offload

Packet

Application touches packet 3 times

Receive encrypted packet

Pass encrypted packet to IPsec engine receive decrypted result

Process decrypted packet (work application wants to do)

Pass result packet to IPsec engine receive encrypted result

Transmit encrypted packet

RX

TX

16December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Inline Processing

PacketApplication

IPsec Offload

Packet

Application touches packet only once

Receive encrypted packet which is decrypted as part of RX path

Process decrypted packet (work application wants to do)

Transmit result packet which is encrypted as part of TX path

RX

TX

3x lookaside performance

17December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Linaro Connect 3Qrsquo17 Demos

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

ODP + ODP-IPsec (408B)

ODP + VPP-OPENSSL (408B)

18

1000 Kbps

3400Mbps

220Kpps750Mbps

18

bull VPP ODP IPsec node (Demoed by NXP)bull Skip a few nodes in VPP Graph where work is done by NXP

hardware Accelerator already

bull The packet is received from a given ODP device Interface and analyzed directly for IPSecCrypto processing

bull On the basis of analysis packet is submitted to HW accelerator via ODP IPSec lookaside APIs

bull Post HW accelerator processing packet further moves in VPP graph nodes for forwarding processing

bull Seen excellent IPSec throughput when compared to VPP OpenSSL based IPSec processing

bull NXP vCPE accelerated demo of IPsec routing(Host and VM sides)

bull CaviumNokia joint demo of 5G IPsec backhauling

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

SmartNICUse Case

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

bull Examplesbull Cavium Octeon TX

bull Marvell OCP SolidNet Adapter

20

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

21

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

VPP IPC over packetIO for host-

SmartNIC communications

VPP single-node multi-

instance management

bull Honeycomb

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Impact of FDio projects in an OPNFV Environment

Architecture - Containerized VNFs

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Host 1 Host 2Kubernetes Multusvhost-user CNI

VPP-ODPDPDK VPP-ODPDPDK

vhost vhost vhost

VXLAN Overlay

23December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

virtio

OPNFV Container4NFV Project

ODPDPDK vhost-

uservirtio_userfor container networking

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America 24

Containerized VNFs on Arm NFV

infrastructure

Kubernetes as Virtual

Infrastructure Manager (VIM)

Multiple networking interfaces supported

in container

VPP for switching and

routing

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 7: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

Arm Goals with VPP amp the FDIO CommunityvRoutervSwitchbull Carrier NFV demands a high performance scalable alternative and VPP fills this gap

bull The Arm ecosystem was seeking an alternative to get behind

1st Tier Supportbull Across all relevant open source communitiesconsortia Arm is driving 1st Tier Architecture status

bull Unified Official Implementation

bull Running in the CI Loop with an official maintainer

bull Available as part of all official releases

Accelerationbull High performance power optimized high core-count ARM Partner SoCs

bull Working with SoC partners and Linaro to drive OpenDataPlane (ODP)- based acceleration and offload

Carrier Grade

Data Plane

Common

Aarch64

Layer

Hardware

Offload

7December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Goal 1st Tier Architecture Status

8

Arm is driving participation in FDio CSIT

Pulling together a common Aarch64 build and CI test

integration

Upstream Integration underway

Coordinating Arm porting- No Fragmentation

Running Unit tests

Creating deb rpm packaging

CSIT functional and performance tests

01

10

0

0 11

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Goal Performance Tuning

Two Performance tracksbull General and OpenDataPlane (ODP)-specific

We have created the ODP4VPP Projectbull Subject of the 2nd half of this webinar

We also drive general performance optimization - iebull Support for 64B 128B cache line sizes

bull NEON enablement

bull Hashing algorithm and memcpy() analysis

bull ldquodualquad looprdquo tuning on Cortex-A processors

9

Flexible video

transcoding

Speech recognition

advanced audio processing

Computer Vision

ARVR

Machine and deep

learning

Gaming advanced

user interface

Enhanced capture

video

NEONtrade

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Security Gateway Use Case

Security Gateways in Networks

Evolved Packet Core

IPsec backhauling

enodeB

BranchOffices

Secure SD-WAN connectionCloud

Service

11December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

VPP Interfaces to Acceleration

ODP to provide VPP with various accelerators support

As accelerators to some VPP graph nodes (crypto)

As partial graph offload

12

VPP IPsec

IPsec options

Custom behavior of odp-input node

Accelerator of VPP IPsec node

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

13

ODP ConceptApplications are hardware-agnostic and portable

Vendors provide optimal implementations of ODP APIs on their platforms

ODP API Boundary

Application Developer Expertise

Hardware Vendor Expertise

ODP Application

VPP Application

ODP Implementation

Platform Features and Accelerators

ODP4VPP Plugin

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP4VPP Project Goals

14

Provide transparent access

to ODP acceleration for

VPP applications

Packaged as a VPP pluginAllow VPP applications to

leverage ODP capabilities

without change

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP Plug-in for VPP

0 1 32 hellip n

ethernet-input

dpdk-input vhost-user-input af-packet-input

ip4-inputip6-input arp-input

ip6-lookup ip4-lookup

ip6-localip6-rewrite ip4-rewriteip4-local

mpls-input

hellip

hellip

custom-1

custom-2 custom-3

Packet

Processing

Graph

Graph Node

Input Graph Node

Plugin usrlibvpp_pluginsfooso

ODP4VPP

Plugin

Skip few nodes

where work is done by

hardware already

odp-input w

IPSec offload

15December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Look-aside Processing

PacketApplication

IPsec Offload

Packet

Application touches packet 3 times

Receive encrypted packet

Pass encrypted packet to IPsec engine receive decrypted result

Process decrypted packet (work application wants to do)

Pass result packet to IPsec engine receive encrypted result

Transmit encrypted packet

RX

TX

16December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Inline Processing

PacketApplication

IPsec Offload

Packet

Application touches packet only once

Receive encrypted packet which is decrypted as part of RX path

Process decrypted packet (work application wants to do)

Transmit result packet which is encrypted as part of TX path

RX

TX

3x lookaside performance

17December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Linaro Connect 3Qrsquo17 Demos

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

ODP + ODP-IPsec (408B)

ODP + VPP-OPENSSL (408B)

18

1000 Kbps

3400Mbps

220Kpps750Mbps

18

bull VPP ODP IPsec node (Demoed by NXP)bull Skip a few nodes in VPP Graph where work is done by NXP

hardware Accelerator already

bull The packet is received from a given ODP device Interface and analyzed directly for IPSecCrypto processing

bull On the basis of analysis packet is submitted to HW accelerator via ODP IPSec lookaside APIs

bull Post HW accelerator processing packet further moves in VPP graph nodes for forwarding processing

bull Seen excellent IPSec throughput when compared to VPP OpenSSL based IPSec processing

bull NXP vCPE accelerated demo of IPsec routing(Host and VM sides)

bull CaviumNokia joint demo of 5G IPsec backhauling

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

SmartNICUse Case

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

bull Examplesbull Cavium Octeon TX

bull Marvell OCP SolidNet Adapter

20

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

21

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

VPP IPC over packetIO for host-

SmartNIC communications

VPP single-node multi-

instance management

bull Honeycomb

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Impact of FDio projects in an OPNFV Environment

Architecture - Containerized VNFs

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Host 1 Host 2Kubernetes Multusvhost-user CNI

VPP-ODPDPDK VPP-ODPDPDK

vhost vhost vhost

VXLAN Overlay

23December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

virtio

OPNFV Container4NFV Project

ODPDPDK vhost-

uservirtio_userfor container networking

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America 24

Containerized VNFs on Arm NFV

infrastructure

Kubernetes as Virtual

Infrastructure Manager (VIM)

Multiple networking interfaces supported

in container

VPP for switching and

routing

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 8: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

Goal 1st Tier Architecture Status

8

Arm is driving participation in FDio CSIT

Pulling together a common Aarch64 build and CI test

integration

Upstream Integration underway

Coordinating Arm porting- No Fragmentation

Running Unit tests

Creating deb rpm packaging

CSIT functional and performance tests

01

10

0

0 11

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Goal Performance Tuning

Two Performance tracksbull General and OpenDataPlane (ODP)-specific

We have created the ODP4VPP Projectbull Subject of the 2nd half of this webinar

We also drive general performance optimization - iebull Support for 64B 128B cache line sizes

bull NEON enablement

bull Hashing algorithm and memcpy() analysis

bull ldquodualquad looprdquo tuning on Cortex-A processors

9

Flexible video

transcoding

Speech recognition

advanced audio processing

Computer Vision

ARVR

Machine and deep

learning

Gaming advanced

user interface

Enhanced capture

video

NEONtrade

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Security Gateway Use Case

Security Gateways in Networks

Evolved Packet Core

IPsec backhauling

enodeB

BranchOffices

Secure SD-WAN connectionCloud

Service

11December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

VPP Interfaces to Acceleration

ODP to provide VPP with various accelerators support

As accelerators to some VPP graph nodes (crypto)

As partial graph offload

12

VPP IPsec

IPsec options

Custom behavior of odp-input node

Accelerator of VPP IPsec node

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

13

ODP ConceptApplications are hardware-agnostic and portable

Vendors provide optimal implementations of ODP APIs on their platforms

ODP API Boundary

Application Developer Expertise

Hardware Vendor Expertise

ODP Application

VPP Application

ODP Implementation

Platform Features and Accelerators

ODP4VPP Plugin

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP4VPP Project Goals

14

Provide transparent access

to ODP acceleration for

VPP applications

Packaged as a VPP pluginAllow VPP applications to

leverage ODP capabilities

without change

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP Plug-in for VPP

0 1 32 hellip n

ethernet-input

dpdk-input vhost-user-input af-packet-input

ip4-inputip6-input arp-input

ip6-lookup ip4-lookup

ip6-localip6-rewrite ip4-rewriteip4-local

mpls-input

hellip

hellip

custom-1

custom-2 custom-3

Packet

Processing

Graph

Graph Node

Input Graph Node

Plugin usrlibvpp_pluginsfooso

ODP4VPP

Plugin

Skip few nodes

where work is done by

hardware already

odp-input w

IPSec offload

15December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Look-aside Processing

PacketApplication

IPsec Offload

Packet

Application touches packet 3 times

Receive encrypted packet

Pass encrypted packet to IPsec engine receive decrypted result

Process decrypted packet (work application wants to do)

Pass result packet to IPsec engine receive encrypted result

Transmit encrypted packet

RX

TX

16December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Inline Processing

PacketApplication

IPsec Offload

Packet

Application touches packet only once

Receive encrypted packet which is decrypted as part of RX path

Process decrypted packet (work application wants to do)

Transmit result packet which is encrypted as part of TX path

RX

TX

3x lookaside performance

17December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Linaro Connect 3Qrsquo17 Demos

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

ODP + ODP-IPsec (408B)

ODP + VPP-OPENSSL (408B)

18

1000 Kbps

3400Mbps

220Kpps750Mbps

18

bull VPP ODP IPsec node (Demoed by NXP)bull Skip a few nodes in VPP Graph where work is done by NXP

hardware Accelerator already

bull The packet is received from a given ODP device Interface and analyzed directly for IPSecCrypto processing

bull On the basis of analysis packet is submitted to HW accelerator via ODP IPSec lookaside APIs

bull Post HW accelerator processing packet further moves in VPP graph nodes for forwarding processing

bull Seen excellent IPSec throughput when compared to VPP OpenSSL based IPSec processing

bull NXP vCPE accelerated demo of IPsec routing(Host and VM sides)

bull CaviumNokia joint demo of 5G IPsec backhauling

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

SmartNICUse Case

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

bull Examplesbull Cavium Octeon TX

bull Marvell OCP SolidNet Adapter

20

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

21

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

VPP IPC over packetIO for host-

SmartNIC communications

VPP single-node multi-

instance management

bull Honeycomb

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Impact of FDio projects in an OPNFV Environment

Architecture - Containerized VNFs

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Host 1 Host 2Kubernetes Multusvhost-user CNI

VPP-ODPDPDK VPP-ODPDPDK

vhost vhost vhost

VXLAN Overlay

23December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

virtio

OPNFV Container4NFV Project

ODPDPDK vhost-

uservirtio_userfor container networking

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America 24

Containerized VNFs on Arm NFV

infrastructure

Kubernetes as Virtual

Infrastructure Manager (VIM)

Multiple networking interfaces supported

in container

VPP for switching and

routing

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 9: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

Goal Performance Tuning

Two Performance tracksbull General and OpenDataPlane (ODP)-specific

We have created the ODP4VPP Projectbull Subject of the 2nd half of this webinar

We also drive general performance optimization - iebull Support for 64B 128B cache line sizes

bull NEON enablement

bull Hashing algorithm and memcpy() analysis

bull ldquodualquad looprdquo tuning on Cortex-A processors

9

Flexible video

transcoding

Speech recognition

advanced audio processing

Computer Vision

ARVR

Machine and deep

learning

Gaming advanced

user interface

Enhanced capture

video

NEONtrade

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Security Gateway Use Case

Security Gateways in Networks

Evolved Packet Core

IPsec backhauling

enodeB

BranchOffices

Secure SD-WAN connectionCloud

Service

11December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

VPP Interfaces to Acceleration

ODP to provide VPP with various accelerators support

As accelerators to some VPP graph nodes (crypto)

As partial graph offload

12

VPP IPsec

IPsec options

Custom behavior of odp-input node

Accelerator of VPP IPsec node

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

13

ODP ConceptApplications are hardware-agnostic and portable

Vendors provide optimal implementations of ODP APIs on their platforms

ODP API Boundary

Application Developer Expertise

Hardware Vendor Expertise

ODP Application

VPP Application

ODP Implementation

Platform Features and Accelerators

ODP4VPP Plugin

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP4VPP Project Goals

14

Provide transparent access

to ODP acceleration for

VPP applications

Packaged as a VPP pluginAllow VPP applications to

leverage ODP capabilities

without change

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP Plug-in for VPP

0 1 32 hellip n

ethernet-input

dpdk-input vhost-user-input af-packet-input

ip4-inputip6-input arp-input

ip6-lookup ip4-lookup

ip6-localip6-rewrite ip4-rewriteip4-local

mpls-input

hellip

hellip

custom-1

custom-2 custom-3

Packet

Processing

Graph

Graph Node

Input Graph Node

Plugin usrlibvpp_pluginsfooso

ODP4VPP

Plugin

Skip few nodes

where work is done by

hardware already

odp-input w

IPSec offload

15December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Look-aside Processing

PacketApplication

IPsec Offload

Packet

Application touches packet 3 times

Receive encrypted packet

Pass encrypted packet to IPsec engine receive decrypted result

Process decrypted packet (work application wants to do)

Pass result packet to IPsec engine receive encrypted result

Transmit encrypted packet

RX

TX

16December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Inline Processing

PacketApplication

IPsec Offload

Packet

Application touches packet only once

Receive encrypted packet which is decrypted as part of RX path

Process decrypted packet (work application wants to do)

Transmit result packet which is encrypted as part of TX path

RX

TX

3x lookaside performance

17December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Linaro Connect 3Qrsquo17 Demos

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

ODP + ODP-IPsec (408B)

ODP + VPP-OPENSSL (408B)

18

1000 Kbps

3400Mbps

220Kpps750Mbps

18

bull VPP ODP IPsec node (Demoed by NXP)bull Skip a few nodes in VPP Graph where work is done by NXP

hardware Accelerator already

bull The packet is received from a given ODP device Interface and analyzed directly for IPSecCrypto processing

bull On the basis of analysis packet is submitted to HW accelerator via ODP IPSec lookaside APIs

bull Post HW accelerator processing packet further moves in VPP graph nodes for forwarding processing

bull Seen excellent IPSec throughput when compared to VPP OpenSSL based IPSec processing

bull NXP vCPE accelerated demo of IPsec routing(Host and VM sides)

bull CaviumNokia joint demo of 5G IPsec backhauling

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

SmartNICUse Case

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

bull Examplesbull Cavium Octeon TX

bull Marvell OCP SolidNet Adapter

20

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

21

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

VPP IPC over packetIO for host-

SmartNIC communications

VPP single-node multi-

instance management

bull Honeycomb

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Impact of FDio projects in an OPNFV Environment

Architecture - Containerized VNFs

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Host 1 Host 2Kubernetes Multusvhost-user CNI

VPP-ODPDPDK VPP-ODPDPDK

vhost vhost vhost

VXLAN Overlay

23December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

virtio

OPNFV Container4NFV Project

ODPDPDK vhost-

uservirtio_userfor container networking

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America 24

Containerized VNFs on Arm NFV

infrastructure

Kubernetes as Virtual

Infrastructure Manager (VIM)

Multiple networking interfaces supported

in container

VPP for switching and

routing

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 10: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

Security Gateway Use Case

Security Gateways in Networks

Evolved Packet Core

IPsec backhauling

enodeB

BranchOffices

Secure SD-WAN connectionCloud

Service

11December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

VPP Interfaces to Acceleration

ODP to provide VPP with various accelerators support

As accelerators to some VPP graph nodes (crypto)

As partial graph offload

12

VPP IPsec

IPsec options

Custom behavior of odp-input node

Accelerator of VPP IPsec node

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

13

ODP ConceptApplications are hardware-agnostic and portable

Vendors provide optimal implementations of ODP APIs on their platforms

ODP API Boundary

Application Developer Expertise

Hardware Vendor Expertise

ODP Application

VPP Application

ODP Implementation

Platform Features and Accelerators

ODP4VPP Plugin

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP4VPP Project Goals

14

Provide transparent access

to ODP acceleration for

VPP applications

Packaged as a VPP pluginAllow VPP applications to

leverage ODP capabilities

without change

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP Plug-in for VPP

0 1 32 hellip n

ethernet-input

dpdk-input vhost-user-input af-packet-input

ip4-inputip6-input arp-input

ip6-lookup ip4-lookup

ip6-localip6-rewrite ip4-rewriteip4-local

mpls-input

hellip

hellip

custom-1

custom-2 custom-3

Packet

Processing

Graph

Graph Node

Input Graph Node

Plugin usrlibvpp_pluginsfooso

ODP4VPP

Plugin

Skip few nodes

where work is done by

hardware already

odp-input w

IPSec offload

15December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Look-aside Processing

PacketApplication

IPsec Offload

Packet

Application touches packet 3 times

Receive encrypted packet

Pass encrypted packet to IPsec engine receive decrypted result

Process decrypted packet (work application wants to do)

Pass result packet to IPsec engine receive encrypted result

Transmit encrypted packet

RX

TX

16December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Inline Processing

PacketApplication

IPsec Offload

Packet

Application touches packet only once

Receive encrypted packet which is decrypted as part of RX path

Process decrypted packet (work application wants to do)

Transmit result packet which is encrypted as part of TX path

RX

TX

3x lookaside performance

17December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Linaro Connect 3Qrsquo17 Demos

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

ODP + ODP-IPsec (408B)

ODP + VPP-OPENSSL (408B)

18

1000 Kbps

3400Mbps

220Kpps750Mbps

18

bull VPP ODP IPsec node (Demoed by NXP)bull Skip a few nodes in VPP Graph where work is done by NXP

hardware Accelerator already

bull The packet is received from a given ODP device Interface and analyzed directly for IPSecCrypto processing

bull On the basis of analysis packet is submitted to HW accelerator via ODP IPSec lookaside APIs

bull Post HW accelerator processing packet further moves in VPP graph nodes for forwarding processing

bull Seen excellent IPSec throughput when compared to VPP OpenSSL based IPSec processing

bull NXP vCPE accelerated demo of IPsec routing(Host and VM sides)

bull CaviumNokia joint demo of 5G IPsec backhauling

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

SmartNICUse Case

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

bull Examplesbull Cavium Octeon TX

bull Marvell OCP SolidNet Adapter

20

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

21

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

VPP IPC over packetIO for host-

SmartNIC communications

VPP single-node multi-

instance management

bull Honeycomb

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Impact of FDio projects in an OPNFV Environment

Architecture - Containerized VNFs

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Host 1 Host 2Kubernetes Multusvhost-user CNI

VPP-ODPDPDK VPP-ODPDPDK

vhost vhost vhost

VXLAN Overlay

23December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

virtio

OPNFV Container4NFV Project

ODPDPDK vhost-

uservirtio_userfor container networking

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America 24

Containerized VNFs on Arm NFV

infrastructure

Kubernetes as Virtual

Infrastructure Manager (VIM)

Multiple networking interfaces supported

in container

VPP for switching and

routing

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 11: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

Security Gateways in Networks

Evolved Packet Core

IPsec backhauling

enodeB

BranchOffices

Secure SD-WAN connectionCloud

Service

11December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

VPP Interfaces to Acceleration

ODP to provide VPP with various accelerators support

As accelerators to some VPP graph nodes (crypto)

As partial graph offload

12

VPP IPsec

IPsec options

Custom behavior of odp-input node

Accelerator of VPP IPsec node

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

13

ODP ConceptApplications are hardware-agnostic and portable

Vendors provide optimal implementations of ODP APIs on their platforms

ODP API Boundary

Application Developer Expertise

Hardware Vendor Expertise

ODP Application

VPP Application

ODP Implementation

Platform Features and Accelerators

ODP4VPP Plugin

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP4VPP Project Goals

14

Provide transparent access

to ODP acceleration for

VPP applications

Packaged as a VPP pluginAllow VPP applications to

leverage ODP capabilities

without change

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP Plug-in for VPP

0 1 32 hellip n

ethernet-input

dpdk-input vhost-user-input af-packet-input

ip4-inputip6-input arp-input

ip6-lookup ip4-lookup

ip6-localip6-rewrite ip4-rewriteip4-local

mpls-input

hellip

hellip

custom-1

custom-2 custom-3

Packet

Processing

Graph

Graph Node

Input Graph Node

Plugin usrlibvpp_pluginsfooso

ODP4VPP

Plugin

Skip few nodes

where work is done by

hardware already

odp-input w

IPSec offload

15December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Look-aside Processing

PacketApplication

IPsec Offload

Packet

Application touches packet 3 times

Receive encrypted packet

Pass encrypted packet to IPsec engine receive decrypted result

Process decrypted packet (work application wants to do)

Pass result packet to IPsec engine receive encrypted result

Transmit encrypted packet

RX

TX

16December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Inline Processing

PacketApplication

IPsec Offload

Packet

Application touches packet only once

Receive encrypted packet which is decrypted as part of RX path

Process decrypted packet (work application wants to do)

Transmit result packet which is encrypted as part of TX path

RX

TX

3x lookaside performance

17December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Linaro Connect 3Qrsquo17 Demos

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

ODP + ODP-IPsec (408B)

ODP + VPP-OPENSSL (408B)

18

1000 Kbps

3400Mbps

220Kpps750Mbps

18

bull VPP ODP IPsec node (Demoed by NXP)bull Skip a few nodes in VPP Graph where work is done by NXP

hardware Accelerator already

bull The packet is received from a given ODP device Interface and analyzed directly for IPSecCrypto processing

bull On the basis of analysis packet is submitted to HW accelerator via ODP IPSec lookaside APIs

bull Post HW accelerator processing packet further moves in VPP graph nodes for forwarding processing

bull Seen excellent IPSec throughput when compared to VPP OpenSSL based IPSec processing

bull NXP vCPE accelerated demo of IPsec routing(Host and VM sides)

bull CaviumNokia joint demo of 5G IPsec backhauling

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

SmartNICUse Case

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

bull Examplesbull Cavium Octeon TX

bull Marvell OCP SolidNet Adapter

20

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

21

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

VPP IPC over packetIO for host-

SmartNIC communications

VPP single-node multi-

instance management

bull Honeycomb

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Impact of FDio projects in an OPNFV Environment

Architecture - Containerized VNFs

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Host 1 Host 2Kubernetes Multusvhost-user CNI

VPP-ODPDPDK VPP-ODPDPDK

vhost vhost vhost

VXLAN Overlay

23December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

virtio

OPNFV Container4NFV Project

ODPDPDK vhost-

uservirtio_userfor container networking

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America 24

Containerized VNFs on Arm NFV

infrastructure

Kubernetes as Virtual

Infrastructure Manager (VIM)

Multiple networking interfaces supported

in container

VPP for switching and

routing

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 12: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

VPP Interfaces to Acceleration

ODP to provide VPP with various accelerators support

As accelerators to some VPP graph nodes (crypto)

As partial graph offload

12

VPP IPsec

IPsec options

Custom behavior of odp-input node

Accelerator of VPP IPsec node

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

13

ODP ConceptApplications are hardware-agnostic and portable

Vendors provide optimal implementations of ODP APIs on their platforms

ODP API Boundary

Application Developer Expertise

Hardware Vendor Expertise

ODP Application

VPP Application

ODP Implementation

Platform Features and Accelerators

ODP4VPP Plugin

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP4VPP Project Goals

14

Provide transparent access

to ODP acceleration for

VPP applications

Packaged as a VPP pluginAllow VPP applications to

leverage ODP capabilities

without change

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP Plug-in for VPP

0 1 32 hellip n

ethernet-input

dpdk-input vhost-user-input af-packet-input

ip4-inputip6-input arp-input

ip6-lookup ip4-lookup

ip6-localip6-rewrite ip4-rewriteip4-local

mpls-input

hellip

hellip

custom-1

custom-2 custom-3

Packet

Processing

Graph

Graph Node

Input Graph Node

Plugin usrlibvpp_pluginsfooso

ODP4VPP

Plugin

Skip few nodes

where work is done by

hardware already

odp-input w

IPSec offload

15December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Look-aside Processing

PacketApplication

IPsec Offload

Packet

Application touches packet 3 times

Receive encrypted packet

Pass encrypted packet to IPsec engine receive decrypted result

Process decrypted packet (work application wants to do)

Pass result packet to IPsec engine receive encrypted result

Transmit encrypted packet

RX

TX

16December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Inline Processing

PacketApplication

IPsec Offload

Packet

Application touches packet only once

Receive encrypted packet which is decrypted as part of RX path

Process decrypted packet (work application wants to do)

Transmit result packet which is encrypted as part of TX path

RX

TX

3x lookaside performance

17December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Linaro Connect 3Qrsquo17 Demos

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

ODP + ODP-IPsec (408B)

ODP + VPP-OPENSSL (408B)

18

1000 Kbps

3400Mbps

220Kpps750Mbps

18

bull VPP ODP IPsec node (Demoed by NXP)bull Skip a few nodes in VPP Graph where work is done by NXP

hardware Accelerator already

bull The packet is received from a given ODP device Interface and analyzed directly for IPSecCrypto processing

bull On the basis of analysis packet is submitted to HW accelerator via ODP IPSec lookaside APIs

bull Post HW accelerator processing packet further moves in VPP graph nodes for forwarding processing

bull Seen excellent IPSec throughput when compared to VPP OpenSSL based IPSec processing

bull NXP vCPE accelerated demo of IPsec routing(Host and VM sides)

bull CaviumNokia joint demo of 5G IPsec backhauling

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

SmartNICUse Case

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

bull Examplesbull Cavium Octeon TX

bull Marvell OCP SolidNet Adapter

20

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

21

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

VPP IPC over packetIO for host-

SmartNIC communications

VPP single-node multi-

instance management

bull Honeycomb

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Impact of FDio projects in an OPNFV Environment

Architecture - Containerized VNFs

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Host 1 Host 2Kubernetes Multusvhost-user CNI

VPP-ODPDPDK VPP-ODPDPDK

vhost vhost vhost

VXLAN Overlay

23December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

virtio

OPNFV Container4NFV Project

ODPDPDK vhost-

uservirtio_userfor container networking

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America 24

Containerized VNFs on Arm NFV

infrastructure

Kubernetes as Virtual

Infrastructure Manager (VIM)

Multiple networking interfaces supported

in container

VPP for switching and

routing

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 13: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

13

ODP ConceptApplications are hardware-agnostic and portable

Vendors provide optimal implementations of ODP APIs on their platforms

ODP API Boundary

Application Developer Expertise

Hardware Vendor Expertise

ODP Application

VPP Application

ODP Implementation

Platform Features and Accelerators

ODP4VPP Plugin

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP4VPP Project Goals

14

Provide transparent access

to ODP acceleration for

VPP applications

Packaged as a VPP pluginAllow VPP applications to

leverage ODP capabilities

without change

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP Plug-in for VPP

0 1 32 hellip n

ethernet-input

dpdk-input vhost-user-input af-packet-input

ip4-inputip6-input arp-input

ip6-lookup ip4-lookup

ip6-localip6-rewrite ip4-rewriteip4-local

mpls-input

hellip

hellip

custom-1

custom-2 custom-3

Packet

Processing

Graph

Graph Node

Input Graph Node

Plugin usrlibvpp_pluginsfooso

ODP4VPP

Plugin

Skip few nodes

where work is done by

hardware already

odp-input w

IPSec offload

15December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Look-aside Processing

PacketApplication

IPsec Offload

Packet

Application touches packet 3 times

Receive encrypted packet

Pass encrypted packet to IPsec engine receive decrypted result

Process decrypted packet (work application wants to do)

Pass result packet to IPsec engine receive encrypted result

Transmit encrypted packet

RX

TX

16December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Inline Processing

PacketApplication

IPsec Offload

Packet

Application touches packet only once

Receive encrypted packet which is decrypted as part of RX path

Process decrypted packet (work application wants to do)

Transmit result packet which is encrypted as part of TX path

RX

TX

3x lookaside performance

17December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Linaro Connect 3Qrsquo17 Demos

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

ODP + ODP-IPsec (408B)

ODP + VPP-OPENSSL (408B)

18

1000 Kbps

3400Mbps

220Kpps750Mbps

18

bull VPP ODP IPsec node (Demoed by NXP)bull Skip a few nodes in VPP Graph where work is done by NXP

hardware Accelerator already

bull The packet is received from a given ODP device Interface and analyzed directly for IPSecCrypto processing

bull On the basis of analysis packet is submitted to HW accelerator via ODP IPSec lookaside APIs

bull Post HW accelerator processing packet further moves in VPP graph nodes for forwarding processing

bull Seen excellent IPSec throughput when compared to VPP OpenSSL based IPSec processing

bull NXP vCPE accelerated demo of IPsec routing(Host and VM sides)

bull CaviumNokia joint demo of 5G IPsec backhauling

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

SmartNICUse Case

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

bull Examplesbull Cavium Octeon TX

bull Marvell OCP SolidNet Adapter

20

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

21

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

VPP IPC over packetIO for host-

SmartNIC communications

VPP single-node multi-

instance management

bull Honeycomb

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Impact of FDio projects in an OPNFV Environment

Architecture - Containerized VNFs

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Host 1 Host 2Kubernetes Multusvhost-user CNI

VPP-ODPDPDK VPP-ODPDPDK

vhost vhost vhost

VXLAN Overlay

23December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

virtio

OPNFV Container4NFV Project

ODPDPDK vhost-

uservirtio_userfor container networking

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America 24

Containerized VNFs on Arm NFV

infrastructure

Kubernetes as Virtual

Infrastructure Manager (VIM)

Multiple networking interfaces supported

in container

VPP for switching and

routing

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 14: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

ODP4VPP Project Goals

14

Provide transparent access

to ODP acceleration for

VPP applications

Packaged as a VPP pluginAllow VPP applications to

leverage ODP capabilities

without change

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

ODP Plug-in for VPP

0 1 32 hellip n

ethernet-input

dpdk-input vhost-user-input af-packet-input

ip4-inputip6-input arp-input

ip6-lookup ip4-lookup

ip6-localip6-rewrite ip4-rewriteip4-local

mpls-input

hellip

hellip

custom-1

custom-2 custom-3

Packet

Processing

Graph

Graph Node

Input Graph Node

Plugin usrlibvpp_pluginsfooso

ODP4VPP

Plugin

Skip few nodes

where work is done by

hardware already

odp-input w

IPSec offload

15December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Look-aside Processing

PacketApplication

IPsec Offload

Packet

Application touches packet 3 times

Receive encrypted packet

Pass encrypted packet to IPsec engine receive decrypted result

Process decrypted packet (work application wants to do)

Pass result packet to IPsec engine receive encrypted result

Transmit encrypted packet

RX

TX

16December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Inline Processing

PacketApplication

IPsec Offload

Packet

Application touches packet only once

Receive encrypted packet which is decrypted as part of RX path

Process decrypted packet (work application wants to do)

Transmit result packet which is encrypted as part of TX path

RX

TX

3x lookaside performance

17December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Linaro Connect 3Qrsquo17 Demos

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

ODP + ODP-IPsec (408B)

ODP + VPP-OPENSSL (408B)

18

1000 Kbps

3400Mbps

220Kpps750Mbps

18

bull VPP ODP IPsec node (Demoed by NXP)bull Skip a few nodes in VPP Graph where work is done by NXP

hardware Accelerator already

bull The packet is received from a given ODP device Interface and analyzed directly for IPSecCrypto processing

bull On the basis of analysis packet is submitted to HW accelerator via ODP IPSec lookaside APIs

bull Post HW accelerator processing packet further moves in VPP graph nodes for forwarding processing

bull Seen excellent IPSec throughput when compared to VPP OpenSSL based IPSec processing

bull NXP vCPE accelerated demo of IPsec routing(Host and VM sides)

bull CaviumNokia joint demo of 5G IPsec backhauling

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

SmartNICUse Case

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

bull Examplesbull Cavium Octeon TX

bull Marvell OCP SolidNet Adapter

20

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

21

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

VPP IPC over packetIO for host-

SmartNIC communications

VPP single-node multi-

instance management

bull Honeycomb

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Impact of FDio projects in an OPNFV Environment

Architecture - Containerized VNFs

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Host 1 Host 2Kubernetes Multusvhost-user CNI

VPP-ODPDPDK VPP-ODPDPDK

vhost vhost vhost

VXLAN Overlay

23December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

virtio

OPNFV Container4NFV Project

ODPDPDK vhost-

uservirtio_userfor container networking

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America 24

Containerized VNFs on Arm NFV

infrastructure

Kubernetes as Virtual

Infrastructure Manager (VIM)

Multiple networking interfaces supported

in container

VPP for switching and

routing

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 15: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

ODP Plug-in for VPP

0 1 32 hellip n

ethernet-input

dpdk-input vhost-user-input af-packet-input

ip4-inputip6-input arp-input

ip6-lookup ip4-lookup

ip6-localip6-rewrite ip4-rewriteip4-local

mpls-input

hellip

hellip

custom-1

custom-2 custom-3

Packet

Processing

Graph

Graph Node

Input Graph Node

Plugin usrlibvpp_pluginsfooso

ODP4VPP

Plugin

Skip few nodes

where work is done by

hardware already

odp-input w

IPSec offload

15December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Look-aside Processing

PacketApplication

IPsec Offload

Packet

Application touches packet 3 times

Receive encrypted packet

Pass encrypted packet to IPsec engine receive decrypted result

Process decrypted packet (work application wants to do)

Pass result packet to IPsec engine receive encrypted result

Transmit encrypted packet

RX

TX

16December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Inline Processing

PacketApplication

IPsec Offload

Packet

Application touches packet only once

Receive encrypted packet which is decrypted as part of RX path

Process decrypted packet (work application wants to do)

Transmit result packet which is encrypted as part of TX path

RX

TX

3x lookaside performance

17December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Linaro Connect 3Qrsquo17 Demos

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

ODP + ODP-IPsec (408B)

ODP + VPP-OPENSSL (408B)

18

1000 Kbps

3400Mbps

220Kpps750Mbps

18

bull VPP ODP IPsec node (Demoed by NXP)bull Skip a few nodes in VPP Graph where work is done by NXP

hardware Accelerator already

bull The packet is received from a given ODP device Interface and analyzed directly for IPSecCrypto processing

bull On the basis of analysis packet is submitted to HW accelerator via ODP IPSec lookaside APIs

bull Post HW accelerator processing packet further moves in VPP graph nodes for forwarding processing

bull Seen excellent IPSec throughput when compared to VPP OpenSSL based IPSec processing

bull NXP vCPE accelerated demo of IPsec routing(Host and VM sides)

bull CaviumNokia joint demo of 5G IPsec backhauling

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

SmartNICUse Case

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

bull Examplesbull Cavium Octeon TX

bull Marvell OCP SolidNet Adapter

20

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

21

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

VPP IPC over packetIO for host-

SmartNIC communications

VPP single-node multi-

instance management

bull Honeycomb

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Impact of FDio projects in an OPNFV Environment

Architecture - Containerized VNFs

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Host 1 Host 2Kubernetes Multusvhost-user CNI

VPP-ODPDPDK VPP-ODPDPDK

vhost vhost vhost

VXLAN Overlay

23December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

virtio

OPNFV Container4NFV Project

ODPDPDK vhost-

uservirtio_userfor container networking

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America 24

Containerized VNFs on Arm NFV

infrastructure

Kubernetes as Virtual

Infrastructure Manager (VIM)

Multiple networking interfaces supported

in container

VPP for switching and

routing

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 16: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

IPsec Look-aside Processing

PacketApplication

IPsec Offload

Packet

Application touches packet 3 times

Receive encrypted packet

Pass encrypted packet to IPsec engine receive decrypted result

Process decrypted packet (work application wants to do)

Pass result packet to IPsec engine receive encrypted result

Transmit encrypted packet

RX

TX

16December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

IPsec Inline Processing

PacketApplication

IPsec Offload

Packet

Application touches packet only once

Receive encrypted packet which is decrypted as part of RX path

Process decrypted packet (work application wants to do)

Transmit result packet which is encrypted as part of TX path

RX

TX

3x lookaside performance

17December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Linaro Connect 3Qrsquo17 Demos

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

ODP + ODP-IPsec (408B)

ODP + VPP-OPENSSL (408B)

18

1000 Kbps

3400Mbps

220Kpps750Mbps

18

bull VPP ODP IPsec node (Demoed by NXP)bull Skip a few nodes in VPP Graph where work is done by NXP

hardware Accelerator already

bull The packet is received from a given ODP device Interface and analyzed directly for IPSecCrypto processing

bull On the basis of analysis packet is submitted to HW accelerator via ODP IPSec lookaside APIs

bull Post HW accelerator processing packet further moves in VPP graph nodes for forwarding processing

bull Seen excellent IPSec throughput when compared to VPP OpenSSL based IPSec processing

bull NXP vCPE accelerated demo of IPsec routing(Host and VM sides)

bull CaviumNokia joint demo of 5G IPsec backhauling

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

SmartNICUse Case

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

bull Examplesbull Cavium Octeon TX

bull Marvell OCP SolidNet Adapter

20

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

21

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

VPP IPC over packetIO for host-

SmartNIC communications

VPP single-node multi-

instance management

bull Honeycomb

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Impact of FDio projects in an OPNFV Environment

Architecture - Containerized VNFs

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Host 1 Host 2Kubernetes Multusvhost-user CNI

VPP-ODPDPDK VPP-ODPDPDK

vhost vhost vhost

VXLAN Overlay

23December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

virtio

OPNFV Container4NFV Project

ODPDPDK vhost-

uservirtio_userfor container networking

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America 24

Containerized VNFs on Arm NFV

infrastructure

Kubernetes as Virtual

Infrastructure Manager (VIM)

Multiple networking interfaces supported

in container

VPP for switching and

routing

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 17: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

IPsec Inline Processing

PacketApplication

IPsec Offload

Packet

Application touches packet only once

Receive encrypted packet which is decrypted as part of RX path

Process decrypted packet (work application wants to do)

Transmit result packet which is encrypted as part of TX path

RX

TX

3x lookaside performance

17December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Linaro Connect 3Qrsquo17 Demos

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

ODP + ODP-IPsec (408B)

ODP + VPP-OPENSSL (408B)

18

1000 Kbps

3400Mbps

220Kpps750Mbps

18

bull VPP ODP IPsec node (Demoed by NXP)bull Skip a few nodes in VPP Graph where work is done by NXP

hardware Accelerator already

bull The packet is received from a given ODP device Interface and analyzed directly for IPSecCrypto processing

bull On the basis of analysis packet is submitted to HW accelerator via ODP IPSec lookaside APIs

bull Post HW accelerator processing packet further moves in VPP graph nodes for forwarding processing

bull Seen excellent IPSec throughput when compared to VPP OpenSSL based IPSec processing

bull NXP vCPE accelerated demo of IPsec routing(Host and VM sides)

bull CaviumNokia joint demo of 5G IPsec backhauling

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

SmartNICUse Case

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

bull Examplesbull Cavium Octeon TX

bull Marvell OCP SolidNet Adapter

20

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

21

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

VPP IPC over packetIO for host-

SmartNIC communications

VPP single-node multi-

instance management

bull Honeycomb

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Impact of FDio projects in an OPNFV Environment

Architecture - Containerized VNFs

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Host 1 Host 2Kubernetes Multusvhost-user CNI

VPP-ODPDPDK VPP-ODPDPDK

vhost vhost vhost

VXLAN Overlay

23December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

virtio

OPNFV Container4NFV Project

ODPDPDK vhost-

uservirtio_userfor container networking

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America 24

Containerized VNFs on Arm NFV

infrastructure

Kubernetes as Virtual

Infrastructure Manager (VIM)

Multiple networking interfaces supported

in container

VPP for switching and

routing

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 18: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

Linaro Connect 3Qrsquo17 Demos

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

ODP + ODP-IPsec (408B)

ODP + VPP-OPENSSL (408B)

18

1000 Kbps

3400Mbps

220Kpps750Mbps

18

bull VPP ODP IPsec node (Demoed by NXP)bull Skip a few nodes in VPP Graph where work is done by NXP

hardware Accelerator already

bull The packet is received from a given ODP device Interface and analyzed directly for IPSecCrypto processing

bull On the basis of analysis packet is submitted to HW accelerator via ODP IPSec lookaside APIs

bull Post HW accelerator processing packet further moves in VPP graph nodes for forwarding processing

bull Seen excellent IPSec throughput when compared to VPP OpenSSL based IPSec processing

bull NXP vCPE accelerated demo of IPsec routing(Host and VM sides)

bull CaviumNokia joint demo of 5G IPsec backhauling

Single CPU (IO Thread) ThroughputArm A72 1800 MHz

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

SmartNICUse Case

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

bull Examplesbull Cavium Octeon TX

bull Marvell OCP SolidNet Adapter

20

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

21

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

VPP IPC over packetIO for host-

SmartNIC communications

VPP single-node multi-

instance management

bull Honeycomb

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Impact of FDio projects in an OPNFV Environment

Architecture - Containerized VNFs

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Host 1 Host 2Kubernetes Multusvhost-user CNI

VPP-ODPDPDK VPP-ODPDPDK

vhost vhost vhost

VXLAN Overlay

23December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

virtio

OPNFV Container4NFV Project

ODPDPDK vhost-

uservirtio_userfor container networking

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America 24

Containerized VNFs on Arm NFV

infrastructure

Kubernetes as Virtual

Infrastructure Manager (VIM)

Multiple networking interfaces supported

in container

VPP for switching and

routing

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 19: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

SmartNICUse Case

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

bull Examplesbull Cavium Octeon TX

bull Marvell OCP SolidNet Adapter

20

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

21

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

VPP IPC over packetIO for host-

SmartNIC communications

VPP single-node multi-

instance management

bull Honeycomb

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Impact of FDio projects in an OPNFV Environment

Architecture - Containerized VNFs

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Host 1 Host 2Kubernetes Multusvhost-user CNI

VPP-ODPDPDK VPP-ODPDPDK

vhost vhost vhost

VXLAN Overlay

23December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

virtio

OPNFV Container4NFV Project

ODPDPDK vhost-

uservirtio_userfor container networking

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America 24

Containerized VNFs on Arm NFV

infrastructure

Kubernetes as Virtual

Infrastructure Manager (VIM)

Multiple networking interfaces supported

in container

VPP for switching and

routing

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 20: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

bull Examplesbull Cavium Octeon TX

bull Marvell OCP SolidNet Adapter

20

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

21

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

VPP IPC over packetIO for host-

SmartNIC communications

VPP single-node multi-

instance management

bull Honeycomb

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Impact of FDio projects in an OPNFV Environment

Architecture - Containerized VNFs

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Host 1 Host 2Kubernetes Multusvhost-user CNI

VPP-ODPDPDK VPP-ODPDPDK

vhost vhost vhost

VXLAN Overlay

23December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

virtio

OPNFV Container4NFV Project

ODPDPDK vhost-

uservirtio_userfor container networking

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America 24

Containerized VNFs on Arm NFV

infrastructure

Kubernetes as Virtual

Infrastructure Manager (VIM)

Multiple networking interfaces supported

in container

VPP for switching and

routing

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 21: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

Efficiency Drivers for SmartNICs

bull Preserve host CPU cycles for applications

bull Combination of Arm cores + accelerators

bull Most flexible and cost effective solution for networking ldquoprepost processingrdquo

21

App

KernelHypervisor

App

HW Acceleration

FDio

SmartNIC as the App

Server

Distributed

SmartNICs

Fdio

KernelHypervisor

HW Acceleration

FDio

Server

SmartNICs

VPP IPC over packetIO for host-

SmartNIC communications

VPP single-node multi-

instance management

bull Honeycomb

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Impact of FDio projects in an OPNFV Environment

Architecture - Containerized VNFs

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Host 1 Host 2Kubernetes Multusvhost-user CNI

VPP-ODPDPDK VPP-ODPDPDK

vhost vhost vhost

VXLAN Overlay

23December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

virtio

OPNFV Container4NFV Project

ODPDPDK vhost-

uservirtio_userfor container networking

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America 24

Containerized VNFs on Arm NFV

infrastructure

Kubernetes as Virtual

Infrastructure Manager (VIM)

Multiple networking interfaces supported

in container

VPP for switching and

routing

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 22: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

Impact of FDio projects in an OPNFV Environment

Architecture - Containerized VNFs

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Host 1 Host 2Kubernetes Multusvhost-user CNI

VPP-ODPDPDK VPP-ODPDPDK

vhost vhost vhost

VXLAN Overlay

23December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

virtio

OPNFV Container4NFV Project

ODPDPDK vhost-

uservirtio_userfor container networking

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America 24

Containerized VNFs on Arm NFV

infrastructure

Kubernetes as Virtual

Infrastructure Manager (VIM)

Multiple networking interfaces supported

in container

VPP for switching and

routing

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 23: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

Architecture - Containerized VNFs

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

Container

ODPDPDK App

ETHDEV

virtio-user

vhost-user adapter

virtio

Host 1 Host 2Kubernetes Multusvhost-user CNI

VPP-ODPDPDK VPP-ODPDPDK

vhost vhost vhost

VXLAN Overlay

23December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

virtio

OPNFV Container4NFV Project

ODPDPDK vhost-

uservirtio_userfor container networking

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America 24

Containerized VNFs on Arm NFV

infrastructure

Kubernetes as Virtual

Infrastructure Manager (VIM)

Multiple networking interfaces supported

in container

VPP for switching and

routing

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 24: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

OPNFV Container4NFV Project

ODPDPDK vhost-

uservirtio_userfor container networking

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America 24

Containerized VNFs on Arm NFV

infrastructure

Kubernetes as Virtual

Infrastructure Manager (VIM)

Multiple networking interfaces supported

in container

VPP for switching and

routing

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 25: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

Getting Involved with FDIO amp ArmOverall Project Website httpswikifdioviewMain_Page

VPP Aarch64 Project httpswikifdioviewVPPAArch64bull Weekly Public Call Wednesdays 1600 UTCbull Eventually feeds into the CSIT project once fully integratedbull CSIT func amp perf httpswikifdioviewCSITAArch64TODO

ODP4VPP Project httpswikifdioviewODP4VPPbull Weekly Meetings Wednesdays 1500 UTC

25December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 26: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

Next Steps

26

The Arm Ecosystem is committed to driving 1st Tier

architecture support for FDio deliverables on

Arm-based servers

We are driving use-case-specific

performance optimizations out of the ODP4VPP

led by Linaro LNG

All of our work will be up-streamed with the results

and benefits shared with the

broad community

FDio will also be integrated into OPNFV ONAP

configurations by the Arm

ecosystem and interested

stakeholders

Follow-on updates should be available in

the Spring 2018

December 5 2017 FDio Mini-Summit at CloudNativeCon + KubeCon North America

Questions

TinaTsouarmcom

Page 27: Arm Rallying the Ecosystem Around FD...Acknowledgements 3 Brian Brooks Honnappa Nagarahalli Francois Ozog Sachin Saxena Song Zhu December 5, 2017 FD.io Mini-Summit at CloudNativeCon

Questions

TinaTsouarmcom