The Trend to Edge Computing - opencompute.org€¦ · Edge Computing Projection 50 Billion Devices Connected to the Internet 50% of Data Will be Processed at Network Edge according

1© 2018 Mellanox Technologies | Confidential

Diverging Switch Form FactorsDavid Iles – Mellanox Technologies

The Trend to Edge Computing


Workloads Moving Off Premise

On-Premise

Public Cloud

Edge


White Box Switches

Arista

Data Center Ethernet Switch Ports (10G & Above)

Source: Crehan Research and Mellanox Estimates


…a mixed bag

White Box for Public Cloud

Whitebox Switches Pros Right price Right port count Right NOS

Whitebox Switch Cons Limited VXLAN scale VXLAN + 100G + Routing RoCE limitations

Future for Public Cloud 200/400 Gigabit Ethernet COBO – Onboard Optics 277V Power Supplies Large scale tables/tunnels

White Box Switches:- Right Price

- Right Port count

- Wrong VXLAN scale

- Wrong VXLAN functionality

- Wrong for Machine Learning

- Wrong for NVME Fabrics


VXLAN is the tunnel of choice

Workloads are Moving Around

On-Premise

Public Cloud

Edge

VX

LA

N


Cloud Connect Acceleration

Millions of VXLAN tunnels 100K Tunnels per switch

On-Premise

Public Cloud

EdgeV

XL

AN

Come See

The Demo!


Not All Workloads are Moving Off Premise

On-Premise

Public Cloud

EdgeHyperconverged Infrastructure (HCI)

“Cloud in a box”

Cloud in your basement

8© 2018 Mellanox Technologies | ConfidentialSWaP for On Premise: Small, Fast, Flexible with Management Integration

Switches Optimized for On Premise Computing

Partial Rack Design(10/25GbE downlinks, 100GbE uplinks)

19’’

40/100GbE

1 4

1 10/25GbE link: SFP28 to SFP28

3 100GbE MLAG links: QSFP28 to QSFP28

2 100GbE Uplink: QSFP28 Transceiver

4 1GbE Transceiver

SN2010SN2010 3

2

Performance

Best $/Gb/s25G Ready

10G Optimized10G

½ 19” width, 1RU height

57W typical power

18x10/25GbE + 4x40/100GbE

On-switch Containers

41

SWaP = Size, Weight & Power


What’s the opposite of data center consolidation?

Edge Computing

On-Premise

Public Cloud

Edge

VX

LA

N

• Enterprise Edge

• Media Edge

• IOT Industrial Edge

• Mobile Edge


Edge Computing Projection

50 BillionDevices Connected to the Internet

50% of DataWill be Processed at Network Edge

according to IDC

$1.7 Billion2015

Micro Data Center Market (just facilities - does not include compute, network, storage)

$6.3 Billion2020

according to MarketsAndMarkets

By 2020:


What is Driving the Growth?

Mobile Edge

Autonomous Vehicles

IoT: Smart Cities

Virtual Reality

IoT: Industrial

Transportation

Hybrid Cloud / ROBO

Events

Disasters

Colocation

Edge / Micro Data Centers


What is a Micro Data Center?Small facility placing compute & storage close to users

Under 1 MW Power Sometimes under 100 KW

Locations Cell towers Central Offices On-premise / business park / sports arena On Transportation – ships, airplanes, submarines

Challenges Power, Cooling Limited Space Rapid/Remote Deployment, Zero Touch Ongoing operations/monitoring

Cell Sites

On Premise

Wherever You Want

On Transportation


Networks Optimized for Edge Computing

Performance

Automated

Cost Efficient

High Availability

Simple

Scalable

2 Switches in 1RU

Ultra Low Power <90 watts

Highly Scalable Data Center Interconnect (DCI)

Zero Packet Loss & Low Latency

RoCE optimized switches for NVMe-oF & Machine Learning

Zero Touch Provisioning

Network Visibility & Telemetry

Cost optimized

SWaP - Size, Weight, and Power Optimized for Micro Data Centers

https://www.mellanox.com/related-docs/prod_eth_switches/PB_SN2100.pdf





Protocols vs Telemetry

Legacy Mindset Webscale Mindset

Protocols Telemetry Features

PIM

HSRP

LACP

VPC

OSFPv2

RIPv2

EIGRP

SNMP

TACACS

UFD

PVRST/ MSTP

Private VLAN

Loop/Root/BPDU Guard

QOS

VRRP

VTP

GVRP

IGMP

TRILL

SPB

FabricPath

VCS

Qfabric

BGP

FCoE

BFD

FEX

OVSDB/VTEP

MLAG

QinQ

EVPN

LACP

BGP/BFD

SNMP

RMON

SPAN

CDP

SNMP

SPAN

ERSPAN

sFlow

IPFIX

SYSLOG

Packet Brokering

LLDP

Real-time Visibility Snapshots

Streaming Telemetry (GPB)

Packet Brokering

Buffer Histograms

Mirror Congestion

Mirror Drops

In Band Telemetry

In-situ OAM

RoCE Telemetry

Watermarks

SYSLOG

ERSPAN

SPAN

sFlow

LLDP

Come See

The Demo!


One Unifying Feature: Telemetry

Exhaustive Packet Drop Counters No mysterious uncounted drops

In-ASIC Switch Monitoring Tool Bandwidth & queue depth over time Microsecond sampling Hardware generated histograms Per port bandwidth (tx/rx) Per port delays from flow control Per queue monitoring

<10% 20% >90%

10 buckets per histogram

304

207

402

505

808

916

815

679

811

195

<10% 20% 30% 40% 50% 60% 70% 80% 90% >90%

Histogram - Egress Queue Utilization5000 samples in the last second – Port 1

Queue

Utilization

>90%

0-10%

90%

20%

30%

40%

304 times 207 times 195 times

Hardware checked the queue 5000 times in the last second

Here’s how many times the queue was at 10% utilization:


They are not just for shopping online

Histograms – a Tool for Analysis


In Band Telemetry

In-band advanced notifications Monitor network, Detect anomalies IP/TCP/GENEVE/VXLAN options Notify about Switch ID Egress port Egress queue Queuing bytes Queuing latency Time stamp

Passive in-band telemetry DSCP coloring according to ingress time Count drops on specific flows across fabric Monitor end-to-end high-latency

Payload

Payload

Queue,latency

Payload

Queue,latency

Queue,latency

Payload

Queue,latency

Queue,latency

Queue,latency

Payload

Analyze

Payload

Queue,latency

Queue,latency

Queue,latency

Queue,latency


Thank You

Documents

The Trend to Edge Computing - opencompute.org€¦ · Edge Computing Projection 50 Billion Devices Connected to the Internet 50% of Data Will be Processed at Network Edge according