Building Flexible High Density Nexus Switches · PDF fileBuilding Flexible High Density 40/100G Fabrics with Cisco Nexus Switches Anant Shah, Sr. Product Manager PSODCT-1013 •

Building Flexible High Density 40/100G Fabrics with Cisco

Nexus SwitchesAnant Shah, Sr. Product Manager

PSODCT-1013

• Cisco Unified Fabric

• Nexus Modular Portfolio Update

• Nexus Fixed Portfolio Update

• NX-OS innovations

• Building Flexible 40/100G Fabrics with Nexus Portfolio

• References

Agenda

Session Abstract

The session will start with an overview of the Nexus 9000,7000 switches

followed by the latest updates to Nexus 2000 thru Nexus 6000 Switches

portfolio and will also include recent key NX-OS innovations

This session will help audience understand how the Cisco Nexus switches

series switches can help build highly dense & scalable 40/100G fabrics in

there Data Center networks. It will also cover some high level design options

using the portfolio above.

Cisco Unified Fabric

Cisco Unified Fabric

Intelligence

Scale

Convergence

Network

Storage

Management

Data Center Fabric Delivering on DC Application Needs

Distributed

Fabric-Based

ComputeCompute Storage Storage Services Services

Application-Driven

Private Cloud

Comp

ute

Comp

ute

Stora

ge

Stora

ge

Servic

es

Servic

es

Comp

ute

Comp

ute

Stora

ge

Stora

ge

Servic

es

Servic

es

Private Cloud Public Cloud

Cisco SDN: Providing Choice in Automation and Programmability

DB DB

Web Web App Web App

Turnkey integrated solution with

security, centralized management,

compliance and scale

Automated application centric-policy

model with embedded security

Broad and deep ecosystem

Application Centric Infrastructure

VxLAN-BGP EVPN

standard-based

3rd party controller support

VTS for software overlay

provisioning and management

across N2K-N9K

Programmable Fabric

Modern NX-OS with enhanced

NX-APIs

Automation Ecosystem (Puppet, Chef, Ansible etc.)

Common NX-API

across N2K-N9K

Programmable Network

Cisco Nexus

5000/5600

CiscoNexus 7000/7700

Cisco Nexus

3000/3100/3200

CiscoNexus 2000

/2300

DC and Cloud Networking Portfolio – Nexus FamilyReady to Lead the 10/40G/100G Transition

CiscoNexus 9000

APICAVSACI

Cisco Nexus 1000V

OPEN

APIs/ Open Source/ Application Policy Model

HIGH PERFORMANCE FABRIC

1/10/40/100 GE

SCALABLE SECURE SEGMENTATION

VXLAN

Ecosystem

10+ Years of Proven NX-OS Operating System

Resilient, Scalable Fabric

Workload Mobility Within/ Across DCs

LAN/SAN Convergence

Operational Efficiency—P-V-C

Architectural Flexibility

Cisco Nexus 6000

Nexus Modular Portfolio Update

Nexus 9500and

Nexus 7000

TWO operational models for Nexus 9KCommon Hardware Platform

APPLICATION CENTRIC INFRASTRUCTURE

NX-OS

Since 2013

Existing Network Model

PROGRAMABILITY—40 GigE—PRICE/PERFORMANCE

APIC

Since 2014

Modular Nexus 9500Common Components

Three Chassis Options

4, 8 and 16 Payload Slot 9504 9508 9516

Industry Most Dense 40G

Devices (upto 576x40G Port)

Supervisor

Redundant ConfigurationSUP-A 4-Core, 16G

Memory, 64G SSD

SUP-B 6-Core, 24G

Memory, 256G SSD

Faster BGB Convergence

System Controller

Redundant Configuration ARM 1.3 GHz Dual Core, Chassis Mgmt

Power Supply

N+N, N+1 Redundancy

3000W AC PSU, 92% Efficient

3000W HV AC/DC PSU, 92% Efficient

Modular NX-OS Enabled Line cards

1) High Performance 100G/40G Aggregation - X9600 Series Line Cards

2) Entry Level 10G/40G Access & Aggregation - X9400 Series Line Cards

3) Performance 10G/40G - X9500 Series Line Cards

X9600 Series Line cards

40G Line card

X9400 Series Line card

10G SFP+ and 10G BASE-T Line card

40G Line card

100G Line card

• 40G Flows - 8p

• 100G Line card – True 100G Flows

X9500 Series Line card

10G SFP+ and 10G BASE-T Line card

40G Line card

40G Fiber

9636 (36x40G)

9432 (32x40G)

9536 (36x40G)

10G Copper

9464 (48x10G+4x40G)

9564 (48x10G+4x40G)

10G Fiber

9464 (48x10G+4x40G)

9564 (48x10G+4x40G)

9736 (36x40G)

ACI

Modular Nexus 9500 Line Card Modules

100G Fiber

9408 (8x100G)

Standalone

Cisco Nexus 7700 Platform SwitchesValue Proposition of the Cisco Nexus 7700 Platform

26 R

U

14 R

U

9 R

U

Cisco Nexus® 7700

10-Slot

Cisco Nexus® 7700

18-Slot

Cisco Nexus® 7700

6-Slot

Environmental EFFICIENCY True front-to-back airflow

Smaller FOOTPRINTMore compact

Fabric BANDWIDTH1.32 Tbps

Capacity

100G Density

40G Density

1G / 10G Density

Nexus 7718

83 Tbps

192

384

768

Nexus 7710

42 Tbps

96

192

384

Nexus 7706

21 Tbps

48

96

192

Cisco Nexus 7702All the N7K Innovations in 3 RU

Evolved Security

MACSec for DCI

Cisco TrustSec – SGT, SXP,

and SGACLs

Control Plane Policing

The New Modular Cisco Nexus 7702 Switch

Operational

Consistency

Same NX-OS software

across all Nexus 7000

and 7700 Series Switches

Optimized for Small DC

Aggregation and Core

Comprehensive Layer 2 and

Layer 3 features

(VDC, FEX, VPC, FabricPath,

Robust Routing)

Designed for DCI

Comprehensive DCI and Edge

features

(OTV, LISP, MPLS L2/L3, and

VXLAN)

Modularity

Supports Nexus 7700

Sup2E, F3, and PS

modules.

Services Chassis

Ideal for ITD

and RISE services

Nexus 7000 Series F3 Module PortfolioIndustry’s Most Feature Rich Data Center Module

F3 12-port 100G ModuleN77-F312CK-26

Nexus 7700 100GNexus 7700 10GF3 48-port 10G Module

N77-F348XP-23

F3 24-port 40G ModuleN77-F324FQ-25

Nexus 7700 40G

F3 12-port 40G ModuleN7K-F312FQ-25

Nexus 7000 40GF3 6-port 100G Module

N7K-F306CK-25

Nexus 7000 100GNexus 7000 10GF3 48-port 10G Module

N7K-F348XP-25

Nexus Fixed Portfolio Update

Nexus 9300 & Nexus 3000

Fixed Nexus 9300 - Switches

40G Fiber10G Fiber

9396 (48x10+12x40G)

10G Copper

9396 (48x10+12x40G)

93128 (96x10+8x40G)Leaf

Sp

ine

9336 (36x40G)

9372 (48x10+6x40G) 9372 (48x10+6x40G)

9332 (32x40G)

93120T (96x10+6x40G)

Nexus 3000 Platform

Cisco Nexus®

3000 Platform

Nexus 3172TQNexus 3172PQ Nexus 3132Q-X48 x 10G,

6 x 40GE Uplinks

48 x 10GBaseT ,

6 x 40G Uplinks

32x40G-QSFP ,2x10G

• Higher Density

• Larger buffers to absorb traffic bursts

• Lower Power - ~10-30% more efficient

• Programmable

• 100M-100G Architecture

• Low Latency

Aug 2014 Nov 2014

Nexus 3264Q64x40G-QSFP+

SoC Architecture Programmable Architectural Flexibility

Nexus 3232C32x100G QSFP28

NEW NEW

5 Million+Ports Shipped 95,000+ Chassis Shipped 4,000+ Customers Building on Nexus 3000

FEX Family Success

Aug 2014

Cisco Live San Diego 2015

Nexus 3112896 x 10G ,

8 x 40G Uplinks

NEW

Announcing Nexus 3200 – Industry’s 25/50G and 10/40/100G Platform

Addressing Scale and Performance Needs of HPC And Cloud Data Center Customers.

Nexus 3264Q – 2RU 64p 40G QSFP+Nexus 3232C – 1RU 32P 100G QSFP28

Efficient

~50% Low power/Gbps

~300-400ns Latency

Architectural Flexibility

10G/25G/40G/50G/100G

Spine/Leaf Architecture

Programmability

RPM,Python,POAP

CHEF, PUPPET, NX-API

Nexus 2k,5k,6k.

NEXUS 5600 SERIES

Nexus 5672UP7.0(1)N1(1)

Nexus 56128P7.0(2)N1(1)

Nexus 5624Q7.1(0)N1(1a)

Nexus 5648Q7.1(1)N1(1)

Nexus 5696Q7.0(4)N1(1)

Switch Fabric

Throughput1.44 Tbps 2.56 Tbps 1.92 Tbps 3.84 Tbps 7.68 Tbps

Port-to-Port Latency ~1.0 us

Layer 3 Capability Integrated Line-Rate

Switch Footprint 1RU 2RU 1RU 2RU 4RU

10 Gigabit Ethernet

Port 72 128 96 192 384

40 Gigabit Ethernet

Port6 8 24 48 96

Unified Ports 16 48 N/A N/A 160 *

1/10 Gigabit Ethernet

With FEX1152 1152 1152 1152 2304

Packet Buffer 25MB per 3x40G (or 12x10G)

SC

AL

ED

EN

SIT

YP

ER

FO

RM

AN

CE

* Current software supports 60 ports

Nexus 2300 Platform Fabric Extender

20 Million+ Ports Shipped 400,000+ Chassis Shipped 10,000+ Customers Building on Nexus 2000 FEX Family

Success

ACL Classifications and QOS

Cisco Nexus®

2200 Platform

Nexus 2348TQNexus 2348UPQ Nexus 2332TQ

48 x 10G + 6 x 40GE Uplinks

Unified Ports Capable

48 x 10GBaseT

+ 6 x 40G Uplinks

32 x 10GBaseT

+ 4 x 40G Uplinks

• Higher Density with Native 40GE Uplinks

• Larger buffers to absorb traffic bursts

• Unified Port Capable (UP models)

• Lower Power - 10% more efficient

• Intra-rack Forwarding Capable – Reduce uplink traffic

• Supported on Nexus 5000, 6000 today

• Nexus 7000/9000 support – June/July 2015

Aug 2014 Nov 2014 Cisco Live Milan 2015

Single Point of Management Scalability FCOE

NX-OS Innovations

Driving Infrastructure Transformation

Simplify Infrastructure Management

Modular, Multi-vendor Interoperability

Adaptable Operating System

Enabling Business Innovation Velocity

Automation Innovation Consistency

MODULAREASE OF

OPERATIONSOPEN 3rd PARTY APP

INTEGRATIONPROGRAMMABILITY READY FOR

DEVOPS

POAP NXAPI

Linux/Python

Daemon

Standard Open Interfaces

Standard Open Interfaces

Automation and Visibility

Adaptable NXOS

Adaptable NXOS

Automation and Visibility

BootStrap and ProvisioningBootStrap and Provisioning

Package and Application Management

Package and Application Management

Server Management Tools

Server Management Tools

PXEData

Models

Enabling Automation and DevOpsOpen NX-OS and NXAPI

VxLAN Tunnel Endpoints with Layer 2 and Layer 3 Gateways

Virtual Extensible LAN (VxLAN)

VxLAN Encapsulated Packet

BRKDCT-1408

Introduction to Overlay

Networks and Use Cases

Cisco Integrated Traffic Director (ITD)Enabling Scalable and highly available data-centers

Application/Services scaling

Multi-Tbps Scale

VIP based L3/L4 server load-balancing Redirect Traffic to Web-cache,

video-cache, WAE etc.

Create Multi-Tbps Firewall

Significant CAPEX and OPEX reduction

Supported on all Nexus 2k,3k,7k and 9k

40/100G Designs with Nexus

High Density Most Compact IP FabricHow to build the highest density and lowest latency design!

6 spine

96 leaf

40G port count: 576 Target Latency: ~1.5 usecs

N5696Q24 spine

384 leaf

10G ports: 9,216 Target Latency: ~1.4 usecs

10G Fabric

N3548X

40G port count: 72 Target Latency: ~750 nsecs 10G port s: 1,152 Target Latency: ~600 nsecs

3548X

3548X

6 spine

12 leaf

24 spine

48 leaf

40G Fabric

12 spine

96 leaf

40G port count: 576 Target Latency: ~1.1 usecs

N3132X24 spine

384 leaf

10G ports: 3,072 Target Latency: ~1.usecs

N3548X

Example of 2000 10G Access Ports40G Fabric and 100G Core

Highlights:

• Architectural Flexibility

- L2 Fabric with Traditional vPC

- L3 Fabric with Overlay, with VxLAN

- Support for Physical or Multi-Hypervisor Environments

• Cisco Differentiation

• Programmable API’s.

• MP-BGP VXLAN overlay.

• Scalable.

• Flexibility for SFP/10GT.

• Huge Cost Savings with Bidi Optics as no cabling upgrades required for 40G

Nexus

9500

Nexus

9500

N9372N9372

N9372

2 x Nexus 9506 Switches

2 x 9536 & 1 x 9408 per N9504 (1 more slot available for growth)

42x 9372 Switches

BiDi Optics

6:1 Oversubscription

CORE

100G

6:1

Lin

era

te

Example of 2000 10G Access Ports

40G Fabric and 100G Core

Highlights:


- L2 Fabric with Traditional vPC or FabricPath

- L3 Fabric with Overlay, DFA or IGP/BGP

- Converged Fabric with LAN/SAN/FCOE and Unified Ports



• Feature Versatility with F3 Modules & N5600

• Network Segmentation with VDCs & Segment-ID

• Multiple Encapsulations OTV, LISP, VXLAN, FabricPath, MPLS


N7706 N7706

N56128N56128

N56128


2 x F3-40G & 1 x F3-100G per N7706 (1 more slot available for growth)

22 x 56128P Switches

BiDi Optics


CORE

100G

6:1

Lin

era

te

Example of 7000 10G Access Ports10G FEX Connectivity - 40G Fabric and 100G Core

Highlights:

• Architectural Flexibility with L2, L3 or Converged Fabrics

• Scalable 1/10G host ports & 40G Uplinks with N2248PQ

• Flexibility to add services, 40G hosts & DCI




• Cost effective FEX connectivity with Bidi

N7710 N7710

N5696Q N5696QN5696Q


4 x F3-40G & 3 x F3-100G per N7710 (1 more slot available for growth)

12 x N6004X Switches with 6 x 40G LEMs per N6004X (2 more LEM Slots available for growth)

144 x N2348UPQ with BIDI

BiDi Optics between N6004X & N7710

100G

3:1

Lin

era

te

1/1

0 G

1/1

0G

3:1

N5696Q

2x 4

0G

2x 4

0G

CORE

N2348UPQN2348UPQ

Example of 2000 10G Access Ports

40G Fabric and 100G Core

Highlights:



- Pure L3 Fabric or L3 Fabric with Overlay


- Low Latency


• No Modular Boxes

• Programmable API’s

• Scalable


3264Q 3264Q

N31128N31128

N31128

2 x 3264Q

22 x 31128P Switches

BiDi Optics


CORE

100G

6:1

Lin

era

te

Nexus

9500

Nexus

9500

N9332N9332

N9332


3 x 9536 & 1 x 9408 per N9508 (4 more slots available for growth)

42 x 9332 Switches

BiDi Optics

6:1

CORE

100G

Lin

era

te


Example of 1000 40G Access Ports 40G Fabric and 100G Core

Highlights:



- L3 Fabric with Overlay, with VxLAN



• Programmable API’s.

• MP-BGP VXLAN overlay.

• Scalable.


Nexus

7710

Nexus

7710

5648QN5648Q

5648Q


4 x F3-40G & 1 x F3-100G per N7710 (4 more slots available for growth)

42 x 5648Q Switches

BiDi Optics

6:1

CORE

100G

Lin

era

te



Highlights:


- L2 Fabric with Traditional vPC or FabricPath

- L3 Fabric with Overlay, DFA or IGP/BGP

- Converged Fabric with LAN/SAN/FCOE and Unified Ports



• Feature Versatility with F3 Modules & N5600




Nexus

9508Nexus

9508

3132X/

3232C 3132X/3

232C

3132X/3

232C

6:1

CORE

100G

Lin

era

te



Highlights:







• Scalable



3 x 9636 & 1 x 9408 per N9508 (4 more slots available for growth)

42 x 3132X Switches

BiDi Optics

Nexus

3264Q

Nexus

3264Q

3264Q3264Q

3264Q

6:1

CORE

100G

Lin

era

te



Highlights:





- Low Latency



• Scalable


2x Nexus 3264Q Spine

21 x 3264Q Switches for Leaf

BiDi Optics

References

References• Nexus 9500 Switches Datasheet http://www.cisco.com/c/en/us/products/collateral/switches/nexus-9000-series-

switches/datasheet-c78-729404.html

• Nexus 9500 40G Module www.ciscohttp://www.cisco.com/c/dam/en/us/products/switches/nexus-9000-series-switches/nexus-9500-40GE-modules-comparison.html

• Nexus 7700 Module Datasheet www.cisco.com/en/US/prod/collateral/switches/ps9441/ps9402/data_sheet_c78-728423.html

• Cisco Nexus 5600 Landing Page http://www.cisco.com/c/en/us/products/switches/nexus-5000-series-switches/index.html

• Cisco Nexus 3000 Landing Page cisco.com/go/nexus3000

• Cisco Nexus ACIcisco.com/go/aci

http://www.cisco.com/c/en/us/products/collateral/switches/nexus-9000-series-switches/datasheet-c78-729404.html

http://www.cisco.com/en/US/prod/collateral/switches/ps9441/ps9402/data_sheet_c78-728410.html

http://www.cisco.com/c/dam/en/us/products/switches/nexus-9000-series-switches/nexus-9500-40GE-modules-comparison.html

http://www.cisco.com/en/US/prod/collateral/switches/ps9441/ps9402/data_sheet_c78-728423.html

http://www.cisco.com/c/en/us/products/switches/nexus-5000-series-switches/index.html

cisco.com/go/nexus3000

cisco.com/go/aci

Complete Your Online Session Evaluation

Don’t forget: Cisco Live sessions will be available for viewing on-demand after the event at CiscoLive.com/Online

• Give us your feedback to be entered into a Daily Survey Drawing. A daily winner will receive a $750 Amazon gift card.

• Complete your session surveys though the Cisco Live mobile app or your computer on Cisco Live Connect.

Continue Your Education

• Demos in the Cisco Campus

• Walk-in Self-Paced Labs

• Table Topics

• Meet the Engineer 1:1 meetings

Thank you

Documents

Building Flexible High Density Nexus Switches · PDF fileBuilding Flexible High Density 40/100G Fabrics with Cisco Nexus Switches Anant Shah, Sr. Product Manager PSODCT-1013 •