Ethernet testing

©Xena Networks, November 2013 1

Ethernet Testing Morten Jagd Christensen [email protected]

Anders Rasmussen [email protected] n


Agenda

Part One (9:30 – 10:15) About Xena Networks Why testing? Scenarios and benchmarking Ethernet Switching

Part Two (10:20 – 11:05) Test Automation Testing at 100Gbit/s Xenas 100G Modules

Part Three (11:10 – 11:55) Live Demo Network configuration Xena Manager RFC2544 / RFC2899 Bachelor/Master projects

data unit layers


Corporate Profile

Founded 2007 by group of communica5ons professionals

Corporate HQ in Copenhagen (Denmark), Boston (US)

Self-‐funded through organic growth

Winner of global awards for price-‐performance leadership incl. Frost & Sullivan (2010 -‐ 2013) and Red Herring


Our vision ...

More companies are deploying Gigabit Ethernet to handle the exponential increase in data traffic.

This is driving the need for low-cost feature-rich Gigabit Ethernet testing solutions.

Xena Networks will meet this demand.

1.

2.

3.


Chassis

4U – high port density

12 slots for modules

Up to 72 x 10G or 6 x 100G test modules

1U – robust & transportable

XenaCompact

XenaBay


Customers … NETWORK EQUIPMENT MANUFACTURERS NETWORK SERVICE PROVIDERS

ENTERPRISE AND FINANCE

UNIVERSITIES AND RESEARCH

SEMICONDUCTOR VENDORS

DEPARTMENT OF DEFENSE

TEST LABORATORIES



Test Applications

R&D Labs –  Functional, conformance, and

negative device testing –  Stress loading

Manufacturing Q&A Sales and Marketing

–  Transportable Demo Racks

Installation & Maintenance –  Pre-staging –  Service turn-up –  Troubleshooting

Research Networks ─  Performance characterization ─  WAN research testbeds


Test types and standards

Test Types

!  Interoperability !  Compliance !  Capabilities

!  Mac tables, stated performance

!  Utilization !  Throughput !  Delay !  Jitter !  SLA/QoS/QoE

Standards

!  IEEE !  Interoperability

!  IETF !  RFC2544, RFC6349 !  RFC2889, RFC3918 !  RFC3511

!  ITU !  Y.1564


Ethernet - Framing

Packet length: 64 – 1518(+)

IFG: 12 bytes

Preamble: 7 bytes

Start of frame delimiter: 1 byte

Key parameters

Inter frame gap (IFG)

Ethernet Packet


PPS & BPS

PPS(64) = 14.881 M BPS(64) = 7.62 Gbit/s

PPS(1518) = 812743 BPS(1518) = 9.87 Gbit/s

Ethernet Speeds

Inter frame gap (IFG)

Ethernet Packet


MAC Address

http://standards.ieee.org/cgi-bin/ouisearch

00:01:C1 Exbit/Vitesse 00:10:FD Cocom/Cisco 00:11:CF T&T/Cobham 00:C0:76 i-data/ 04:F4:BC Xena Networks

‘My’ Vendor IDs


MAC Address

”The type/len field of the ethernet header, specifies next layer protocol”

Type Protocol

0x0800 IPv4

0x0806 ARP

0x8100 VLAN

0x86DD IPv6

0x8847 MPLS (unicast)

http://standards.ieee.org/develop/regauth/ethertype/eth.txt



0000 4c 8d 79 dc d5 6c 00 19 cb 97 7d 58 08 00 45 00 L.y..l.. ..}X..E.

0010 00 34 7a 5b 40 00 37 06 97 6e 57 f8 cf fd 0a 00 .4z[@.7. .nW.....

0020 00 05 00 50 e4 35 22 b1 e7 18 59 49 fe a7 80 11 ...P.5". ..YI....

0030 10 2c 52 a1 00 00 01 01 08 0a e2 a9 56 9f 4e dc .,R..... ....V.N.

0040 13 8e

0000 ff ff ff ff ff ff e0 06 e6 aa ac 3b 08 00 45 00 ........ ...;..E.

0010 00 4e 72 d9 00 00 80 11 b2 c5 0a 00 00 02 0a 00 .Nr..... ........

0020 00 ff 00 89 00 89 00 3a 14 d3 8b 21 01 10 00 01 .......: ...!....

0030 00 00 00 00 00 00 20 45 45 45 49 45 44 46 41 46 ...... E EEIEDFAF

0040 41 45 44 44 43 43 41 43 41 43 41 43 41 43 41 43 AEDDCCAC ACACACAC

0050 41 43 41 43 41 41 41 00 00 20 00 01 ACACAAA. . ..

Broadcast

Unicast


Switching

p1

p2 p0

p3

src A, dst B

Learning & Flooding


Switching

p1

p2 p0

p3

src A, dst B

src A, dst B

src A, dst B

A: p0 Learning & Flooding


Switching

p1

p2 p0

p3

src F, dst C

A: p0 Learning & Flooding


Switching

p1

p2 p0

p3

src F, dst C

src F, dst C src F, dst C

A: p0 F: p3

Learning & Flooding


Switching

p1

p2 p0

p3

src B, dst A

A: p0 F: p3

Learning & Flooding


Switching

p1

p2 p0

p3

src B, dst A

A: p0 F: p3

B: p2

Learning & Flooding


Switching

p1

p2 p0

p3

broadcast

A: p0 F: p3

B: p2

Learning & Flooding




"  Many basic tests can be performed manually (XenaManager).

"  However… –  Multiple parameters must be sweeped (packet size,

protocols, TX throughput…). –  Identical (and standardized) tests must be performed

to allow for a fair comparison between solutions and products.

–  Many parameters requires iterative test runs to be accurately determined.

"  Intelligent automation "  Ex. Max throughput without packet loss

Why use test automation


"  Program controls the test equipment, and possibly the Device Under Test (DUT), to test various scenarios.

"  Based on the results, the settings may be adjusted and the test rerun.

"  Collated results are presented in a nice and easy to interpret overview (graphs etc.)

Automatic testing


"  Generic test for networks and DUTs "  Result metrics

–  Throughput "  How much data can we push through the DUT? (without packet

loss)

–  Loss percentage (for fixed attempted throughput) "  At X% throughput how many% of packets are lost?

–  Latency "  What is the delay through the DUT?

–  Back-to-Back "  How many packets can be transmitted back-to-back (100%

throughput) without packet loss "  Tests the buffers in the system

"  All run for different packet sizes

Standard test: RFC 2544


"  Specific test for Ethernet switches "  Result metrics

–  Throughput –  Frame loss –  Forwarding rates –  Congestion Control –  Forward Pressure –  Address caching capacity –  Address learning rate –  Errored frames filtering –  Broadcast frame Forwarding and Latency

"  Fully meshed and partially meshed

Standard test: RFC 2889


"  Many equipment manufactures (including Xena) supplies a “scripting interface”.

"  Customers can design their own test scripts or even their own GUI –  There exists a custom Chinese “XenaManager”!

"  Any environment, which allows for a TCP connection can be used – Even Excel!

Custom testing


Excel ☺


Excel ☺



"  Joint project between DTU, Xena and TPACK (2009-2012): “The Road to 100 Gigabit Ethernet”.

Background


"  Pure software –  Usually* too slow for very high speed testing

"  Pure static hardware (ASIC) –  Very high performance –  Expensive in low quantities –  Inflexible

"  Xena uses a flexible FPGA (reconfigurable microchip) and software solution

How do we decide on a platform?


"  Combined hardware/software platform –  Software: Makes the complicated (low speed) decisions –  Hardware: Performs high-speed low complexity tasks

"  Flexible Field Programable Gate Array (FPGA) platform "  Can be reconfigured and updated/upgraded after deployment

The Xena platform


High Speed Testing

Software

Hardware


"  Verifies basic binary transmission (0’s and 1’s) "  Pseudo Random Binary Sequence testing is usually used:

"  Output: Bit-error-rate "  Weapon of choice for optics people ☺ "  Not very complicated for 100G operation

Physical Layer testing


"  PRBS is great but… –  Cannot test traffic, which is manipulated by the DUT

(no loop-through testing) –  Cannot test aggregated physical links –  No upper layers

"  We need to be able to check the upper layers such as the Ethernet (MAC) layer at 100Gbps –  This is a significant challenge compared to 10Gbps

What more do we need?


"  The raw data rate is in itself a challenge - but not the biggest

"  Higher layers (L2-3) = more processing (packet/frame based)

"  Maximum packet rate at 100Gbps is 149Mpps. –  Around 6ns to process each packet!

"  Realistic clock rates in a Field Programmable Gate Array (FPGA) is <400MHz –  We cannot just “overclock” the old 10G systems –  High level of parallelization is required: ½-1 packet per clock

cycle.

"  Memory access (if required) must be very fast

Why is 100G Ethernet challenging?


"  First step: –  Test Layer 1,5 (Framed

CGMII) –  Includes physical link

aggregation (100G uses 1-10 aggregated links)

–  Some framing –  No CRC –  No MAC address lookup

–  Allows for Xena/TPACK loopback

–  Proof of concept –  Proof of hardware

100GE testing


100GE testing


"  Second step –  Add Layers 2, 3 and 4

"  Full MAC/IP header processing –  CRC checksum –  Payload filters –  Packet statistics –  ………….

"  Speed up possibilities –  One 100G core (processes 1 packet per cycle) –  Multiple parallel 10G cores –  Overclock existing 10G cores

100GE testing


"  Layer 4-7 testing at >10G –  High general complexity (TCP, HTTPS, etc.) –  Very challenging to produce and analyse realistic

scenarios (thousands of users)

"  400GE –  The next evolution of Ethernet –  Not standardized yet –  Hopefully the hardware (FPGAs, memory etc.) will have

evolved by then ☺

What is next?





Xena Manager •  Controls XenaBay and XenaCompact

•  Easily create advanced traffic scenarios

•  Multiple streams per port •  Streams are identified by Test payload IDentifier: TID

•  Configurable Transmission Profile: •  Rate [pbs, pps, %] •  Packet length [fixed, random, increment, butterfly] •  Packet bursts

•  Configurable Content •  Packet structure [Ehternet, IP, UDP, …] •  Static content: DST IP = FF FF FF FF, … •  Dynamic content: Field modifiers

•  Field: SMAC •  Offset: 4 bytes •  Mask 0xFFFF •  Method: increment, decrement, random (+ repeat)


Custom Traffic Mix

TID 77: 50% UDP packets (b.fly) Min: 500, Max: 700

TID 88: 5% 2x VLAN (fixed) Len: 700

+ one burst of 5 packets every 45981ns

TID 99: 10% Ethernet (rand) Min: 300, Max 500

Unknown 5% IP (fixed) Len: 64

Streams

TID 77: ECN, DST IP, Payload pattern

TID 88: Payload pattern

TID 99: Payload increment

Unknown Payload random

Modifiers


Automated Test

• RFC 2889 Test • GUI

• RFC 2544 Test • Excel


Try the FREE live demo system

Visit http://www.xenanetworks.com/html/live_demo.html

1

2


Projects at Xena Networks


Master and Bachelor Projects

Sarah Ruepp Associate Professor DTU Fotonik [email protected]

or



0000 01 00 5e 7f ff fa 6c 88 14 ee a9 2c 08 00 45 00 ..^...l. ...,..E.

0010 00 a1 14 07 00 00 01 11 ab 3b 0a 00 00 10 ef ff ........ .;......

0020 ff fa e9 66 07 6c 00 8d 6e 0d 4d 2d 53 45 41 52 ...f.l.. n.M-SEAR

0030 43 48 20 2a 20 48 54 54 50 2f 31 2e 31 0d 0a 48 CH * HTT P/1.1..H

0040 6f 73 74 3a 32 33 39 2e 32 35 35 2e 32 35 35 2e ost:239. 255.255.

0050 32 35 30 3a 31 39 30 30 0d 0a 53 54 3a 75 72 6e 250:1900 ..ST:urn

0060 3a 73 63 68 65 6d 61 73 2d 75 70 6e 70 2d 6f 72 :schemas -upnp-or

0070 67 3a 64 65 76 69 63 65 3a 49 6e 74 65 72 6e 65 g:device :Interne

0080 74 47 61 74 65 77 61 79 44 65 76 69 63 65 3a 31 tGateway Device:1

0090 0d 0a 4d 61 6e 3a 22 73 73 64 70 3a 64 69 73 63 ..Man:"s sdp:disc

00a0 6f 76 65 72 22 0d 0a 4d 58 3a 33 0d 0a 0d 0a over"..M X:3....

IP Multicast


0000 33 33 00 01 00 03 e0 06 e6 aa ac 3b 86 dd 60 00 33...... ...;..`.

0010 00 00 00 21 11 01 fe 80 00 00 00 00 00 00 18 89 ...!.... ........

0020 ce 67 99 bc 87 f9 ff 02 00 00 00 00 00 00 00 00 .g...... ........

0030 00 00 00 01 00 03 fc 53 14 eb 00 21 81 a1 21 32 .......S ...!..!2

0040 00 00 00 01 00 00 00 00 00 00 07 64 68 63 70 70 ........ ...dhcpp

0050 63 32 00 00 01 00 01 c2.....

Anyone?


"  Connect to Live Demo / Xena Bay "  Walk through Modules and Ports

–  Reserve 100G port

"  Walk through tabs: –  Streams, Stats, Capture, Histograms, Global

"  Setup 100G stream and show Rx/Tx stats –  PRBS testing tab

"  Load port config multicast –  Show flooding


"  Load port config features "  Walk through 77, 88, 99, unknown streams "  Start streams – show Rx/Tx stats "  Capture from all streams

–  Show payload fill pattern and TPLD

"  Generate histogram for TID 88 –  Revisit stream id 88 –  Mention burst

"  Modify stream 77 –  Set IP address to 0A 00 XX YY

"  Capture and show in wireshark

Documents

Ethernet testing