APAN perfSONAR deployment

Takatoshi Ikeda APAN-JP/KDDI

Agenda • Background • APAN perfSONAR Deployment • Use Cases

2014/8/11 perfSONAR Workshop, APAN 38th meetings in Nantou 2

Self-Introduction • Takatoshi Ikeda

– Living in Tokyo, Japan

• Job Titles – KDDI

• Japanese Telecommunication Company – APAN-JP NOC – NICT (National Institute of Information and Communications Technology)

• Visiting fellow

• In charge of – the engineering and operation for:

• APAN-JP, JGN-X , TEIN-JP – Deploying the measurement environment in the Asian R&E Networks

• Deploying the perfSONAR in Japanese R&E networks • Support of deployment in Asian R&E networks

– Active on advanced use of the perfSONAR • Visualization • Use with SDN

2014/8/11 perfSONAR Workshop, APAN 38th meetings in Nantou 3

Agenda • Background • APAN perfSONAR Deployment • Use Cases

2014/8/11 perfSONAR Workshop, APAN 38th meetings in Nantou 4

Motivation

2014/8/11 perfSONAR Workshop, APAN 38th meetings in Nantou 5

Global Projects Tele-Medicine / Tele-education

(APAN medical WG, SOI) High Energy Physics

(LHC, ITER)

Radio Astronomy Observatory (e-VLBI, ALMA)

Hi-definition Video Transfer (CineGrid)

2014/8/11 perfSONAR Workshop, APAN 38th meetings in Nantou 6

Agenda • Background • APAN perfSONAR Deployment • Use Cases

2014/8/11 perfSONAR Workshop, APAN 38th meetings in Nantou 7

APAN Network Topology

2014/8/11

APANの絵

perfSONAR Workshop, APAN 38th meetings in Nantou 8

Lawrence Berkeley National Laboratory U.S. Department of Energy | Office of Science

Toolkit Deployment (Note: There is now enough critical mass to be really useful)

2014/8/11 9

Lawrence Berkeley National Laboratory U.S. Department of Energy | Office of Science

Global perfSONAR Deployment* Organization Number of Domains Number of

perfSONAR hosts

ESnet 1 96

Internet2 1 27**

US Regional networks 27 63

US Universities 69 152

US Govt/DOE Labs 11 30

Canada 11 40

South America 3 4

Europe 42 81

Asia/Pacific 20 38

Africa 3 3

Commercial 9 27

Unclassified** - 243***

Total 197 802 *Captured from Lookup Service – Sept 6th 2013 ** Only 3 showing up in Lookup Service for some reason ***Private Address Space, Lack of DNS records, IPv6 Only, etc.

2014/8/11 10

Asia-Pacific perfSONAR Deployment

2014/8/11 perfSONAR Workshop, APAN 38th meetings in Nantou 11

Deployed APAN Networks • AU

– AARnet • CN

– CERNET – CNGI-6IX

• HK – HARNET

• JP – APAN-JP – JGN-X – SINET

• KR – KOREN – KREONET

2014/8/11

• LK – LEARN

• PH – PREGINET

• PK – PERN

• TH – NECTEC – UniNet

• TW – ASGC – TWAREN

perfSONAR Workshop, APAN 38th meetings in Nantou 12

APAN-JP and JGN-X Deployment

2014/8/11

Deployment Services

gLS

hLS

SNMP MA

PS-BUOY(BWCTL)

PS-BUOY(OWAMP)

L2 Status

Fukuoka

Singapore

Bangkok

Hong Kong

Tokyo *2

Tokyo

Osaka

Fukuoka

perfSONAR Workshop, APAN 38th meetings in Nantou 13

Spec. of APAN-JP perfSONAR Host

Throughput Tester Delay Tester

HW chassis Supermicro SuperServer SYS-6015W-NTRV

Supermicro SuperServer 6013P

CPU Intel Xeon X5677 *1 Intel Xeon 3.06GHz *2

Memory DDR3 1333Hz ECC Registered 4G x2

DDR266 1GB * 2

HDD 500GB x2 (Host RAID, RAID1) SAS 73GB * 2 (RAID1)

NIC 1G: On-board 10/100/1000 Myricom 10G-PCIE-8B-S+E

On-board 10/100/1000 * 2

SW pS-performance Toolkit v3.3.2 pS-performance Toolkit v3.3.2

2014/8/11 perfSONAR Workshop, APAN 38th meetings in Nantou 14

Agenda • Background • APAN perfSONAR Deployment • Use Cases

2014/8/11 perfSONAR Workshop, APAN 38th meetings in Nantou 15

Visualization of Multi-domain measurement data

2014/8/11

Multi-domain traffic weather MAP Multi-domain L2 path monitoring

Graphs of performance measurement data

Case 1

perfSONAR Workshop, APAN 38th meetings in Nantou 16

Detection of performance degradation • Interface error in TransPAC LA POP

Measurement data between APAN Tokyo XP and TransPAC LA POP

TCP Throughput

Traffic

Performance degradation

Throughput degradation gradually

It was aware of performance degradation and resolved

Case 2

2014/8/11 perfSONAR Workshop, APAN 38th meetings in Nantou 17

Network Control based on network condition

• Integration of network control (NSI/Openflow) and measurement (perfSONAR) – Application-driven dynamic path and routing – Transport specific application across dedicated dynamic path to achieve higher

performance than shared path – Path provisioning and changing triggered by delay or loss

Case 3

2014/8/11 perfSONAR Workshop, APAN 38th meetings in Nantou 18

Workflow diagram

Loss

Only Video Streaming

Case 3

2014/8/11 perfSONAR Workshop, APAN 38th meetings in Nantou 19

APAN Performance Matrix

• Goal Monitoring the performance of Asian R&E Networks and provide the best performance to the researchers

• Description – Displaying the result of performance measurement among

APAN members in the matrix • Doing periodical measurement among APAN members • Showing that result in matrix

• Implementation

– perfSONAR MeshConfig – perfSONAR MadDash (Monitoring and Debugging

Dashboard)

Case 4

2014/8/11 perfSONAR Workshop, APAN 38th meetings in Nantou 20

• Measurement Metrics – Throughput(TCP)

• BWCTL/iperf • Measurement 30 seconds per 2 hours

Measurement Metric and Site

• Measurement Site

– APAN-JP • Tokyo, QGPOP(Fukuoka)

– KREONET（Korea) • Daejeon

– PREGINET • Manila

– TEIN • HK (Hong Kong), SG (Singapore),

MB (Mumbai)

– TransPAC3 • Los Angeles

– UniNet • Bangkok

– NECTEC • Bangkok

– AARnet • Sydney

– TWAREN • Taipei

Case 4

2014/8/11 perfSONAR Workshop, APAN 38th meetings in Nantou 21

Measurement Results So

urce

Destination

http://ps1.jp.apan.net/maddash-webui/

Case 4

Some Updates will be presented @ Network Engineering Workshop, Aug.14

2014/8/11 perfSONAR Workshop, APAN 38th meetings in Nantou 22

"Measure what is measurable, and make measurable what is not so”

-Galileo Galilei

2014/8/11 perfSONAR Workshop, APAN 38th meetings in Nantou 23

Thank you