Hans-Werner Braun Ronn Ritke NLANR/MNA (UCSD/SDSC)
http://moat.nlanr.net/ Funded by the National Science
Foundation/CISE/ANIR NLANR/MNA Measurement and Network
Analysis
Slide 2
Goals and objectives Creation of the Network Analysis
Infrastructure (NAI) to support measurements and network analysis
header traces, performance, statistics Network measurement and
analysis research activities Tool development for analysis and
visualizations All data, analyses, graphs, visualizations, and
tools are made public available for use by all researchers.
Slide 3
Public Interface Internet Trace User Community Attendance and
presentation at meetings Host PAM2003 Workshop. Result reporting
for the high performance environment Web interface newsletters
(Networking Analysis Times, Packets) published papers
Internet Trace User Community Led by Joerg Micheel We are
seeking constructive discussion on monitor placement strategies,
trace duration, trace variety, etc. For example, a number of
researchers have requested longer duration traces. As a result, a
set of passive traces from Auckland that consists of single and
multiple day duration traces were made available. Researchers have
published at least 7 papers based on those traces. Which PMA trace
summaries are most helpful in allowing other researchers to choose
from available trace data sets?
Slide 6
Completely noninvasive, no impact on forwarding paths.
Aggregated traffic signature at a measurement point. OC3/OC12, ATM
and POS, OC48 (develop OC192 capability). Between June 2000 and Jan
2001 (7 months) 6,000 PMA trace files were downloaded (31 per day)
from at least 193 different sites. Trace analysis summaries include
(total packets, Bytes, top port numbers by volume, top 100
throughput connections, etc.) (Passive traffic collection and
analysis at optical carrier speeds) Passive Measurement and
Analysis (PMA) project
Slide 7
NCAR U. Colorado, Boulder AIX/MAE-West NASA-Ames Argonne Nat.
Lab U. of Michigan Michigan State U. Ohio State U. STARTAP/APAN
Rice U. Baylor College of Medicine U. of Houston Texas A&M U.
Old Dominion U. MCNC North Carolina State U. U. of North Carolina
Duke U. U. of Florida Miami U. Florida State U. 26 September 2000
SDSC, U. California, San Diego Passive measurement deployment
status FDDI OC3 ATM OC3 PoS OC12 ATM OC12 PoS NCSA FIX-West Tel
Aviv U. (I-2) Colorado State Front Range GigaPoP Texas GigaPoP U.
Memphis Indiana State Columbia U.
fiber connection end-point optical interfaces with own
subsystem (e.g., DAG3, FORE) main system memory host system bus
optical interconnection optical splitters fiber connection
end-point host collection and analysis process Passive monitor
components
Slide 10
Automated packet header trace collection 036912151821 n seconds
(e.g., 90) measurement collected every three hours from measurement
objects random start in first hour, but synchronized across
machines sent to central collector (via encrypted ssh) daily
analysis and encoded traces created encoded files available via ftp
and http maximum time for delayed start time for network analysis
tasks remaining available time for transmission NAIMOAT
Slide 11
Active Measurement Project (AMP) Led by Tony McGregor Focus on
site-to-site measurement across high performance networks Attempt
to deploy FreeBSD-based AMP machines at all HPC sites about 130
machines currently deployed and operational RTT, topology, and
loss; user/event driven throughput We currently measure RTT to each
of the other monitors every minute and the route to each every 10
minutes
Slide 12
23 February 2000 UCSD Active measurement deployment status SDSU
UIowa Princeton Dartmouth NCREN/NCSC BU UCSC NCSA UMass GATech UCB
CSU-SB UCBoulder NCAR Harvard SDSC UMiami Duke CMU/PSC UAB
UWashington FSU UWyoming FNAL UWisc- Milwaukee UNC-CH UArizona
UC-Irvine UWaikato NTNU NSF SDSMT Oklahoma State Washington State
U. Stanford UCLA UVirginia UDel UKansas UFlorida UMd UNM UA
UVermont UOregon Kansas State MIT JHU ColoState Rice WUSTL IU
UMissouri Mississippi State ODU Montana State NCSU UCF NDSU Emory
U. WVU UMich SLAC GMU URochester MSU Yale USF UofUtah CSUPomona
Columbia Iowa State PSU SMU UPenn UMBC Georgetown UAH UIC UAlaska
UWisc UofOklahoma UC NWU ACCESS ASU Vanderbilt Oregon State Startap
MTU WSU UofGeorgia UConn UTK UHawaii UIUC NMSU
Slide 13
AMP web info (1)
Slide 14
AMP web info (2)
Slide 15
AMP web info (3)
Slide 16
Event Detection Tony McGregor AMP system consists of around 130
monitors in a full mesh. A set of graphs is available for each of
the approximately 14,000 measured paths. The Automated Event
Detection is a system for detection of events in data collected by
active monitors. The system is divided into algorithms; each
algorithm detects one class of network event. Currently, three
algorithms are implemented. The "Plateau Detector" detects a change
in the base RTT between a pair of monitors. A second algorithm
detects a change in the RTT variance over a path. While the last
algorithm triggers when packet losses are above an input threshold
value.
Slide 17
Collaborations Internet2 1. regarding the IPLS router
instrumentation at the Indiana GigaPOP (Joerg Micheel in
discussions with Matt Zekauskas). 2. continuing discussions with I2
researchers regarding AMP involvement in E2E project (Tony
McGregor, Ronn Ritke). 3. participation on the Internet2 End-to-End
Performance Initiative Design Team (Ronn Ritke). Deployment of AMP
machines at NASA Goddard and JPL. The machine at JPL is part of the
JPL Performance Reference System. We now have AMP monitors at LBNL,
SLAC, Argonne National Lab and Fermi DOE facilities.
Slide 18
Collaborations (Contd) Phil Dykstra and Cindy Dykstra,
WareOnEarth (WCI, Inc.) regarding the AMP peer network with Defense
Research and Engineering Network (DREN), as well as other
activities. Other NLANR sites and their researchers and
administrators, including weekly conference calls, and other
activities. Kevin Walsh and Jay Dombrowski network systems group at
SDSC (SDSC Enterprise Network Services [ENS]) on creating the data
compute engine/repository containing a replica of AMP data, as well
as additional activities.
Slide 19
International Collaborations Discussions with Tom DeFanti have
included the monitoring of STAR LIGHT, and early insertion of
optical splitters to allow quick installation of PMA machines. We
are in talks with AMPATH regarding the placement of an OCXmon and
AMP machine to measure the traffic from AMPATH. We are in contact
with Greg Cole of FASTnet (formerly MIRnet) and are discussing
several possible measurement activities.
Slide 20
International Collaborations (Contd) We have a PMA monitor in
Israel, and AMP machines in Korea, Norway, Australia, and New
Zealand (soon Japan). We are working with Canada, Korea, and
Australia to help them install their own local AMP meshes. We are
working with the Pacific Rim Applications & Grid Middleware
Assembly (PRAGMA) effort at SDSC. Interest has also been expressed
by other countries (Japan and Thailand) in both the AMP and PMA
projects.
Slide 21
KOREA Network Map : ~2001 HPCnet SingAREN STAR TAP KIX Seoul XP
KwangjuTaejonSeoul HPCnet APAN Tokyo XP Suwon Renater 2 TaeguPusan
ATM/SONET 155Mbps/310Mbps ATM/SONET 622Mbps 2M ATM 8M 2M 45M
Slide 22
Slide 23
Hans-Werner Braun Ronn Ritke NLANR/MNA (UCSD/SDSC)
http://moat.nlanr.net/ Funded by the National Science
Foundation/CISE/ANIR NLANR/MNA Measurement and Network
Analysis
Slide 24
Goals and objectives Creation of the Network Analysis
Infrastructure (NAI) to support measurements and network analysis
Network measurement and analysis research activities Tool
development for analysis and visualizations All data, analyses,
graphs, visualizations, and tools are made public available for use
by all researchers.
Slide 25
Completely noninvasive, no impact on forwarding paths.
Aggregated traffic signature at a measurement point. OC3/OC12, ATM
and POS, OC48 (develop OC192 capability). Between June 2000 and Jan
2001 (7 months) 6,000 PMA trace files were downloaded (31 per day)
from at least 193 different sites. Trace analysis summaries include
(total packets, Bytes, top port numbers by volume, top 100
throughput connections, etc.) (Passive traffic collection and
analysis at optical carrier speeds) Passive Measurement and
Analysis (PMA) project
Slide 26
NCAR U. Colorado, Boulder AIX/MAE-West NASA-Ames Argonne Nat.
Lab U. of Michigan Michigan State U. Ohio State U. STARTAP/APAN
Rice U. Baylor College of Medicine U. of Houston Texas A&M U.
Old Dominion U. MCNC North Carolina State U. U. of North Carolina
Duke U. U. of Florida Miami U. Florida State U. 26 September 2000
SDSC, U. California, San Diego Passive measurement deployment
status FDDI OC3 ATM OC3 PoS OC12 ATM OC12 PoS NCSA FIX-West Tel
Aviv U. (I-2) Colorado State Front Range GigaPoP Texas GigaPoP U.
Memphis Indiana State Columbia U.
Slide 27
Active Measurement Project (AMP) Led by Tony McGregor Focus on
site-to-site measurement across high performance networks Attempt
to deploy FreeBSD-based AMP machines at all HPC sites about 130
machines currently deployed and operational RTT, topology, and
loss; user/event driven throughput We currently measure RTT to each
of the other monitors every minute and the route to each every 10
minutes
Slide 28
23 February 2000 UCSD Active measurement deployment status SDSU
UIowa Princeton Dartmouth NCREN/NCSC BU UCSC NCSA UMass GATech UCB
CSU-SB UCBoulder NCAR Harvard SDSC UMiami Duke CMU/PSC UAB
UWashington FSU UWyoming FNAL UWisc- Milwaukee UNC-CH UArizona
UC-Irvine UWaikato NTNU NSF SDSMT Oklahoma State Washington State
U. Stanford UCLA UVirginia UDel UKansas UFlorida UMd UNM UA
UVermont UOregon Kansas State MIT JHU ColoState Rice WUSTL IU
UMissouri Mississippi State ODU Montana State NCSU UCF NDSU Emory
U. WVU UMich SLAC GMU URochester MSU Yale USF UofUtah CSUPomona
Columbia Iowa State PSU SMU UPenn UMBC Georgetown UAH UIC UAlaska
UWisc UofOklahoma UC NWU ACCESS ASU Vanderbilt Oregon State Startap
MTU WSU UofGeorgia UConn UTK UHawaii UIUC NMSU
Slide 29
AMP web info (1)
Slide 30
AMP web info (2)
Slide 31
AMP web info (3)
Slide 32
International Collaborations Discussions with Tom DeFanti have
included the monitoring of STAR LIGHT, and early insertion of
optical splitters to allow quick installation of PMA machines. We
are in talks with AMPATH regarding the placement of an OCXmon and
AMP machine to measure the traffic from AMPATH. I recently attended
a meeting in Russia with Greg Cole of NaukaNet (formerly Fastnet)
and are discussing several possible measurement activities.
Slide 33
International Collaborations (Contd) We have a PMA monitor in
Israel, and AMP machines in Korea, Norway, Australia, and New
Zealand (soon Japan). We are working with Canada, Korea, and
Australia to help them install their own local AMP meshes. We are
working with the Pacific Rim Applications & Grid Middleware
Assembly (PRAGMA) effort at SDSC. Interest has also been expressed
by other countries (Japan, China and Thailand) in both the AMP and
PMA projects.
Slide 34
KOREA Network Map : ~2001 HPCnet SingAREN STAR TAP KIX Seoul XP
KwangjuTaejonSeoul HPCnet APAN Tokyo XP Suwon Renater 2 TaeguPusan
ATM/SONET 155Mbps/310Mbps ATM/SONET 622Mbps 2M ATM 8M 2M 45M
Slide 35
Slide 36
AARNets International Connections Current and Planned Singapore
South Asia Middle East Europe APAN Abilene CANet GEANT StarTap Fiji
Global GRID Forum South America AARNet International Transit
Network Japan New Zealand Taiwan Hawaii SLO Seattle PNG Sydney
Perth
Slide 37
Possible CA*net 4 Topology January 1, 2002 Halifax Edmonton
Seattle Vancouver Winnipeg Quebec City Montreal Ottawa Chicago
Halifax New York Regina Fredericton Charlottetown Victoria Windsor
London Sudbury Thunder Bay Saskatoon Kamloops Buffalo Spokane
Minneapolis Albany St. John's Calgary Toronto Prince George
Hamilton Kingston CA*net 4 Node Mini-IX Possible Future Breakout
Possible Future link or Option CA*net 4 OC192