Bringing Mexico Into the Global LambdaGrid

Dr. Larry SmarrDirector, California Institute for Telecommunications and

Information TechnologyHarry E. Gruber Professor,

Dept. of Computer Science and EngineeringJacobs School of Engineering, UCSD

Calit2 WorkshopFebruary 2, 2006

Developing International Research Collaborations:Mexico

• UCSD Meeting on Joint CICESE/Calit2 Proposal Sept 2002• SDSU’s Eric Frost Talk at CUDI Meeting at CICESE April 2003• Arzberger PRAGMA talk-CUDI in Puebla, Mexico October 2003• Visit by CICESE and CONACYT to Calit2 Jan 2004• Visit by Calit2 and OptIPuter to CICESE March 2004• Visit by CICESE and CONACYT to Calit2 AHM April 2004

Jaime Parada, Felipe Rubio, & Carlos Duarte at the Calit2 All Hands Meeting

UC San DiegoRichard C. Atkinson Hall Dedication Oct. 28, 2005

Two New Calit2 Buildings Will Provide Major New Laboratories to Their Campuses

• New Laboratory Facilities– Nanotech, BioMEMS, Chips, Radio, Photonics,

Grid, Data, Applications– Virtual Reality, Digital Cinema, HDTV, Synthesis

• Over 1000 Researchers in Two Buildings– Linked via Dedicated Optical Networks– International Conferences and Testbeds

UC Irvine

www.calit2.net

Preparing for an World in Which Distance Has Been Eliminated…

The Calit2@UCSD Building is Designed for Prototyping Extremely High Bandwidth Applications

1.8 Million Feet of Cat6 Ethernet Cabling

150 Fiber Strands to Building;Experimental Roof Radio Antenna Farm

Ubiquitous WiFiPhoto: Tim Beach,

Calit2

Over 10,000 Individual

1 GbpsDrops in the

Building~10G per Person

UCSD is Only UC Campus with

10GCENIC

Connection for ~30,000 Users

UCSD is Only UC Campus with

10GCENIC

Connection for ~30,000 Users

24 Fiber Pairs

to Each Lab

Challenge: Average Throughput of NASA Data Products to End User is < 50 Mbps

TestedOctober 2005

http://ensight.eos.nasa.gov/Missions/icesat/index.shtml

Internet2 Backbone is 10,000 Mbps!Throughput is < 0.5% to End User

fc *

Dedicated Optical Channels Makes High Performance Cyberinfrastructure Possible

(WDM)

Source: Steve Wallach, Chiaro Networks

“Lambdas”Parallel Lambdas are Driving Optical Networking

The Way Parallel Processors Drove 1990s Computing

10 Gbps per User ~ 200x Shared Internet Throughput

San Francisco Pittsburgh

Cleveland

National Lambda Rail (NLR) and TeraGrid Provides Cyberinfrastructure Backbone for U.S. Researchers

San Diego

Los Angeles

Portland

Seattle

Pensacola

Baton Rouge

HoustonSan Antonio

Las Cruces /El Paso

Phoenix

New York City

Washington, DC

Raleigh

Jacksonville

Dallas

Tulsa

Atlanta

Kansas City

Denver

Ogden/Salt Lake City

Boise

Albuquerque

UC-TeraGridUIC/NW-Starlight

Chicago

International Collaborators

NLR 4 x 10Gb Lambdas Initially Capable of 40 x 10Gb wavelengths at Buildout

NSF’s TeraGrid Has 4 x 10Gb Lambda Backbone

Links Two Dozen State and Regional Optical

Networks

DOE, NSF, & NASA

Using NLR

CUDI-CENIC Fiber Dedication at Border Governor’s Conference, July 14, 2005

OsakaProf. Aoyama

Prof. Smarr

Torreon Conference---Fiber Dedication Linking Mexico and US, crossing at San Diego-Tijuana

• Shared Security

• Energy

• Trans-National Crime

• Education and Research

• Business Development

US Mexico

Arnold

Culmination of Three Years of Work Between Calit2,

CICESE, CENIC, and CUDI

http://www.cudi.edu.mx/

CICESE, CONACYT, CUDI, and Telmexat iGrid2005

September 26-29, 2005

UCSD

StarLight Chicago

UIC EVL

NU

CENIC San Diego GigaPOP

CalREN-XD

8

8

Expanding the OptIPuter LambdaGrid

NetherLight Amsterdam

U AmsterdamSARA

NASA Ames

NASA GoddardNLRNLR

2

SDSU

CICESE

via CUDI

CENIC/Abilene Shared Network

1 GE Lambda

10 GE Lambda

PNWGP Seattle

CAVEwave/NLR

NASA JPL

ISI

UCI

CENIC Los Angeles

GigaPOP

22

AIST (Japan)KISTI (Korea

www.glif.isVisualization courtesy of

Bob Patterson, NCSA.

www.glif.is

Created in Reykjavik, Iceland 2003

The Global Lambda Integrated Facility--Countries are Aggressively Creating Gigabit Services

We are Very Close to Setting Upa Gigabit Lambda Between Calit2 and CICESE

Source: Raúl Hazas, CICESE

Goal—Upgrade Access Grid to HD Streams Over IP on Dedicated Lambdas

Access Grid Talk with 35 Locations on 5 Continents—SC Global Keynote Supercomputing 04

OptIPuter Scalable Adaptive Graphics Environment (SAGE) Allows Integration of HD Streams

Source: David Lee, NCMIR, UCSD

• Live Streaming Video of the RTS-2000 Microscope

•HD Video from Remote BIRN Site

• Macro View of Montage Data

• Micro View of Montage Data

•HD Video from the RTS Microscope Room

SAGE Developed Under

Jason Leigh, EVL

The OptIPuter Enabled Collaboratory:Remote Researchers Jointly Exploring Complex Data

OptIPuter will ConnectThe Calit2@UCI

200M-Pixel Wall tothe 100M-Pixel Display

at Calit2@UCSDWith Shared Fast Deep Storage

“SunScreen” Run by Sun Opteron Cluster

UCI

UCSD

Combining Telepresence with Remote Interactive Analysis of Earth Sciences Data Over NLR

OptIPuter Visualized Data

HDTV Over Lambda

Live Demonstration of 21st Century National-Scale Team Science

August 8, 2005

Scripps Institution of Oceanography, UCSD, La Jolla, CA

Goddard Space Flight Center, Maryland

First Trans-Pacific Super High Definition Telepresence Meeting in New Calit2 Digital Cinema Auditorium

Keio University President Anzai

UCSD Chancellor Fox

Lays Technical Basis for

Global Digital

Cinema

Sony NTT SGI

The Sargasso Sea Experiment The Power of Environmental Metagenomics

• Yielded a Total of Over 1 billion Base Pairs of Non-Redundant Sequence

• Displayed the Gene Content, Diversity, & Relative Abundance of the Organisms

• Sequences from at Least 1800 Genomic Species, including 148 Previously Unknown

• Identified over 1.2 Million Unknown Genes

MODIS-Aqua satellite image of ocean chlorophyll in the Sargasso Sea grid about the BATS site from

22 February 2003

J. Craig Venter, et al.

Science 2 April 2004:

Vol. 304. pp. 66 - 74

Marine Genome Sequencing ProjectMeasuring the Genetic Diversity of Ocean Microbes

CAMERA will include All Sorcerer II Metagenomic Data

Flat FileServerFarm

W E

B P

OR

TA

L

TraditionalUser

Response

Request

DedicatedCompute Farm(100s of CPUs)

TeraGrid: Cyberinfrastructure Backplane(scheduled activities, e.g. all by all comparison)

(10000s of CPUs)

Web(other service)

Local Cluster

LocalEnvironment

DirectAccess LambdaCnxns

Data-BaseFarm

10 GigE Fabric

Calit2’s Direct Access Core Architecture Will Create Next Generation Metagenomics Server

Source: Phil Papadopoulos, SDSC, Calit2+

We

b S

erv

ice

s

Sargasso Sea Data

Sorcerer II Expedition (GOS)

JGI Community Sequencing Project

Moore Marine Microbial Project

NASA Goddard Satellite Data

Community Microbial Metagenomics Data