National Center for Supercomputing Applications GLORIAD Science Applications Astronomy – Virtual Observatories Global Climate Change Richard M. Crutcher

National Center for Supercomputing Applications

GLORIAD Science ApplicationsAstronomy – Virtual Observatories

Global Climate Change

Richard M. Crutcher

Professor of Astronomy, University of Illinoisand

Senior Associate Director for Applications,National Center for Supercomputing Applications


What is NCSA?• United States National Science Foundation

funded center operated by the University of Illinois• Provides high-performance computing resources to

the U.S. academic community on basis of peer-reviewed proposals

• Non-U.S. researchers can collaborate with U.S. researchers and obtain supercomputing resources

• NCSA computing resources– 2 TFlop IBM Power 4, AIX operating system– 15 TFlop Pentium 4 Xeon cluster, Linux operating system– 10 TFlop Itanium 2 Teragrid cluster, Linux operating system


Extensible TeraGrid Facility

NCSA: Compute IntensiveSDSC: Data Intensive PSC: Compute Intensive

IA64

IA64 Pwr4EV68

IA32

IA32

EV7

IA64 Sun

10 TF IA-64128 large memory nodes

230 TB Disk Storage3 PB Tape Storage

GPFS and data mining

4 TF IA-64DB2, Oracle Servers500 TB Disk Storage6 PB Tape Storage1.1 TF Power4

6 TF EV6871 TB Storage

0.3 TF EV7 shared-memory150 TB Storage Server

1.25 TF IA-6496 Viz nodes

20 TB Storage

0.4 TF IA-64IA32 Datawulf80 TB Storage

Extensible Backplane NetworkLA

HubChicago

Hub

IA32

Storage Server

Disk Storage

Cluster

Shared Memory

VisualizationCluster

LEGEND

30 Gb/s

IA64

30 Gb/s

30 Gb/s30 Gb/s

30 Gb/s

Sun

Sun

ANL: VisualizationCaltech: Data collection analysis

40 Gb/s

Backplane Router

The National Virtual Observatory



What is the NVO?• An NSF-funded collaboration of astronomy data

providers and IT specialists

• A participant in the International Virtual Observatory Association

VO-India GAVO

KVO IDGAR=


Data Grid for Astronomy– Federation of diverse, distributed data & services

~103 catalogs, image archives, data collections currently on-lineArchive growth:

Sloan Digital Sky Survey: ~3 TB (today)Large Synoptic Telescope: 10 PB/year (2008)

– Infrastructure that enables difficult science• handling large datasets• integrating diverse data• integrating computational services

– Standards for interoperable information & data exchange

What is the NVO?






Example of research with the NVO

Cluster Galaxy Morphology AnalysisIntegrating Grid-based data archives

and computations


Galaxy Morphology: Science Goals• Investigate the dynamical state of galaxy clusters • Study galaxy evolution within context of large-scale

structure• Use galaxy morphology as probe of dynamical history:

For each galaxy in cluster, calculate three morphological parameters:• Surface Brightness

• Concentration Index

• Asymmetry Index

Compare parameters with other previously measured indicators:magnitude, color, peculiar velocity, position in cluster, x-ray gas emission


Galaxy Morphology: Procedure1. Choose a cluster

2. Obtain images of cluster from the optical & x-ray bandsshows 2 views of the large-scale structure of cluster

3. Create a catalog of galaxies in the cluster collect interesting properties of galaxies from existing catalogs

4. Obtain images of individual galaxies

“cutouts” from larger images using cutout service

5. Calculate morphology parameters from image cutouts

6. Merge calculated values into galaxy catalog

7. Visualize the results


Enabling Standards & Technologies• Data Formats

– FITS – an existing standard for astronomical images & tables– VOTable – an XML schema for transmitting astronomical tables

• Data Access Protocols– Cone Search – for searching catalogs by sky position

– Simple Image Access (SIA) – to search for/create images based on sky position

HTTP Get Queries return VOTable documents prototypes!

• Grid Technologies– Chimera & Pegasus – virtual data catalog and workflow management

• Replica Catalog Service – built-in caching of results on the grid

– Condor

Cluster Galaxy Morphology Analysis Portal

1.User’s Machine

webbrowser

User selectsa cluster

How it works



clusters

2. Look up clusterin internally storedcatalog

1.User’s Machine

webbrowser


How it works



clusters

Chandra SIA

Skyview SIA

DSS SIA


1.User’s Machine

webbrowser


3. X-ray and Optical Images retrieved via SIA interface

How it works



clusters

Chandra SIA

Skyview SIA

DSS SIA


1.User’s Machine

webbrowser



How it works

4. User launchesgrid-based analysis



clusters

Chandra SIA

Skyview SIA

DSS SIA


1.User’s Machine

webbrowser




NED Cone Search

CADC CNOC Cone Search

5. Initial Galaxy Catalog generated via Cone Search

How it works



clusters

Chandra SIA

Skyview SIA

DSS SIA


1.User’s Machine

webbrowser




NED Cone Search



DSS SIA

CNOC SIA

6. Image cutout pointers merged into catalog

How it works



clusters

Chandra SIA

Skyview SIA

DSS SIA


1.User’s Machine

webbrowser




NED Cone Search



DSS SIA

CNOC SIA


Morphology CalculationService

7. Morphological parameters calculated on grid for each galaxy

How it works



clusters

Chandra SIA

Skyview SIA

DSS SIA


1.User’s Machine

webbrowser




NED Cone Search



DSS SIA

CNOC SIA


8.

How it works

Morphology CalculationService

7. Morphological parameters calculated on grid for each galaxy


User downloads final table and images for analysis, visualization






Global Climate ChangeMajor Global Climate Change Concerns• Climate Change (“Global Warming”)• Stratospheric ozone depletion• Impacts on global air quality• Biodiversity and biospheric changesScientific requirements to resolve uncertainty and develop

meaningful policy• Require extensive use of large datasets from numerical

models & many observational programs• Require extensive international coordination in the

development and analysis of these datasets

Climate change as our example


Climate change is one of the biggest issues confronting humanity in the 21st century

Climate is the averaged trend of weather, or the typically expected conditions

Heat trapping gases emitted from human activities are driving significant changes in the climate

Climate change magnifies existing health, environmental and social problems


Temperature anomalies = change in temperature relative to 1880-1920

Natural forcing only Human forcing only

All forcings

Evaluation of the Change in Annual Global TemperatureEvaluation of the Change in Annual Global Temperature


Projected Global Surface

Temperature Response:

~ 1.5 to 5.8 °C by 2100

Relative to 1990

Ensemble of Climate Models

Derived Change in Annual Temperature for 2071-2100 relative to 1961-1990


Concerns about Concerns about Impacts of Climate Impacts of Climate

Change are at the Change are at the Local to Regional Local to Regional

LevelLevel

Also windsand severe weather events


Assessing Regional Climate Effects• Impacts happen locally -- Regional analyses of climate change

are essential to evaluating impacts

• Outputs from the large scale climate model are not adequate

– Global climate projections better understood than regional effects.

– Global models have grids of roughly 200 km x 200 km or bigger

– Need analyses to 10 to 30 km to capture local variations and impacts

• A complete assessment of climate change on human, ecological, and other systems is complicated by other stresses on these systems – many of which are human-related

– Multiple approaches and datasets need to be considered

• Dynamical downscaling approaches are being developed

– Regional scale models at the 10-50 km resolution or incorporation of nested grids at this resolution into global models


Large datasets need to be shared to resolve global change issues

Measurementdataset

User

SatelliteDataset

Modeling Dataset

User User

UserUser

UIUC Russia

NCAR

China

This requires Gbps capacity


Richard M. Crutcher

Professor of Astronomy, University of Illinoisand

Senior Associate Director for Applications,National Center for Supercomputing Applications

email: [email protected]

Documents

National Center for Supercomputing Applications GLORIAD Science Applications Astronomy – Virtual Observatories Global Climate Change Richard M. Crutcher