15 May 2003

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH

Cecelia DeLuca / NCAR2nd ESMF Community MeetingPrinceton, NJ

                 

NSIPP Seasonal ForecastNCAR/LANL CCSM

NCEP ForecastGFDL FMS Suite

MITgcm

NASA GSFC PSAS

ESMF Design Overview andImplementation Strategy

15 May 2003

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH

Outline

• ESMF Design Goals• ESMF Design Strategies• Architecture and Features• Implementation Strategy

15 May 2003

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH

ESMF Design Goals

• Composable, swappable, nestable model components for building Earth system applications

dyn

assimatm

hurr_sim

phys

assim_atmocean

15 May 2003

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH

ESMF Design Goals (cont.)• Reusable toolkits for grid operations and

routine utilities• Performance portability and ease of use in a

complex, transient computing environment• Application and infrastructure codes that are

maintainable and extensible

15 May 2003

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH

ESMF Design Goals (cont.)• Flexibility

– To allow unconstrained scientific development– To encourage technical innovation– To support partial adoption of framework services– To accommodate different programming models

15 May 2003

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH

Outline

• ESMF Design Goals• ESMF Design Strategies• Architecture and Features• Implementation Strategy

15 May 2003

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH

Architecture

External Libraries

Low Level Utilities

Fields and Grids Layer

Model Layer

Coupling Layer

ESMF Infrastructure

User Code

ESMF Superstructure

BLAS, MPI, NetCDF, …

Composable, swappable, nestable model components for building Earth system applications

Reusable toolkits for grid operations and routine utilities

Performance portability and ease of use in a complex, transient computing environment

15 May 2003

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH

ESMF Design Approach

• Component-based architecture: large, functionally related pieces of software (e.g., atmosphere, land models) interact through well-defined interfaces

• Object oriented design: smaller, functionally related pieces of software are bundled into modules containing data and methods

• Layered design: details of platform and parallelism are not visible at the highest level interfaces

Application and infrastructure codes that are maintainable and extensible

15 May 2003

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH

ESMF Design Approach (cont.)Flexibility• To allow unconstrained scientific development• To encourage technical innovation• To support partial adoption of framework services• To accommodate different programming models

• Physical interfaces to components are not prescribed• Designed to be compatible with user-managed intra-

component communication• Extensible for new grids / algorithms / comm libraries• Many ESMF services may be used independently • Allows arbitrary placement of inter-component

communication

15 May 2003

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH

Outline

• ESMF Design Goals• ESMF Design Strategies• Architecture and Features• Implementation Strategy

15 May 2003

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH

General Features

• ESMF will be usable by models written in F90/C/C++• ESMF will be usable by models requiring adjoint capability• ESMF will be usable by models requiring shared or

distributed memory parallelism semantics• ESMF will support sequential and concurrent modes of

execution• ESMF will support several I/O formats, including

GRIB/BUFR, netCDF, HDF• ESMF will have uniform syntax across platforms• ESMF will target a broad range of platforms, from major

centers commodity hardware

15 May 2003

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH

ESMF Services

event alarmsperformance profilingI/O primitivescommunication primitives, etc.

Low-Level Utilities

transpose, halo, etc.abstract machine layout

Parallel Utilities

grid metadatagrid decomposition

Grids

field metadatafield and field bundle datafield I/O

FieldsFields and Grids

components (gridded, coupler, app)states

Components / Coupling

15 May 2003

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH

Field: Halo( ), Import( ), Export( ) + I/O

ESMF Components

2. ESMF provides a toolkit that components use to

i. increase interoperability

ii. improve performance portability

iii. abstract common services

Component: Init( ), Run( ), Checkpoint( )

Grid: Regrid( ), Transpose( ) + Metrics

DELayout, PE List, Machine Model

Application Component

Gridded Components Coupler Components

1. ESMF provides an environment for assembling geophysical components into an application.

15 May 2003

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH

ESMF Version 1.0

MachineModel

Layout

DistGridPhysGrid

State

Bundle

GriddedComponent

Array

Utilities: TimeMgr, Config, LogErr, I/O etc.

F90

Superstructure

Infrastructure

Field

Grid

Regrid

Comm

Data Communications

Design CompleteLimited PrototypeFuller Prototype

Route

CouplerComponent

C++

ApplicationComponent

15 May 2003

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH

Outline

• ESMF Design Goals• ESMF Design Strategies• Architecture and Features• Implementation Strategy

15 May 2003

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH

Implementation Strategy for ESMF Version 1.0

Infrastructure

Superstructure

• Sufficient breadth to prototype how all major parts of the ESMF system will interact

• Well-developed superstructure (Components and States)

• Basic functions in most infrastructure classes

15 May 2003

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH

Implementation Strategy for ESMF Version 1.0 (cont.)

• Sufficient depth to develop simple ESMF applications

• Groundwork laid for high performance communication, uniform API across shared/distributed memory, load balancing capability

• Fully developed F90/C++ interoperability strategy

Infrastructure

Superstructure

15 May 2003

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH

Implementation Strategy for ESMF Version 1.0 (cont.)

Infrastructure

Superstructure

Over the next year:• Development of grid and parallel

regrid services• Continued work on communication,

decomposition, and other utilities• Organization, standardization, fine-

tuning interfaces• Hardening and optimizing

implementation• Extending and polishing

documentation and tutorial examples

15 May 2003

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH

Development Focus

Near-term framework development focus is on creating sufficient infrastructure and superstructure to achieve the initial set of interoperability experiments.

These are:– FMS B-grid atmosphere coupled to MITgcm ocean– CAM atmosphere coupled to NCEP analysis– NSIPP atmosphere coupled to DAO analysis

15 May 2003

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH

The Team• Fields and Grids

– Nancy Collins, Jon Wolfe, David Neckels

• Regrid– Phil Jones

• Time + Machine Model/Comms– Earl Schwab

• Benchmarks– Gerhard Theurich

• Web and Admin– Robbie Stauffer

• I/O– Nancy Collins, Atanas Trayanov

• Profiling and logging– Shep Smithline, Erik Kluzek

• Attributes– Leonid Zaslavsky, Nancy Collins

• System Tests and Demos– Silverio Vasquez, Nancy Collins,

Jon Wolfe• Build

– Dennis Flanigan

15 May 2003

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH

More information

ESMF website: http://www.esmf.ucar.edu

On the website:• Information about the Community Meeting• ESMF documents • ESMF browsable source code repository • On-line forms for community input and catalogued responses• Milestone schedule, project archives and history, related projects• Management plan, board and team contacts• More …