Upload
tatum
View
30
Download
0
Embed Size (px)
DESCRIPTION
Meteo-GRID: World-wide Local Weather Forecasts by GRID Computing. Claus-Jürgen Lenz, Detlev Majewski. Deutscher Wetterdienst PO Box 10 04 65 D - 63004 Offenbach am Main Germany e-mail: [email protected] http://www.dwd.de. C.-J. Lenz, D. Majewski, G.-R. Hoffmann. Contents: - PowerPoint PPT Presentation
Citation preview
Meteo-GRID:World-wide Local Weather Forecasts
by GRID Computing
Deutscher WetterdienstPO Box 10 04 65D - 63004 Offenbach am MainGermany
e-mail: [email protected]://www.dwd.de
C.-J. Lenz, D. Majewski, G.-R. Hoffmann
Claus-Jürgen Lenz, Detlev Majewski
Contents:
- Introduction to EUROGRID and Meteo-GRID
- Detailed Description of Meteo-GRID, computational requirements, status of work
- Demonstration example
Gesellschaft für Parallele Anwendungen und Systeme mbH
Pallas GmbHHermülheimer Straße 10D-50321 Brühl, Germany
[email protected]://www.pallas.com
www.eurogrid.org
Application Testbed for European GRID computing
Volume: 33 person years, 2 Million Euro fundingby European Commission Grant No. IST-1999-20247,Funding time: Nov. 2000 - Oct. 2003
EUROGRID Vision
Build a European GRID infrastructure
that gives users
a seamless, secure access to
High Performance Computing resources
and that advances computational science
in Europe
EUROGRID Goals
- Integrate resources of leading European HPC centres
into a European HPC GRID
- Develop new software components for GRID computing
- Demonstrate the Application Service Provider (ASP)
model for HPC access (‘HPC portal’) for different
applications
- Contribute to the international GRID development
Structure of the Work
• Application GRIDs:application-specific interfaces, evaluation of GRID solutions– Bio-GRID– Meteo-GRID – CAE-GRID
• HPC GRID Infrastructure:connect HPC centers using UNICORE technology
• Development and integration of new software components
• Dissemination and exploitation
European Testbed for GRID ApplicationsBio-GRID
• Operate a GRID for biomolecular simulations
• Develop interfaces to existing biological andchemical codes
Meteo-GRID
• Develop a relocatable version of DWD‘s weather prediction model
• Goal: ‘Weather prediction-on-demand‘ as an ASP solution
CAE-GRID
• Coupled simulations of aircrafts
• HPC portals for EADS engineers and for engineers at Daimler-Chrysler and partners
• Develop GRID technology for computing cost estimates and billing
HPC Research GRID
• Demonstrate a European HPC GRID testbed
• Develop new GRID applications
• Enable sharing of competence and know-how
• Agree on security standards, certification, access policies, ...
Technology Development• Build on the functionality of UNICORE
• Extend UNICORE to provide the middleware necessary for the Domain specific GRIDs
- Efficient data transfer
- Resource brokerage
- ASP services
- Application coupling
- Interactive access
EUROGRID Partners
HPC Centres
• CSCS Manno (CH)
• FZ Jülich (D)
• ICM Warsaw (PL)
• IDRIS Paris (F)
• Univ Bergen (N)
• Univ Manchester (UK)
Users
• Deutscher Wetterdienst
• EADS• T-Systems
(Assistant Partner)
Integration• Pallas (Project Coordinator)
• Fecit (Assistant Partner)
Goal of Meteo-GRID
To provide
high-resolution short range weather forecasts
with the
relocatable nonhydrostatic “Lokal-Modell” (LM)
of DWD
for any desired region in the world
Meteo-GRID
• Develop a relocatable version of DWD‘s weather prediction model
• ‘Weather prediction-on-demand‘ as an ASP solution
Meteo-GRID: Meteorological Portal
Hoffmann (DWD)
Meteo-GRID: Potential Users
• Use by other meteorological services
• Use by weather service providers
- commercial application
• Use by individuals via Internet
- weather forecast on demand
• Use by individuals via Mobile Telephones
- WAP services
Hoffmann (DWD)
What´s special about Meteo-GRID ? (1)
- Real-time weather forecasting is a time-critical task,
a 48-h forecast must be completed in less than
60 minutes
- LM is a large MPP code of about 100.000 lines of code,
Fortran95, MPI for message passing
- Weather forecasting is computationally expensive
~ 4000 Flop/grid point and time step
~ 15 Tflop for a 48-h forecast (160 x 160 x 35 grid points,
grid resolution ~ 7 km)
~ 3000 sec at a sustained speed of 5 Gflop/s
CPU requirements of LM
What´s special about Meteo-GRID ? (2)
- Weather forecasting requires high band width for data
transfer
Forecast data (at hourly intervals): (48+1) x 20 Mbyte = 1 GByte
Transfer in less than 1 hour: 2.4 Mbit/sec
- “Weather” has large social and economic impact
worldwide (storms, floodings, snow, freezing rain ...)
Damages following cyclone Lothar in southwestern Germany (26 Dec 1999)
Flood at Vistula river, summer 2001
Coastal storm at Hamburg and at the North Sea Blizzard in New York
Tasks of Meteo-GRID (1)
Selection of
- model domain,
- grid resolution,
- forecast date,
- forecast range and
- forecast products
using a Graphical User Interface (GUI)
Meteo-GRID GUI (1)
Nellari, Ballabio (CSCS Manno)
Meteo-GRID GUI (2)
Nellari, Ballabio (CSCS Manno)
Tasks of Meteo-GRID (2)
Derivation of
topographical data
for the selected model domain from high-resolution
(1 km x 1 km) data sets (GIS) at DWD
Examples for TOPO applications (1)
Examples for TOPO applications (2)
water
peat
clay
loamy clay
loam
loamy sand
sand
rock, concrete
ice, glacier
undefined
Examples for TOPO applications (3)
Tasks of Meteo-GRID (3)
Derivation of
- an initial data set and
- lateral boundary data sets
for LM from data of the global model GME of DWD
(Oracle data base)
GME model grid and LM domain
Tasks of Meteo-GRID (4)
- LM forecast run is performed on any supercomputer
available in EUROGRID using UNICORE technology
- Forecast data (GRIB code) are returned to the user
via UNICORE and the Internet
OR . . .
Tasks of Meteo-GRID (5)
OR . . .
- Visualization of LM forecasts ( 1 to 5 dimensional
graphics) on the HP Computer and subsequent
- Return of image files to the user via UNICORE
and the Internet
- Verification and validation of LM forecasts for any
region worldwide
Information and data flow in Meteo-GRID (1)
1.1. Set up of LM-domain Set up of LM-domain
User
Global topographicaldata set (GIS),~ 7 GByte
Topographical data set(1 - 5 MByte)
DWDDWDDWDDWD
GUI:GUI:Selection of- domain corners- grid resolution- forecast date- forecast range- forecast products
Calculation at DWD onSGI Origin O 2000 orIBM RS/6000 SP (5 - 30 min wallclock time)
Information and data flow in Meteo-GRID (2)
2. Define forecast date and range
GME data base (Oracle)
Hourly initial and lateral boundarydata sets on GME grid (~ 50 MByte)
User DWDDWDDWDDWD
Extraction of GME results covering the LM domain at DWD (SGI Origin O 2000 or IBM RS/6000 SP)
Information and data flow in Meteo-GRID (3)
3.3. Perform LM-forecast on EUROGRID HPC and send forecast data to userPerform LM-forecast on EUROGRID HPC and send forecast data to user
User DWDDWDDWDDWD
Topographical data set
Initial and lateral boundarydata sets on GME grid
HPCGME2LM
interpolation of GME results to LM grid
LMcalculation of weather forecast
1 - 5 MByte
1 - 20 GByteLM-forecast datavisualisation
~50 MByte
Initial and hourly lateral boundarydata sets on LM grid (1 - 20 GByte)
For more Information . . .
about DWD: http://www.dwd.de
about Pallas GmbH: http://www.pallas.com
about UNICORE: http://www.unicore.de
http://www.fz-juelich.de/unicoreplus/index.html
about EUROGRID: http://www.eurogrid.org