22
••• 1 Ideas on Ideas on High Performance Computing High Performance Computing in Europe in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views of the European Commission” 44 th HPC User Forum Stuttgart, 6 October 2011 Pekka Karp European Commission - DG INFSO GEANT & e-Infrastructures

1 Ideas on High Performance Computing in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views

Embed Size (px)

Citation preview

Page 1: 1 Ideas on High Performance Computing in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views

••• 1

Ideas on Ideas on High Performance ComputingHigh Performance Computing

in Europein Europe

“The views expressed in this presentation are those of the author and do not necessarily reflect the views of the European Commission”

44th HPC User Forum Stuttgart, 6 October 2011

Pekka KarpEuropean Commission - DG INFSO

GEANT & e-Infrastructures

Page 2: 1 Ideas on High Performance Computing in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views

in producing knowledge through research

in diffusing it through education

in applying it through innovation

To be a genuinely competitive in the knowledge economy, one must be better

Page 3: 1 Ideas on High Performance Computing in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views

••• 3

Collaboration between European and worldwide research teams; access to rare/remote resources

Global high-speed communication infrastructures

Global Virtual Research Communities

Data-intensive science and innovation Use and manage exponentially growing sets of data

Experimentation in silico, simulation Use of high-performance computing

ICT a fundamental enabler for research & innovation

Page 4: 1 Ideas on High Performance Computing in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views

••• 4

The Communication on ICT Infrastructures for e-Science Com(2009) 108 asks:

“Building a new generation of supercomputing facilities”

Member States to scale up and pool investment in support of PRACE

Commission to define and support an ambitious European strategic agenda for supercomputing

Confirmed by the Conclusions of 2982nd Competitiveness Council of Dec. 2009

Page 5: 1 Ideas on High Performance Computing in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views

••• 5

Investments in HPC infrastructures require a long term perspective

Combine and reinforce the efforts of national and EU funding authorities - PRACE

Exploit the innovative potential of HPC services beyond science

Develop a new HPC strategy for industrial involvement

Transition to peta-scale and exa-scale computing creates new opportunities for both science and computing

Page 6: 1 Ideas on High Performance Computing in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views

••• 6

National

Tier-1 DEISA2/PRACE-2IP – €53 MHP-SEE & LinkSCEEM2

EU

Tier-0 –PRACE-1IP – €48 M

Local

Tier-2 + EUDAT, EGI – €60 Mnumerous other projects

Exa-s

cale

pro

toty

pes -

€42

M

Page 7: 1 Ideas on High Performance Computing in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views

••• 7

Collaborative Research into Exa-scale Systemware, Tools and Applications

3-year IP Project (October 2011 - September 2014)

Total budget: €12 M€ (€8.6 M EC contribution), 1008 PMs

Building and exploring appropriate system-ware for exa-scale platforms

Enabling a set of key co-design applications for exascale

Employing both incremental and disruptive solutions

6 full-scale science and engineering applications

EPCC, HLRS, CSC, PDC, Cray, TUD, Allinea, ABO, JYU, UCL, ECMWF, ECP, DLR

Page 8: 1 Ideas on High Performance Computing in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views

••• 8

Dynamical Exa-scale Entry Platform 3-year IP Project (October 2011 - September 2014)

Total budget: €16.2 M (€8 M EC contribution), 1313 PMs

Implementation of a Booster based on MIC processors and EXTOLL interconnect

Energy-aware integration of components

Basic strategy to port applications: Highly scalable kernels offloaded to the Booster part

Less scalable kernels executed on the Cluster part

Page 9: 1 Ideas on High Performance Computing in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views

••• 9

To develop an European exa-scale approach based on embedded power-efficient technology

3-year IP Project (October 2011 - September 2014)

Total budget: €14.5 M (€8.1 M EC contribution), 1095 PMs

Prototype HPC system based on European embedded processors

Design of a next-generation system

Open source system software stack

Up to 11 full-scale scientific applications

Page 10: 1 Ideas on High Performance Computing in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views

••• 10

• Partnership for Advanced Computing in Europe• 21 Countries joined forces to create a unique high-end

High-Performance Computing Research Infrastructure

• National co-investments of €400 M to deploy and operate up to four leading edge Tier-0 systems

• First Tier-0 system (1 petaflops) in Germany (JUGENE) • High interest in PRACE access calls (6 times oversubscribed)

• Address issues like more effective solar cells, biochemistry, fluid dynamics, particle and plasma physics, weather and climate models, material science, and astro-physics

• Study "Development of a Supercomputing Strategy in Europe“

• PRACE AISBL opened on 5 October 2010 in Brussels by Commissioner Kroes

• Second PRACE Tier-0 system (1.6 petaflops) in France (CURIE)

• Third PRACE Tier-0 system (1 petaflops) being installed (HERMIT)

• Study "Financing a Software Infrastructure for Highly Parallelised Codes“ 10

Page 11: 1 Ideas on High Performance Computing in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views

••• 11

2005 2006 2007 2008 2009 2010

a.u.

PR

AC

ED

EC

I

2011

DE

ISA

PR

AC

E T

ier-

02

syst

ems

“DE

CI”

PR

AC

Em

ore

th

an 1

5 P

F

2013

Page 12: 1 Ideas on High Performance Computing in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views

10% Loss

Page 13: 1 Ideas on High Performance Computing in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views

Only half o

f US

GDP spending

Page 14: 1 Ideas on High Performance Computing in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views

Europe 21%

Asia 34%

US

44%

Page 15: 1 Ideas on High Performance Computing in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views

••• 15

Europe has lost 10% of its HPC capabilities in the last 2 years while Asia and the US have increased their capabilities

Japan overtook Europe (all 27 Member States combined) in terms of HPC capacities available

Fragmentation of European HPC efforts across many countries

Some HPC production capabilities with reliance on foreign components and (sub) systems; European IPR benefitting others

Page 16: 1 Ideas on High Performance Computing in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views
Page 17: 1 Ideas on High Performance Computing in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views

HPC use

Science

Industry

Public service

Policy making

HPC systemsupply

95% US

EU market forhigh-end HPC: €630 M/yr

Application software & tools

HP

C E

cosy

stem

Page 18: 1 Ideas on High Performance Computing in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views

Basic premise:Europe should be a global HPC leader

excelling in the application and production of HPC, in all domains

(for industry, science and society)

Alternative:A follower is just fine, what matters is the applications Develop EU autonomous industrial capability

Alternative: continue to rely on systems from the US and others

HPC policy should be European Alternative: Member States continue with their

national (sub-critical) policies

Page 19: 1 Ideas on High Performance Computing in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views

Develop EU-level governance

Spend more (MS, EU, industry, training)

Development of EU native capability through

Pre-commercial procurement

Level-playing field for EU supply industry

Increase HPC use in industry, especially by SMEs

Share application and software development with global partners

Page 20: 1 Ideas on High Performance Computing in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views

••• 20

Support international collaborations that are strategic for global scientific partnerships, thus reinforcing Global Virtual Research Communities

Consolidate e-Infrastructures as a multi-disciplinary platform for global collaborations

Reinforce European research capacity in the domain of high performance computing (HPC)

Adopt adequate organizational and governance models

Use e-Infrastructures as platforms for technology experimentation at large scale (e.g. Future Internet)

Page 21: 1 Ideas on High Performance Computing in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views

••• 21

e-Infrastructures provide the underlying platforms for computationally intensive applications that enable international collaboration combining knowledge from different fields of science

HPC empowered e-Infrastructures integrate and make widely available national infrastructures and resources

e-Infrastructures implement a key EU policy and strategy -the European Research and Innovation Area

e-Infrastructures “facilitate” cohesion, standards, industry, etc.

New forms of organizations (Global Virtual Research

Organisations) emerge relying on high performance computing

Page 22: 1 Ideas on High Performance Computing in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views

••• 22••• 22

The Bits in Science and Innovation