HPCI 3rd project report meeting, October 21, 2016, TOKYO

Dr. Sergio Bernardi Member of PRACE Board of Directors

PRACE second phase: progressing toward a larger and

stronger European HPC infrastructure

for science excellence and competitiveness

PRACE is an international not-for-profit association under Belgian law, with its seat in Brussels.

PRACE has 25 members and 2 observers.

PRACE is governed by the PRACE Council in which each member has a seat. The daily management of the association is delegated to the Board of Directors.

PRACE is funded by its members as well as through a series of implementation projects supported by the European Commission. Computing resources are made available by a group of members (Hosting Members)

Partnership for Advanced Computing in Europe

The PRACE Governance Council

•Is the Decision making body •Has One representative for

each Member State •Helds 3 meetings / year

Scientific Steering Committee (SSC)

•Composed of 21 European leading scientists (of which 6 are ERC grant holders) •Provides advice and guidance on all matters of a scientific and technical nature

Access committee

•Composed of world-class researchers experienced in areas of science, engineering and supercomputing •Gives advice to the Board of Directors concerning the allocation of resources

Industrial Advisory Committee (IAC)

•Includes representatives of 11 different industrial sectors •Provides PRACE with advice on HPC usage for the benefit of European competitiveness and economic growth

Strategy Working Group (SWG) •To discuss strategic issues in between PRACE Council meetings •To identify opportunities and threats for PRACE •To work on strategic subjects delegated by the Council

Council

BoD

SSC

Access Committee

IAC PRACE AISBL

SWG

Mission: enabling world-class science through large scale simulations Offering: HPC resources on leading edge capability systems

Resource award: through a single and fair pan-European peer review process for open research

PRACE AISBL as persistent pan-European supercomputing infrastructure

Open R&D access for industrial users (> 50 companies supported)

PRACE achievements so far

465 scientific projects enabled

530 M€ of funding for the 2010-2015 period (PRACE initial phase)

≈ > 7000 people trained in 6 PRACE Advanced Training centers (PATC) and other events

50 Pflop/s of aggregated peak performance on 7 world-class systems

12.2 thousand million core hours awarded since 2010 by peer review

The road went so far

2004-2006

• HPCEUR • HET • Scientific

case

2007

• HPC in ESFRI roadmap

• HPC vision involving 15 countries

• PRACE initiative started

2008-2010

• PRACE preparatory phase project

• EC funding from the FP7

April 2010

• PRACE AISBL created

• HQ office in Brussels

• 1° call for project access launched

2010-2015

• PRACE IP projects (1-4)

• PCP for energy efficiency launched

• Regular calls (2 per year)

• Industry and SME support

• Expanding training (PATC)

• End of PRACE initial period

2016

• PRACE members agreement on new funding model

• New HM : Switzerland

• PRACE 2 starts issuing Call 14 for more than 2000 M core/h

PRACE 2: the PRACE Programme

provisioning of a federated world-class Tier-0 supercomputing infrastructure that is architecturally diverse;

a unique transparent peer review process for resource allocation, exclusively based on scientific excellence;

coordinated high-level application support teams that provide users with second and third level application support on the Tier-0 systems;

implementation actions in the areas of dissemination, industry collaboration, training, as well as the exploration of future supercomputing technologies that will include additional application enabling investments coordinated with the support team efforts.

Evolution of PRACE: PRACE 2 Programme

The overarching goal of PRACE is to provide a federated European supercomputing infrastructure that is science driven and globally competitive to accomplish by means of:

PRACE 2 Programme key elements

Computing cycles made available by Hosting Members on Tier-0 systems

High Level Support Teams in charge of

supporting European scientific communities in their efficient use of Tier-0 systems funded

by non-Hosting Members

PRACE integrated programme

Provision of cycles

The PRACE Programme aims at providing the required Tier-0 capability and capacity, as well as the architectural diversity; In PRACE Programme the Tier-0 reference system is defined to have : a capability comparable to a system of 5,000 nodes with two Intel-Xeon processors of the latest generation (at procurement time) and an anticipated total availability of approximately 37,5 million node-hours (85%) per year. Any Tier-0 systems will comprise of at least 2,500 nodes, in order to be able to provide enough capability; the baseline capacity for Tier-0 systems for PRACE 2 is a minimal contribution of 40% of the total available node-hours per year on a Tier-0 reference system, i.e., approximately 15 million node-hours per year. Each hosting member is expected to provide the equivalent capacity of at least one Tier-0 system while always fulfilling the minimal capability requirement of 2,500 nodes.

High-level teams in terms of code enabling and optimization of scientific applications Each team will be located at an HM Tier-0 site HPC experts having, on the one hand, strong skills both on specific HPC architectures provided by the Hosting Members as well as applied mathematics, computer science and management of data, and on the other hands are experienced in the fields of applications they support

HLST High-Level Support Teams

PRACE services: continuing support to science excellence

MareNostrum: IBM BSC, Barcelona, Spain

JUQUEEN: IBM BlueGene/Q GAUSS/FZJ Jülich, Germany

CURIE: Bull Bullx GENCI/CEA Bruyères-le-Châtel, France

SuperMUC: IBM GAUSS/LRZ Garching, Germany

Hazel Hen: Cray GAUSS/HLRS, Stuttgart, Germany

PRACE Hosting Members offering of core hours on 7 world-class machines

MARCONI: Lenovo CINECA Bologna, Italy

Piz Daint: Cray XC 30 CSCS Lugano, Switzerland

Distribution of resources by science domains

PRACE peer-review access

Free at point of use, need to publish results at the end of the award period PRACE calls are open for international projects Types of resource allocations for scientists

Project Access (call every 6 months) • For a specific project, award period 1 to max 3 years •purpose: to ensure a stable and reliable minimum access to the necessary computational resources for large-scale, long term projects of very high scientific quality and with a broad European scope, importance and relevance • For individual researchers and research groups (no restriction of nationality for both researcher and centre)

Preparatory Access (continously open, rolling calls, quarterly cut-off) • Prepare proposals for Project Access • Optionally with support from PRACE experts

Peer Review process

1 1

Open Call for

Proposals

Technical Peer Review

Scientific Peer Review

Technical experts in PRACE systems and software

Access Committee

Prioritisation +

Resource Allocation

Project +

Final Report

Researcher Researchers with expertise in scientific field of proposal

~ 2 Months ~ 3 Months Up to 3 years

Right to reply

Project Access Calls

Call schedule is approved by the Council in advance: dates and content

Terms of reference prepared by PRACE Office: what the call offers in terms of resources

Call schedule planning is prepared by BoD and executed by Peer Review staff of the PRACE AISBL Office

Rolling calls: no peer-review, evaluation of proposal is performed by the hosting centers Regular quarterly cut-offs Allocation is limited to the resources available: defined by the Hosting Centres (typically between 2% and 5% of the resources made available to PRACE)

Preparatory Access Calls

Preparatory Access Objective : to allow researchers computing time for optimization and code testing

before the application to Project Access resources

Preparatory Access Types

Type of Prep Access

Code Already Scales to Tier-0 Minimum ?

System Duration Apps enabling work needed for efficient running?

Expected outcome

Type A Yes, this is a pre-requisite

Tier-0 only 3 months No, scaling testing only

Application for Project Access for production runs

Type B Yes, this is a pre-requisite

Tier-0 only 6 months Yes, work will be done by researchers themselves

Application for Project Access for production runs

Type C Yes, this is a pre-requisite

Tier-0 only 6 months Yes, staffing resources from project requested

Application for Project Access for production runs

Type D Possibly, but not necessarily. Potential must be demonstrated.

Tier-1 and Tier-0

12 months Yes, staffing resources from project requested

Application to Prep Access A, B or C to prepare code for Tier-0 access, application for Project Access, SHAPE or DECI for production runs

Astrophysics

132 million core hours

on MaresNostrum (ES)

for FR

149 million core

hours: 57 on

MareNostrum (ES) + 92 on

SuperMUC (DE) for DE

40 million core hours on CURIE

TN (FR) for France

68million core hours on FERMI

(IT) for IT

80 million core hours

on FERMI (IT) for FR

68,5 million core hours on FERMI

(IT) for NL

ITER project, led by CEA, aims to demonstrate the scientific feasibility of nuclear fusion as a future energy source.

Research on supernovae and heavy chemical elements. This PRACE grant is one of the biggest worldwide allocation in this domain.

PRACE resources enable the development of modelling and simulation strategies concerning combustion instabilities in high performance engines.

The project focuses on the study of on one paradigmatic system used in fluid dynamics, namely Rayleigh Bernard convection. The goal: to extend availability on Lagrangian data.

Research on the quantitative

description of hydration and

water kinetics in the orthosteric

binding site of the adenosinic receptor.

PRACE resources are used to explore earthquakes and how to prevent their effects. IMAGINE_IT project aims to build up a 3D seismic velocity model for Italy at unprecedented high resolution.

Engineering Chemistry Earth Science Life Sciences Physics

Examples of top allocations of resources…

Training and skill support

Seasonal Schools

Have been running since 2008 Offering top-quality face-to-face training events Organised around / all over Europe Topics range from generic intermediate to

advanced From programming techniques to more

specialised topical schools

Upcoming Seasonal Schools:

HPC in the Life Sciences 10 – 12 April 2017 PRACE Spring School 2017, Sweden

PATC (PRACE Advanced Training Centers) Programme 2016-2017

79 courses, 215 training days New courses on forward-looking topics New hardware and programming paradigms Data science Collaboration with CoEs on several courses

PRACE Training figures 6 PRACE Advanced Training Centres (PATC): •Barcelona Supercomputing Center (Spain) •CINECA – Consorzio Interuniversitario (Italy) •CSC – IT Center for Science Ltd (Finland) •EPCC at the University of Edinburgh (UK) •Gauss Centre for Supercomputing (Germany) •Maison de la Simulation (France.

PATC events: from March 2012 until July2016 (PATCs started in 2012)

321 events 7087 participants

915 PATC training days

ALL PRACE training events (including PATC courses, seasonal schools, workshops, International HPC Summer School, etc), since 2008/09:

8664 participants 353 training events 1040 training days

Training and Events Portal

www.training.prace-ri.eu Single hub for the PRACE training events, training material and tutorials Number of page views increased by 25% and number of users by 45% since 2014

CodeVault and More

Repository of Open Source code samples https://gitlab.com/PRACE-4IP/CodeVault Examples and model solutions of common HPC programming tasks: Possible to use in training and as building blocks of real-world applications Anonymous read access Best Practice Guides http://www.prace-ri.eu/best-practice-guides/ White Papers http://www.prace-ri.eu/white-papers/

Future Training Activities

Launch of Massive Open Online Courses (MOOCs) Introduction to HPC, coordinated by EPCC Management of massive data, coordinated by Univ. Ljubljana

PRACE Training Centres (PTCs) Cover basic and advanced needs across Europe

Goal: To inspire the next generation of software engineers, system administrators, and general users of HPC

PRACE Summer of HPC (SoHPC)

International training event on HPC

Access to EU, U.S., Japanese and Canadian HPC-infrastructures HPC challenges by discipline (e.g., bioinformatics, computer science, physics…) HPC Programming Proficiencies Performance analysis & profiling Algorithmic approaches & numerical libraries Data-intensive computing Scientific visualization

Leading computational scientists and HPC technologists offer instruction on a variety of topics since 2010:

7th International HPC Summer School

June 2016, Ljubljana, Slovenia 7th International HPC Summer

School June 2016, Ljubljana, Slovenia

PRACE events

PRACE Days: When Science Meets Industry

PRACEdays17 will be part of the European HPC Summit Week 2017 which will be organised in Barcelona, Spain, in May 2017

This year for the first time, PRACEdays16 became the center point of the European HPC Summit Week.

PRACEdays is the annual event organized by PRACE AISBL that gathers participants from Europe and worldwide for keynote presentations and discussions about and between science, industry and HPC.

Engagement of Industry and SMEs

Access open to industrial users since January 2012 Access to leading-edge resources

The regular calls open to industry twice a year •free at point of use •based on scientific excellence only •commitment to publish results in publicly available media

Permanent Preparatory Access call •Assess the scalability and port the codes preparation for future regular calls •Large companies & SMEs

Access to high-value services

Access to new knowledge enabled through PRACE Training Code enabling Information, Promotion and Networking

Since 2012: >50 companies supported

HPC is a powerful technology: • To enable the development of new products or

services, • To reduce time-to-market • To reduce cost of R&D or increase the product

quality • To create new business opportunities

…. but there are still barriers for SMEs for using HPC:

• cost of operation • lack of knowledge • lack of resources

HPC & SMEs

Pan-European, PRACE-based, programme supporting HPC adoption by SMEs: Raise awareness and equip European SMEs with the expertise necessary to take advantage of the innovation possibilities opened up by HPC thus increasing their competitiveness.

Overcome the barriers to HPC adoption: Lack of expertise in knowledge of the possibilities of HPC and advanced numerical simulation; Lack of resources to facilitate the HPC adoption process; The entry costs of implementing new technologies.

SHAPE facilitates the process of defining a workable solution based on HPC SHAPE helps to define an appropriate business model.

SHAPE results so far 3 calls: 28 projects funded from 9 different countries 4th call closed on September 9th 2016 Different computational fields: hydraulic turbine design, life science, audio technologies, LES turbulence models in race boat sail, airflow simulations, electromagnetic behavior of products, virtual test bench for centrifugal pumps, CFD simulation of innovative hull, etc

Participation in the Programme has been monitored to evaluate possible benefits, ROI and business impact obtained by the SMEs:

• SHAPE is of real value to the SMEs • Many positive outcomes for the businesses involved in the activity • Tangible measures of the ROI in many of the projects:

- new staff people hired - contracts have been won - costs have been reduced - HPC Access - in house HPC systems installed

• Optimism that the improvement in the service will lead to an increase in customer numbers • Adopting HPC: Companies R&D will be accelerated along with reduced costs • Commitment to continue working with HPC: in-house or via access to PRACE resources

For any information: www.prace-ri.eu/shape shape@prace-ri.eu

Looking ahead

• Enable broad access

• Integration of technologies into system prototypes

• Co-design of solutions • Procuring HPC systems

• Integration of data services with HPC infrastructure

• HPC Bg Data convergence

• European Cloud Inititive

• Builds on European Cloud strategy and European HPC strategy

European Open

Science Cloud

HPC infrastructure

for data processing

Adapting HPC

solutions for cloud

environment

Approaching Exascale: prototypes co-design

PRACE in the European Research Infrastructure landscape and new EC initiatives

Lead the integration of a highly effective HPC ecosystem

Provide an HPC infrastructure for science and industry

Nurture and develop skills Attract, train and retain competences

Enabling HPC access for excellence in science and competitiveness of industry

Conclusion

THANK YOU FOR YOUR ATTENTION www.prace-ri.eu