The EXDCI project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 671558

SRA 3 & “post H2020” vision

Michael Malms, ETP4HPC

European HPC summit week 2018, Ljubljana

May 2018EXDCI

2014 2015 2017 2018 20192016 2020 2021 2022

WP14/15 Call Deadline

and Projects

WP16 Call

CSA 14/15

WP18-20 Calls

CSA 18-20

SRA 1

SRA 2

SRA 3

WP17 Call

SRA published

2013,

2015,

2017

“post H2020”

HPC vision

CSA 16/17

SRAs / WPs in Horizon 2020 : the timeline

May 2018EXDCI

Strategic Research Agenda (SRA3): the flow

May 2018EXDCI

SRA 3

Application Requirements

Science: CoEs/PRACE Applications

Industry

Big Data (BDVA)

BDEC / HiPEAC

Input – sources for the SRA 3

May 2018EXDCI28 May 2018 ETP4HPC Event 5

Multi-dimensional SRA HPC model

May 2018EXDCI28 May 2018 6

Balance Compute, I/O and Storage performance

• Non-volatile memories in I/O stack and deep I/O hierarchies

• Data centric computing

• Object storage & cloud convergence

• Feature rich APIs

• QoS & understandability

• Data management

• Adaptation for new programming paradigms and workloads

• Adaptations for new hardware: processing environments and interconnect networks

Detailed research priorities – example: I/O and storage

May 2018EXDCI

Over 100 research milestones - example: I/O and storage

May 2018EXDCI

Storage &

Curation

@Cloud

BD Analytics @Cloud

IoT / CPS / Edge /…

HPC “in the loop”BD Analytics @Edge

Post H2020: where to go next?

May 2018EXDCI

ETP4HPCs extension to HPC, Big Data and Deep Learning

This is the structural foundation of the technical roadmap work ahead

May 2018EXDCI

* Horizon 2020 - Work Programme 2018-2020

Collaboration HPC – BD - IOT

May 2018EXDCI

2018: R&I “post H2020” vision documents

HPC

extreme

HPC + BD + IOT

use cases

- analysis

- break-down

- identification

- interdependencies

- optimization

technical computing

embedded techn. & HPC

Big Data

IOT

Embedded techn.

Big Data

IOT

interdependencies

'siloed' independent visdion papers interconnected, redundancy-free, complementary docs.

May 2018EXDCI

Goals for 2018 and 1H 2019

• 4Q 2018:

an „Extreme scale Demonstrator 2“ call proposal for 2020

focusing on integration of HPC+BD+IOT technology in future relevant use scenarious

proposal jointly developed between ETP4HPC, HiPEAC, BDVA and AIOTI

as EsD1, call should target demonstration & integration of technology developed in

European research programmes in respective domains

first draft planned for october 2018

• 1Q 2019:

a „postH2020“-vision document outlining the big picture of HPC related research for FP9

jointly developed with HiPEAC in collaboration with BDVA and AIOTI

international input taken into account (first event see next page)

May 2018EXDCI

BD-HPC-IOT high-impact use case Analysis

1. Cases in Manufacturing Line / Factory Digital twin, - [Anibal Reñones, Cartif, ]

2. Smart grid and customer pattern analysis - [Anibal Reñones, Cartif, ]

3. Hybrid-Twin: Wind Turbine Farm of Composite Rotor Blade – [Fouad El-Khadi, ESI Group],

4. Near Real Time Electricity Network Smarter Optimized Operation, [Davide Dalle Carbonare, Engineering, ]

5. Real-time Simulation For Man-in-the-loop Aircraft Testing [[Davide Dalle Carbonare, Engineering, ]

6. Combating Fake News with AI, Big Data and HPC solutions, [Davide Dalle Carbonare, Engineering, ]

7. Nonintrusive Load Monitoring – [Davide Dalle Carbonare, Engineering],

8. Automatic cartography of extensive territories – [Tonny Velin, Answare]

9. Autonomous driving / Data Twin – [Nenad Stojanovic, Nissantech]

10. Ship behaviour simulation/modelling. [Konstantinos Chatzikokolakis, Marine Traffic]

11. Wind Power Sound Propagation – [Panu Maijala, VTT,]

12. FEM-based optimisation & digital twin of electromechanical devices [Janne Keränen, VTT]

13. Individualized healthcare diagnosis - [DANIEL ALONSO ROMÁN, ITI ]

14. Weather and climate forecasts – [Claudio Arlandini, CINECA]

15. Weather and Climate Modelling – [Philipp Neumann, Deutsches Klimarechenzentrum, Peter Bauer, European Centre for Medium-Range Weather

Forecasts]

16. Data-Check: distinguish truth from lies, [Antonis Ramfos, Athens Technology Center S.A.]

A: (the Data Twin family of cases)

• 10 - Data-driven modelling and simulation of Digital Twins for Autonomous Driving Nissatech)

• 11 - Hybrid Twin: Wind turbine farm of Composite Rotor Blade (ESI)

• 8 - Manufacturing Line / Factory Digital twin (CARTIF)

• 9 - Smart grid and customer pattern analysis (CARTIF

B:

• 5 - Weather and Climate Modelling (DKRZ, ECMWF)

• 14 - Weather use case (Cineca)

C:

• 7 - Health use case - Multi-omics patient (ITI)

Selection for further refinement

16 proposed Big Data use cases analysed for their „Extreme compute AND Eextreme Data“ demand

May 2018EXDCI

several use cases based on concept of “digital twin”

Trend No. 4: Digital Twins

A digital twin is a digital representation of a real-world entity or system.

In the context of IoT, digital twins are linked to real-world objects and offer information on the state of the

physical counterparts, respond to changes, improve operations and add value.

With an estimated 21 billion connected sensors and endpoints by 2020, digital twins will exist for billions of

things in the near future.

In the short term, digital twins offer help with asset management, but will eventually offer value in

operational efficiency and insights into how products are used and how they can be improved.

May 2018EXDCI

Backup

source: https://blog.eoda.de/wp-content/uploads/2013/10/dv1.jpg

Data characteristics: the 4’V’s

May 2018EXDCI

Step 1. Profile use case using “ISO-JTC1-WG9-BDV reference model” - template

Data Characteristics

Data Volume

Data Velocity Data Variety (Data types: Structured, Time Series/IoT, Image/Video/Audio,

Geo/Spatial, Text/NLP/Genomics,

Graph/Network) Data Variability

Data processing and analytics/machine learning characteristics

Data volatility Data veracity

Data monetary value Data visualization

Structured and unstructured data Scaling

Distributed file system Distributed data processing – Batch,

Realtime, Interactive, Cloud, Edge, HPC, ..

SQL or Non-relational databases – storage types (SQL,Key-value, Document, Column, Graph, …)

Analytics, Machine Learning/AI (Which techniques are used)

subset of

template

specify

use case

in these

dimensions

May 2018EXDCI

Step 2. Profile use case in its HPC related dimensions (extract of “HPC template”)

Draw the pipeline as a graph of data nodes (as follows) connected by data flows. Nodes:

Data Object: The types of files/data store objects/… that are in a data repository

Data ingest: The original source of data where data objects are produced.

Data repository: A data repository has the capability to hold different types of data objects for a certain

(possibly infinite) amount of time. A data repository is able to receive and provide data objects.

Processing station: A processing station consumes data objects, processes them and typically produces new

data objects, which are moved into data repositories.

Flows:

Figure 1: Example diagram.

Data transport: A data transport entity describes the connection between any of the previous entities for moving data.

May 2018EXDCI

Weather and Climate

May 2018EXDCI

Personalized medicine: Multi-omics use case

Personalized & precisión medicine:

medical decisions, practices,

interventions, products, tailored to the

individual patient, based on their

predicted response and risk of disease

EU countries will cooperate in linking genomic databases across borders:

https://ec.europa.eu/digital-single-market/en/news/eu-countries-will-cooperate-linking-

genomic-databases-across-borders

- In a near future, multi-omics sequencing will be a commodity

Multi-omics: different layers of information

from the human cell

Multi-omics

pipeline: from

biological samples to

predictive models.

- Process and analize a huge amount of information coming from

more and more patients

- HPC and advanced data analytics required

- Very sensitive type of personal data.

May 2018EXDCI

..from use case analysis: HPC+BD+IOT infrastructure capabilities chart

May 2018EXDCI

Use case work: next steps

Next events for working group:

• teleconference on June 4th

• face-to-face meeting at ISC: Tuesday, June 26th, from 2pm to 4pm ( Appenzell Room @ Moevenpick

Hotel

• ideally IOT experts will join us !

Extend workgroup:

• current workgroup composed of HPC and BD experts ( ETP4HPC and BDVA)

• IOT technical skills needed to make progress

• research priorities contained in AIOTI WG01 document for IOT platforms appear very complementary

to priorities in BD and HPC domains

• therefore a MOU on future joint roadmap & research priorities work between ETP4HPC and AIOTI is

suggested

• with a meeting to synchronize of a common understand of a future collaboration during ISC, possibly

also on Tuesday, June 26th

May 2018EXDCI

Coming up: A HPC-Vision – workshop during ISC (1)

May 2018EXDCI

Coming up: A HPC-Vision – workshop during ISC (2)

Speakers on „Post H2020-HPC vision“ session:

• Satoshi Matsuoka

Head of the Riken Center for Computational Science (R-CCS) at RIKEN

• Mark Duraton

Member of the Research and Technology Department of CEA & Member of HiPEAC network of excellence

• Rick Stevens

Associate Laboratory Director – Computing, Environment and Life Sciences // Professor of Computer Science

• Jesus Labarta

Prof. of Computer Architecture at the Technical University of Catalonia (UPC)

• Dan Read

University Chair in Computational Science and Bioinformatics at the University of Iowa

• Dirk Pleiter

Prof. of Theoretical Physics at the University of Regensburg and Research group leader at the Jülich Supercomputing

Centre (JSC)

May 2018EXDCI

BackupThank you

…any questions ?

May 2018EXDCI

Coming up: A HPC-Vision – workshop during ISC (1)

ETP4HPC and HiPEAC comitted to generate a „post H2020“ HPC vision document by 1Q2019

• Approach:

we need to get input from European AND international sources

we invite internationally recognized key experts to work with us

the event is three-fold and takes place during the ISC week:

Sunday, June 24th:

• 15:00 – 18:30: Key presentations, session open to ETP4HPC and HiPEAC members

• 18:30 - 22:00: Networking dinner, open to ETP4HPC and HiPEAC members

Wednesday, June 27th:

• 18:30 – 22:00: Small group worksession to define cornerstones of vision paper

Workshop co-organized between ETP4HPC and HiPEAC

May 2018EXDCI

Extreme scale Demonstrators

HPC CentersParticipate in the co-design process

Manage system deployment

Operate

Validate and characterise the system

Technology ProvidersEnsure the integration of the technologies

Perform the testing and

quality/performance assurance

Perform the maintenance and service

Application ownersDefine application requirements

Port and optimise applications

1. Integrate results of

R&D projects into

fully integrated

systems prototypes.

EsD 2018:

• designpoint: 500-1000 PF

• power eff.: 35kW/PFLOPS

• density: 1PF/rack

• I/O balanced design

• TRL 7

EsD 2020:

• technology: next generation

• new deployment areas:

• HPDA / ML

2. Establish proof-points

for the readiness,

usability and scalability

of the

technologies