9
BIG DATA EUROPE: PILOTS & APPLICATIONS Apache Big Data Europe, Seville, Spain

Apache Big_Data Europe event: "Integrators at work! Real-life applications of Apache Big Data components: Pilots and Applications"

Embed Size (px)

Citation preview

Page 1: Apache Big_Data Europe event: "Integrators at work! Real-life applications of Apache Big Data components: Pilots and Applications"

                    

BIG DATA EUROPE: PILOTS & APPLICATIONSApache Big Data Europe, Seville, Spain

Page 2: Apache Big_Data Europe event: "Integrators at work! Real-life applications of Apache Big Data components: Pilots and Applications"

Different uses of the BDE components

Adaptation of an existing non-parallel algorithm.

Management and preparation of data for an existing infrastructure.

Reimplementation of a parallel version of an algorithm in a Big Data processing system language.

1 mai 2023

Page 3: Apache Big_Data Europe event: "Integrators at work! Real-life applications of Apache Big Data components: Pilots and Applications"

SC4: Traffic conditions estimation

1 mai 2023www.big-data-europe.eu

Transport

• Estimation of real-time traffic conditions in Thessaloniki

• Combines:• Traffic modelling from

historical data• Current measurements

from a taxi fleet of 1200 vehicles

Page 4: Apache Big_Data Europe event: "Integrators at work! Real-life applications of Apache Big Data components: Pilots and Applications"

SC4 Pilot Architecture

1 mai 2023www.big-data-europe.eu

Page 5: Apache Big_Data Europe event: "Integrators at work! Real-life applications of Apache Big Data components: Pilots and Applications"

SC5: Climate modelling

1 mai 2023www.big-data-europe.eu

Climate

• Discovering and re-using previously computed derivatives• Lineage annotation: datasets

and model parameters used to compute derivative datasets

• Finding appropriate past runs avoids repeating weeks-long modelling runs

• Preparing modelling experiments• Slicing, transforming, combining datasets into

new datasets• Submission to and retrieval from modelling

infrastructure

Page 6: Apache Big_Data Europe event: "Integrators at work! Real-life applications of Apache Big Data components: Pilots and Applications"

SC5 Pilot Architecture

1 mai 2023www.big-data-europe.eu

Page 7: Apache Big_Data Europe event: "Integrators at work! Real-life applications of Apache Big Data components: Pilots and Applications"

SC7: Change detection & verification

1 mai 2023www.big-data-europe.eu

Secure Societie

s

• Automatically detect land cover evolution, caused by physical or human activities, and alert user accordingly. • Events are extracted from text

published by news agencies and on social media.

• Events are geo-located and relevant changes are detected by comparing current and previous satellite images

Page 8: Apache Big_Data Europe event: "Integrators at work! Real-life applications of Apache Big Data components: Pilots and Applications"

SC7 Pilot Architecture

1 mai 2023www.big-data-europe.eu