Embed Size (px)
Citation preview
.
.
.
....
Benjamin ErbUlm University, Germany
4th Graph-TA, Barcelona 2016
Computing onEvent-sourced GraphsShort Overview
2 Computing on Event-sourced Graphs | Benjamin Erb Ulm University, Germany | 4th Graph-TA, Barcelona 2016
Introduction...
Benjamin Erb, research assistant
Research group of Prof. Frank Kargl
Institute of Distributed SystemsUlm University, Germany
WWW: uulm.de/?erb
Event Processing+Graph Computing
..
Source: twitter.com
..
Source: twitter.com
..
Source: twitter.com
7 Computing on Event-sourced Graphs | Benjamin Erb Ulm University, Germany | 4th Graph-TA, Barcelona 2016
Different Style of ProcessingBatch Processing & Event Processing
Finding interesting accounts Processing posts for trends
graph analysis
offline operation
batch processingstream analysis
online operation
event processing
approximative resultsexact results
Giraph GraphLab SamzaStrom
near-realtime
8 Computing on Event-sourced Graphs | Benjamin Erb Ulm University, Germany | 4th Graph-TA, Barcelona 2016
Why not using both?Lambda & Kappa Architectures
Input Data
Speed Layer(Near-realtime)
Serving Layer(Results)
Batch Layer(Offline processing)
Details: lambda-architecture.net, kappa-architecture.com
9 Computing on Event-sourced Graphs | Benjamin Erb Ulm University, Germany | 4th Graph-TA, Barcelona 2016
The Idea: How about graph computing? (1)lightweight, event-driven computations
vertices possess local state and behaviorasynchronous messaging between verticesvertex states are query-able by the user
batch processing on the graphoffline processing of complex computationtraditional models, e.g. Pregel/BSP
unified platformone platform, multiple computation types
B. Erb, F. Kargl: A Conceptual Model for Event-sourced Graph Computing; DEBS ’15
Platform Design?
The missing link: Event Sourcing
Platform Design?The missing link: Event Sourcing
11 Computing on Event-sourced Graphs | Benjamin Erb Ulm University, Germany | 4th Graph-TA, Barcelona 2016
Event Sourcing in a NutshellExample: Bank Account Balance
TraditionalState Updates
0€100€120€80€200€
Details: M. Fowler: Event Sourcing
11 Computing on Event-sourced Graphs | Benjamin Erb Ulm University, Germany | 4th Graph-TA, Barcelona 2016
Event Sourcing in a NutshellExample: Bank Account Balance
TraditionalState Updates
0€100€120€80€200€
Event-sourcedState Changes
AccountCreatedDeposited(100)Deposited(20)Withdrawn(40)Deposited(120)
Details: M. Fowler: Event Sourcing
12 Computing on Event-sourced Graphs | Benjamin Erb Ulm University, Germany | 4th Graph-TA, Barcelona 2016
The Idea: How about graph computing? (2)event-sourced graph operations
local topology changesmessaging between verticesstate updates of vertices
event logs…maintain the entire vertex historyallow for global graph reconstruction
B. Erb, F. Kargl: A Conceptual Model for Event-sourced Graph Computing; DEBS ’15
13 Computing on Event-sourced Graphs | Benjamin Erb Ulm University, Germany | 4th Graph-TA, Barcelona 2016
Event-sourced History of the GraphEvent Logging, Snapshots & Branching
B. Erb, F. Kargl: A Conceptual Model for Event-sourced Graph Computing; DEBS ’15
13 Computing on Event-sourced Graphs | Benjamin Erb Ulm University, Germany | 4th Graph-TA, Barcelona 2016
Event-sourced History of the GraphEvent Logging, Snapshots & Branching
B. Erb, F. Kargl: A Conceptual Model for Event-sourced Graph Computing; DEBS ’15
13 Computing on Event-sourced Graphs | Benjamin Erb Ulm University, Germany | 4th Graph-TA, Barcelona 2016
Event-sourced History of the GraphEvent Logging, Snapshots & Branching
Live Graph
B. Erb, F. Kargl: A Conceptual Model for Event-sourced Graph Computing; DEBS ’15
13 Computing on Event-sourced Graphs | Benjamin Erb Ulm University, Germany | 4th Graph-TA, Barcelona 2016
Event-sourced History of the GraphEvent Logging, Snapshots & Branching
Live Graph
Event-driven Graph Computing
B. Erb, F. Kargl: A Conceptual Model for Event-sourced Graph Computing; DEBS ’15
13 Computing on Event-sourced Graphs | Benjamin Erb Ulm University, Germany | 4th Graph-TA, Barcelona 2016
Event-sourced History of the GraphEvent Logging, Snapshots & Branching
Graph Snapshots
Live Graph
Event-driven Graph Computing
B. Erb, F. Kargl: A Conceptual Model for Event-sourced Graph Computing; DEBS ’15
13 Computing on Event-sourced Graphs | Benjamin Erb Ulm University, Germany | 4th Graph-TA, Barcelona 2016
Event-sourced History of the GraphEvent Logging, Snapshots & Branching
Graph Snapshots
Live Graph
Event-driven Graph Computing
B. Erb, F. Kargl: A Conceptual Model for Event-sourced Graph Computing; DEBS ’15
13 Computing on Event-sourced Graphs | Benjamin Erb Ulm University, Germany | 4th Graph-TA, Barcelona 2016
Event-sourced History of the GraphEvent Logging, Snapshots & Branching
Graph Snapshots
Live Graph
Decoupled Batch Processing on Branches
Event-driven Graph Computing
B. Erb, F. Kargl: A Conceptual Model for Event-sourced Graph Computing; DEBS ’15
14 Computing on Event-sourced Graphs | Benjamin Erb Ulm University, Germany | 4th Graph-TA, Barcelona 2016
Thanks!..Questions? Feedback?Drop by at the poster session!
Contact
WWW: uulm.de/?erbMail: [email protected]: @b_erb
Backup Slides
16 Computing on Event-sourced Graphs | Benjamin Erb Ulm University, Germany | 4th Graph-TA, Barcelona 2016
Programming ModelAsynchronous, message-driven, vertex-centric, decentralized
Incoming messages from adjacent vertices
Outgoing messages to adjacent vertices
Event-sourced vertex state
Behavior function
(St+1, ft+1,[mout]) = ft(min, St)
B. Erb, F. Kargl: A Conceptual Model for Event-sourced Graph Computing; DEBS ’15
