Embed Size (px)
DESCRIPTION
The presentation supported the speech by Monica Franceschini, SpagoBI Architect, at OW2Con 2013 - the annual community event of OW2 Consortium (www.ow2.org). It focuses on the smart approach adopted by SpagoBI suite (www.spagobi.org) to manage Big Data. www.spagoworld.org
Citation preview
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
How to maximize the value of Big Data with the open source SpagoBI suite
through a comprehensive approach
Monica Franceschini - SpagoBI ArchitectSpagoBI Competency Center - Engineering Group
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
for BIG DATA
COMPREHENSIVE APPROACH
visualization
information building
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
DATASET
dataset
in-memorydatabase
schedulation
Independent object to collect data from different sources, used by visualization tools.
Follows SpagoBI behavioural model
visualization
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
DATA SOURCES
dataset
SpagoBI data sources are defined as connections towards different databases both from the Hadoop ecosystem and NoSql db
● HiveQL● HBQL● CQL● Cypher...
SQL-like queries :
visualization
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
IN-MOTION DATA
dataset
Continuously running data can be processed by stream processors or CEPs and collected by SpagoBI dataset
Dataset as an Event Handler notified by SpagoBI Adapter of newly available data
Stream processors/CEPs SpagoBI Adapter
+
visualization
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
SEMANTIC DATA
dataset
Classify and categorize unstructured and heterogeneous data through semantic annotations, using domain ontologies.
Semantic information can be stored in NoSql Graph databases and extracted by SpagoBI dataset
visualization
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
INFORMATION BUILDING
FILE DATA SOURCES
DATASET
visualization
QbESelf ServiceAd hoc reporting
Cooperation of visualization tools and free enquiry engine to produce information
dataset
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
AGILE DEVELOPMENT
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
SELF SERVICE
FILE DATA SOURCES
DATASET
QbE engine allows creating new datasets and refining analysis in a graphical way
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
AD HOC REPORTING
DATASET
Worksheet engine provides an instant graphical meaning to datasets
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
DASHBOARDS Cockpit engine allows aggregating different documents, interacting one with each other, to get information at a glance
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
JUST A USE CASE
for BIG DATA
Telecommunication companies: need to extract value from mobile data traffic information to improve services and advance new solutions
Public administration: need to extract value from information gathered from different sources (consumption, highway traffic, voice traffic) in order to improve the supply of tourist, environmental, social services
BIG DATA OPEN DATA
VALUE
Open Data + Big Data = Value
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
INFORMATION CYCLE SpagoBI tools cooperating together produce NEW VALUE from information
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
WHAT NEXT?
datasetData miningText miningSentiment analysisPredictive analysis...
Extract value from
information
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
Find out all information (demo, documentation, tutorials, services and much more)
and download all SpagoBI components at:www.spagobi.org
Contact [email protected] -
@twittmonique – [email protected]
