Embed Size (px)
DESCRIPTION
The vastness and variety of the Big Data landscape requires a new explorative paradigm to analyze data and extract new value from information. The speech describes the approach adopted by SpagoBI suite to manage large volumes of heterogeneous structured and unstructured data, to perform real-time Business Intelligence on Big Data streaming and to give meaning to data through the semantic analysis. SpagoBI supplies meaningful data insights through the main concept of persistable and schedulable datasets, and using tools such as self-service BI, ad-hoc reporting, interactive dashboards and explorative analysis.
Citation preview
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
How to maximize the value of Big Data with the open source SpagoBI suite
through a comprehensive approach
Monica Franceschini - SpagoBI ArchitectSpagoBI Competency Center - Engineering Group
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
for BIG DATA
COMPREHENSIVE APPROACH
vis ua liza tion
info rm atio n b uild ing
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
DATASET
d ata s et
in-memorydatabase
schedulation
Independent object to collect data from different sources, used by visualization tools.
Follows SpagoBI behavioural model
visualization
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
DATA SOURCES
d ata s et
SpagoBI data sources are defined as connections towards different databases both from the Hadoop ecosystem and NoSql db
● HiveQL● HBQL● CQL● Cypher...
SQL-like queries :
visualization
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
IN-MOTION DATA
d ata s et
Continuously running data can be processed by stream processors or CEPs and collected by SpagoBI dataset
Dataset as an Event Handler notified by SpagoBI Adapter of newly available data
Stream processors/CEPs SpagoBI Adapter
+
visualization
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
SEMANTIC DATA
d ata s et
Classify and categorize unstructured and heterogeneous data through semantic annotations, using domain ontologies.
Semantic information can be stored in NoSql Graph databases and extracted by SpagoBI dataset
visualization
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
INFORMATION BUILDING
FILE DATA SOURCES
DATASET
visualization
QbESelf ServiceAd hoc reporting
Cooperation of visualization tools and free enquiry engine to produce information
d ata s et
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
AGILE DEVELOPMENT
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
SELF SERVICE
FILE DATA SOURCES
DATASET
QbE engine allows to create new datasets and refine analysis in a graphical way
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
AD HOC REPORTING
DATASET
Worksheet engine provides an instant graphical meaning to datasets
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
DASHBOARDS Cockpit engine allows aggregating different documents, interacting one with each other, to get information at a glance
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
JUST A USE CASE
for BIG DATA
Te le c o m m unic atio n c o m pa nie s : need to extract value from mobile data traffic information to improve services and advance new solutions
Pub lic a d m inis tra tio n : need to extract value from information gathered from different sources (consumption, highway traffic, voice traffic) in order to improve the supply of tourist, environmental, social services
BIG DATA OPEN DATA
VALUE
Open Data + Big Data = Value
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
INFORMATION CYCLE SpagoBI tools cooperating together produce NEW VALUE from information
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
WHAT NEXT?
d ata s et
Data miningText miningSentiment analysisPredictive analysis...
Ex tra c t va lue fro m info rm atio n
Twitter #ow2conwww.ow2.org
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
Find out all information (demo, documentation, tutorials, services and much more)
and download all SpagoBI components at:w w w.s pa g o b i.o rg
Contact uss pa g o b i@e ng .it -
@tw ittm o niq ue – m o nic a .fra nc e s c h ini@e ng .it
