17
www.spagobi.org Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. SpagoBI & Big Data: a smart approach to turn data into knowledge October 8th, 2013 Monica Franceschini – IT Solution Architect This presentation has been used during a webinar delivered within SpagoWorld Webinar Center - http://bit.ly/WebinarCenter

Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge

Embed Size (px)

DESCRIPTION

The presentation supported the webinar focused on the smart approach adopted by SpagoBI suite to manage Big Data, delivered on October 8th, 2013 within SpagoWorld Webinar Center. http://www.spagoworld.org/

Citation preview

Page 1: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge

www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

SpagoBI & Big Data:

a smart approach to turn data into knowledge

October 8th, 2013

Monica Franceschini – IT Solution Architect

This presentation has been used during a webinar delivered withinSpagoWorld Webinar Center - http://bit.ly/WebinarCenter

Page 2: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge

www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

Smart approach

By smart approach we mean:

● Information building through

● Different data sources connections

● Datasets

● Self service BI

● Agile development of information

● Visualization through

● Dashboards with interactions between documents

● Behavioural model leading documents behaviour

● Ad hoc reporting

● Smart approach = comprehensive approach

Page 3: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge

www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

Comprehensive approach

BYTES STREAM

SEMANTIC

BIG DATASETS

for Big Data

ANALYTICS

Page 4: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge

www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

Comprehensive approach

for Big Data

Visualization

Information building

Static reportsChartsGeoAd hoc reporting...

NoSqlHadoopReal timeSelf Service...

DATASET

Page 5: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge

www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

3 scenarios

Data Source

Data Set

Visualization

InIn--MemoryMemoryPersistencyPersistency

SchedulationSchedulation

Data Streaming

Semanticdatabase

Page 6: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge

www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

Dataset component

Data Set

Visualization

InIn--MemoryMemoryPersistencyPersistency

SchedulationSchedulation

BehaviouralBehavioural modelmodel

Analytical driver Analytical driver LOV (List of Values)LOV (List of Values)

Page 7: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge

www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

Big Data storages

Data SourceData Set

Impala

JDBC / JNDI connectionstowards NoSql databases of the Hadoop ecosystem

Dataset follows the Behavioural Modelusing: SpagoBI analytical driversUser attributes

Query ● HBql● CQL● HiveQL● ...

Page 8: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge

www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

Real time

Data Streaming

InIn--MemoryMemory

Event Dispatcher

SpagoBIAdapter

● Web Service● Java API● Queue● ...

Event Handlers

Dataset

● SMS● Alerts● Mail● ...

PersistencyPersistency

Visualization

Page 9: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge

www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

Semantic

Linked data semantic ontologies

Experienced NoSQL graph databases:

OrientDBNeo4J

Page 10: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge

www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

Semantic

Semanticdatabase

ExplorativeExplorative AnalysisAnalysisNetwork Network AnalysisAnalysis asas DRIVERDRIVER

Network AnalysisEngine

MQL,MQL,CypherCypher, , SPARQLSPARQL, , GremlinGremlintraversetraverse

OrientOrient DB, DB, Neo4J...Neo4J...

Classify and Categorize unstructured and heterogeneous data throughsemantic annotations, using domain ontologies.

FILTERFILTER

VisualizationVisualization

Page 11: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge

www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

Comprehensive approach

for Big Data

Visualization

Information building

Static reportsChartsGeo

Ad hoc Ad hoc reportingreporting...

NoSqlHadoopReal time

SelfSelf ServiceService...

DATASET

Page 12: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge

www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

Agile development

Query

Create charts

Refine the query

Persist

New query

Page 13: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge

www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

Self service

Use Free Enquiry Engine to:

DefineDefine youryour ownown queriesqueriesoverover datasetsdatasets

Create Create newnew datasetsdatasets in in a a graphicalgraphical and and smartsmart

wayway

RefineRefine youryour analysisanalysis

Page 14: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge

www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

Ad hoc reporting

Use Worksheet

to:

InteractInteract withwith QbEQbE totorefreshrefresh youryour datadata

ProvideProvide anan instantinstantgraphicalgraphical meaningmeaning toto

youryour datasetsdatasetsCreate a Create a prototypeprototype forforyouryour projectproject

Page 15: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge

www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

Dashboards

Use Cockpits to:

Aggregate Aggregate analysisanalysis totogetget information at a information at a

glanceglance

FilterFilter data data usingusingspecificspecific documentsdocuments

MakeMake differentdifferent kindskinds ofofdocumentsdocuments interactinteract

withwith eacheach otherother

Page 16: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge

www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

What comes nextUnstructured &

heterogeneous data

Statistical computing

Text mining

Sentiment analysis

...and more advanced & predictive analysis

NEW VISUALIZATION

Data mining

NEW INFORMATION

BUILDING TECH

Page 17: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge

www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

Find out all information

(demo, documentation, tutorials, services and much more)

and download all SpagoBI components at:

www.spagobi.org

Contact us

[email protected]