Upload
spagoworld
View
5.496
Download
0
Tags:
Embed Size (px)
DESCRIPTION
Citation preview
Open Source Business Intelligence
SpagoBI: a definition
SpagoBI is an integration platform for enterprise BI solutions, entirely developed in FOSS philosophy
What SpagoBI is ?
Platform:
It covers and satisfies all the BI requirements: KPIs, Reporting, OLAP, Dashboard and charts, Data Mining, Free Inquiring (QbE), Dossier, Geo-referenced analysis, Collaboration
Data Management, Profiling and security
Administrator support (versioning, scheduling, approval iter, import/export, etc)
SpagoBI is an integration platform for enterprise BI solutions, entirely developed in FOSS philosophy (Free and Open Source Software)
What SpagoBI is ?
Integration platform: Not a product platform, with a predefined set of tools Open to many products for the same/different analytical area, both open
source and proprietary It allows the composition of one’s own platform time for time in the best
way No binding dependences from products and tools Open standards adoption It allows to give the right answers to analytical questions by means of
different products
SpagoBI is an integration platform for enterprise BI solutions, entirely developed in FOSS philosophy (Free and Open Source Software)
What SpagoBI is ?
Enterprise platform
Distributed architecture (scalability)
Adaptive behaviour of the documents based on the end users’ roles
Entirely Open Source
It is not the lite OS version of an enterprise commercial version
SpagoBI is an integration platform for enterprise BI solutions, entirely developed in FOSS philosophy (Free and Open Source Software)
BI platform: Report OLAP Dashboard KPIs Charts Data Mining GEO-referenced analysis Free Inquiry (QbE) Collaboration ETL
Enterprise level Integration platform (not a closed product)
Multi engine (also mixing OS and proprietary)
Scalability
Security and visibility
What SpagoBI is ?
SpagoBI architecture
SpagoBI 2.1Architecture
Integration Platform
Analytical Model
Analytical Engines
Man
agemen
t Tools
SpagoBI – Analytical Model
It is the layer that mediates all interactions between the core of the platform (i.e. behavioural model and service components) and external analytical engines
It works as a meta model describing all analytical areas in an abstract way (i.e. implementation independent)
It allows to de-couple users analytical questions from the actual tools used to answer to them
It is a cornerstone in the implementation of the integrability strategy adopted by the platform (integration platform vs. product) platform)
SpagoBI – Analytical Model in action
SpagoBI – Behavioural Model
It represents the allowed end-user’s behaviour according to his/her business responsabilities
It enhances the prominent analytical concepts and describes how they are showed and checked according to the end-user roles
It provides a unique representation of every analytical concept
SpagoBI – Behavioural Model
The behavioural model (BM) represents the allowed end-user’s behaviour in relation to his/her business responsibilities
It’s up to the BM to manage who, when, where and how constraints are related to an actionable functionality provided by the platform
actions
users
BM
SpagoBI – Behavioural Model in action
SpagoBI – Behavioural Model in action
SpagoBI – Behavioural Model in action
SpagoBI – Management Tools
A set of back-end services that can be used to support all the other platform components and functionalities. Scheduler
Alarms & Notifications
Distribution lists
Subscriptions
Monitoring & Auditing
Collaboration module
SpagoBI – Analytical Engines
They are the components that actually execute analysis
At least one analytical engine exists for each analytical area (ex. report, olap, datamining, ecc…)
For each analytical area more than one engine type can exist (ex. Jasper, BIRT and BO for reporting)
One engine type can have multiple instances to guarantee scalability and reliability
SpagoBI logical architecture
The main components of SpagoBI
SpagoBI Metadata
SpagoBI Core
Authorization System
Authentication System
SS
O / S
ecurity AP
I
SpagoBI Engine
SpagoBI Engine
SpagoBI Engine
SpagoBI Engine
Security connectors
Folders
From SpagoBI 1.9.x to SpagoBI 2.x
All the SpagoBI components are now into the SpagoBI Server
SpagoBI SERVERSpagoBI Studio
SpagoBI Meta
Spa
goB
I S
DK
SpagoBI Applications
But in the new 2.x Release, some other main modules are coming …
SpagoBI 2.x – Main Modules
5 ModulesServerStudioMetaSDKApplications
6 NEW Engines GEO engine New QbE (multi-schema) Interactive dashboard (Composed Document) KPI modeller and navigator JPalo for OLAP Chart engine
Architectural review WebApplication and JSR 168 SSO with CAS SOA SSL Security assessment (OWASP Compliant)
General Features Subscriptions Personal folders Rich client Data sources configuration Alert and Notification Save Import/export settings ….
SpagoBI Server (the already known platform, with many
news) :
SpagoBI 2.x – Main Modules
5 ModulesServerStudioMetaApplicationsSDK
SpagoBI Studio : the integrated environment, to develop, test
and deploy documents into one or more SpagoBI Server
SpagoBI Meta : Business and technical metadata
SpagoBI SDK, to use SpagoBI from external application:
- Tag Lib- Integration API- Web Services
SpagoBI Applications: - BAM- Audit & Monitoring- ….
SpagoBI technological architecture
Technological architectureSpagoBI can be deployed in:
Tomcat 6.x
Jboss 4.x
WebSphere 6.x
SpagoBI can be installed as a simple WebApplicationSpagoBI can be installed in a Portal environment:
eXo Platform 2.x
Liferay 5.1
WebSphere Portal
Open StandardsJSR 168, JSR 170, JDBC, JDK, Hibernate
SpagoBI for the end-user
SpagoBI 2.1End-user functionalities
SpagoBI 2.1 - Reporting
SpagoBI 2.1 - Reporting
Template File
Parameters
Report Engine
A typical reporting system
SpagoBI 2.1 - Reporting
SpagoBI 2.1 - Reporting
SpagoBI 2.1 - Reporting
SpagoBI 2.1 – Reporting and behavioural model
SpagoBI 2.1 – Reporting and behavioural model
SpagoBI 2.1 - OLAP
SpagoBI 2.1 - OLAP
A typical OLAP system
Olap C
lient
Com
. AP
I
Com
. AP
ICom. Protocol
Olap S
erver
Data Storage
MONDRIANJPIVOT
SpagoBI 2.1 – OLAP functionalities
SpagoBI 2.1 – OLAP functionalities
SpagoBI 2.1 – OLAP functionalities
SpagoBI 2.1 – OLAP functionalities
SpagoBI 2.1 - GEO
SpagoBI 2.1 – GEO Analysis
GEO Analysis is ...
... a visual representation of some spatial data (typically a geographic map) whose elements, usually called geographical features, are enriched with some graphical information (typically colours) based on the value of some KPI related to the spatial element.
SpagoBI 2.1 – GEO Analysis
GEO spatial data: basic concepts
- features
- attributes
- layers
- maps
SpagoBI 2.1 – GEO Analysis
Geographic features are ...
... geometric entities like points, lines and polygons that can have a graphical representation. Geographical features are usually related to some existing entity in the real world like, for example, cities, streets and regions.
point line
polygon
SpagoBI 2.1 – GEO Analysis
Geographic attributes are ...
... properties related to some geographical features like for example id, name, population, length, ecc ...
POINT( Id: MI Name:Milan State: Italy Region:Lombardia Area: 182 km2 )
LINE( Id: H101 Name:101 Length: 500 km Type: Freeway )
POLYGON( Id: IT Name:Italy Population 51M Capital: Rome )
SpagoBI 2.1 – GEO Analysis
Layers are ...
... group of features, usually of the same geometric type and usually related to the same kind of real world entities.
Italy Regions' layer: groups together all the polygonal type features related to regions of Italy
SpagoBI 2.1 – GEO Analysis
Maps are ...
... a portrayal of geographic information as a digital image file suitable for display on a computer screen.
A map is not the data itself.
… usually built as a composition of different geographical layers
SpagoBI 2.1 – GEO Engine goal
GEO Analysis GOAL is ...
... build a bridge between geo-spatial data and datawarehouse informations
SpagoBI 2.1 – GEO Analysis
GEO spatial data: out of scope
- Web Map Server: a system capable of producing maps from geographic information
- Web Feature Service: a service whose interface allows to request for geographical features
- Geographical Information System: a system for capturing, storing, analyzing and managing data and associated attributes
SpagoBI 2.1 – GEO Analysis
GEO Dimension
- is part of the data warehouse
- is the link between the business data and the geo data
- is structured into one or more hierarchies
SpagoBI 2.1 – GEO in action
SpagoBI 2.1 – GEO in action
SpagoBI 2.1 – GEO in action
SpagoBI 2.1 – Charts
SpagoBI 2.1 – Bar charts
SpagoBI 2.1 – Dial charts
SpagoBI 2.1 – Pie charts
SpagoBI 2.1 – Box charts
SpagoBI 2.1 – Charts in action
SpagoBI 2.1 – Dashboards
SpagoBI 2.1 – Dashboards: Rotate
SpagoBI 2.1 – Dashboards: Live Line
SpagoBI 2.1 – Dashboards in action
SpagoBI 2.1 – Composite Document
SpagoBI 2.1 – Composite document
The composite document is a new SpagoBI engine which creates and displays on a single page more SpagoBI documents of any type (maps, reports, charts,…).
It can be considered as a new type of instrument panel with the difference that the documents are dynamic and so the users can navigate the displayed information.
SpagoBI 2.1 – Composite document in action
SpagoBI 2.1 – Composite document in action
The user clicks on Washington state and then each other document is reloaded taking the new parameter as input:
SpagoBI 2.1 – Composite document in action
The same, if the user click on the table, the charts in the lower part will be refreshed according to the new parameter :
SpagoBI 2.1 – Composite document in action
Also the last single chart can update other documents, in this case updates the last chart on the right:
Note that all documents within the composite document share the same parameters and you can configure it so that everyone can start the update of the other, updating the value of a shared parameter
SpagoBI 2.1 – KPI
SpagoBI 2.1 – KPI for the final user
SpagoBI 2.1 – KPI instance details
Semaphore
Model instance CODE – Model Instance Name
Bullet Chart with Thresholds,value and Target
KPI value
KPI Measure Unit
KPI WeightKPI under Alarm control
KPI linked to another SpagoBI Document
SpagoBI 2.1 – The steps to create a KPI
KPI Definition Steps:Define a ModelDefine a Data Set for each KPIDefine ThresholdsDefine KPIsDefine a Model InstanceCreate a KPI Document
SpagoBI 2.1 – A KPI Model
SpagoBI 2.1 – A KPI Data Set
SpagoBI 2.1 – A KPI Treshold
SpagoBI 2.1 – Cross Navigation
SpagoBI 2.1 – Cross Navigation
The cross navigation is a mechanism that allows to execute a target document by clicking on an element of a source document, preserving the context of the starting document itself and passing as parameters the relevant data.
The target document can be in turn a source document, i.e. you can click on one of its elements and reach a third document, and so on.
A breadcrumb keeps track of the sequence of opened documents; the user can return to a previously opened document by clicking on an element of the breadcrumb itself.
SpagoBI 2.1 – Cross Navigation in Reporting
SpagoBI 2.1 – Cross Navigation in GEO
SpagoBI 2.1 – Query by Example
SpagoBI 2.1 – QbE in action
SpagoBI 2.1 – QbE in action
SpagoBI 2.1 – QbE in action
SpagoBI 2.1 – QbE in action
SpagoBI 2.1 – QbE in action
SpagoBI 2.1 – QbE in action
SpagoBI 2.1 – Analyitical Dossier
SpagoBI 2.1 – Analyitical Dossier
SpagoBI 2.1 – Analytical Dossier
SpagoBI 2.1 – Analytical Dossier
SpagoBI 2.1 – Data Mining
SpagoBI 2.1 – Data Mining
Data mining is ...
... the nontrivial extraction process of implicit, previously unknown, and potentially useful knowledge from massive amount of data
SpagoBI 2.1 – Data Mining
SpagoBI has a data mining engine based on WEKA library called SpagoBIWekaEngine
With SpagoBIWekaEngine it is possible to execute mining processes defined visually using WEKA's KnowledgeFlow Designer
The output quality of a mining process can be than further investigate using others SpagoBI's analytical engines such as reporting engines
SpagoBI 2.1 – Data Mining
SpagoBI have one data mining engine based on WEKA library called SpagoBIWekaEngine
With SpagoBIWekaEngine it is possible to execute mining processes defined visually using WEKA's KnowledgeFlow Designer
The output quality of a mining process can be than further investigate using others SpagoBI's analytical engines such as reporting engines
SpagoBI 2.1 – Data Mining
SpagoBI have one data mining engine based on WEKA library called SpagoBIWekaEngine
With SpagoBIWekaEngine it is possible to execute mining processes defined visually using WEKA's KnowledgeFlow Designer
The output quality of a mining process can be than further investigated using other SpagoBI's analytical engines such as reporting engines
SpagoBI 2.1 – ETL
SpagoBI 2.1 – ETL
ETL is ...... is a process in data warehousing that involves
1. extracting data from outside sources;
2. transforming it to fit business needs;
3. loading it into the data warehouse.
ETL is important, as it is the way data actually gets loaded into the warehouse.
SpagoBI 2.1 – ETL
SpagoBI has an ETL engine based on Talend called SpagoBITalendEngine
With SpagoBITalendEngine it is possible to execute ETL processes defined visually using Talend Open Studio (TOS)
Each ETL process registered into the platform can be scheduled using the SpagoBI's Scheduler Portlet and then its execution can be minitoreted using SpagoBI's EventMonitor Portlet
SpagoBI 2.1 – ETL
SpagoBI have one ETL engine based on Talend called SpagoBITalendEngine
With SpagoBITalendEngine it is possible to execute ETL processes defined visually using Talend Open Studio (TOS)
Each ETL process registered into the platform can be scheduled using the SpagoBI's Scheduler Portlet and then its execution can be minitoreted using SpagoBI's EventMonitor Portlet
SpagoBI 2.1 – ETL
SpagoBI have one ETL engine based on Talend called SpagoBITalendEngine
With SpagoBITalendEngine it is possible to execute ETL processes defined visually using Talend Open Studio (TOS)
Each ETL process registered into the platform can be scheduled using the SpagoBI's Scheduler Portlet and then its execution can be minitoreted using SpagoBI's EventMonitor Portlet
SpagoBI for the end-user
SpagoBI 2.1Administrator functionalities
SpagoBI for the admin: managing resources
SpagoBI for the admin: managing engines
SpagoBI for the admin: managing data sources
SpagoBI for the admin: managing data sources
SpagoBI for the admin: managing functionalities
SpagoBI for the admin: managing functionalities
SpagoBI for the admin: managing documents
SpagoBI for the admin: managing documents
SpagoBI for the admin: managing List of Values
SpagoBI for the admin: managing analytical drivers
SpagoBI for the admin: managing menus
References
SpagoBI Web Site
http://spagobi.eng.it
SpagoBI Online Demo
http://spagobi.eng.it/SpagoBI
SpagoBI Donwload Forge
http://forge.ow2.org/project/showfiles.php?group_id=204
SpagoBI Forum
http://forge.ow2.org/forum/?group_id=204