20
Mikael Hagström SAS Institute Multidimensional Data Model Extensions to Data Warehouses

Multidimensional Data Model Extensions to Data Warehouses · S Different Needs Knowledge Workers Satisfy need to have data reflect their business visiondata Exploratory ‘analysis’,

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Multidimensional Data Model Extensions to Data Warehouses · S Different Needs Knowledge Workers Satisfy need to have data reflect their business visiondata Exploratory ‘analysis’,

Mikael Hagström

SAS Institute

Multidimensional

Data Model Extensions

to

Data Warehouses

Page 2: Multidimensional Data Model Extensions to Data Warehouses · S Different Needs Knowledge Workers Satisfy need to have data reflect their business visiondata Exploratory ‘analysis’,

S

Different Needs

Knowledge Workers

Satisfy need to have data

reflect their business

vision

Exploratory ‘analysis’,

help to identify possible

answers

Access to subsets of

detail data

Simple (i.e. spreadsheet-

like) access

Information Technology

Enable end-users fast

access to summarized

data

Alignment with data

warehouse architecture

Accurate and timely data

Build, maintain and

perform capabilities

Interested in hardware and

network demands

What can SAS Institute offer them ?

Page 3: Multidimensional Data Model Extensions to Data Warehouses · S Different Needs Knowledge Workers Satisfy need to have data reflect their business visiondata Exploratory ‘analysis’,

Business Intelligence Architecture

Warehouse

Administrator

Extract

Transform

“Scrub”

Add-value

Warehouse

Storage

Architecture

Business

Intelligence

Applied

Analysis

OLAP

MDDB

Page 4: Multidimensional Data Model Extensions to Data Warehouses · S Different Needs Knowledge Workers Satisfy need to have data reflect their business visiondata Exploratory ‘analysis’,

S

“Packaged OLAP” Technology

Proprietary data storage architecture

MDDB (Multi Dimensional Data Base)

SAS/EIS Class

Viewers

MDDB Enabled SAS/EIS Classes

Multidimensional report

3D Business graphs

Map

Organizational chart

Graphical variance report

Page 5: Multidimensional Data Model Extensions to Data Warehouses · S Different Needs Knowledge Workers Satisfy need to have data reflect their business visiondata Exploratory ‘analysis’,

S

Data Warehouse Storage Structure

Metadata

MDDB

Page 6: Multidimensional Data Model Extensions to Data Warehouses · S Different Needs Knowledge Workers Satisfy need to have data reflect their business visiondata Exploratory ‘analysis’,

S

Hybrid OLAP (HOLAP)

Relational OLAP (ROLAP)

Relational Storage

highly voluminous data

typically flexible

Multidimensional OLAP (MOLAP)

Multi Dimensional Storage (MDDB)

summarisable data

typically fast

Page 7: Multidimensional Data Model Extensions to Data Warehouses · S Different Needs Knowledge Workers Satisfy need to have data reflect their business visiondata Exploratory ‘analysis’,

S

SAS MDDB - Features

Efficient storage, Sparsity control

Flexible tuning

Fast summarization

Automatic statistics

Fast information retrieval

Flexible Client/Server deployment

Reach through to source data

Multi-platform (“Mobile OLAPs”)

Integrated with Data Warehouse

Analysis

PC Personal Productivity tools

Page 8: Multidimensional Data Model Extensions to Data Warehouses · S Different Needs Knowledge Workers Satisfy need to have data reflect their business visiondata Exploratory ‘analysis’,

S

Multi-Dimensional Data is typically Sparse by its nature

… but clustered.

Page 9: Multidimensional Data Model Extensions to Data Warehouses · S Different Needs Knowledge Workers Satisfy need to have data reflect their business visiondata Exploratory ‘analysis’,

S

MDDB - What’s Inside ?

MDDB

Page 10: Multidimensional Data Model Extensions to Data Warehouses · S Different Needs Knowledge Workers Satisfy need to have data reflect their business visiondata Exploratory ‘analysis’,

S

MDDB - What’s Inside ?

NWAY Crossing

Subtable

Lookup table

Page 11: Multidimensional Data Model Extensions to Data Warehouses · S Different Needs Knowledge Workers Satisfy need to have data reflect their business visiondata Exploratory ‘analysis’,

S

MDDB - How does it work ?

NWAY Crossing

Request

Reach Through

Page 12: Multidimensional Data Model Extensions to Data Warehouses · S Different Needs Knowledge Workers Satisfy need to have data reflect their business visiondata Exploratory ‘analysis’,

S

Size Relationship

MDDB Operational

Data

Page 13: Multidimensional Data Model Extensions to Data Warehouses · S Different Needs Knowledge Workers Satisfy need to have data reflect their business visiondata Exploratory ‘analysis’,

S

35.5 Million Records

2.2 % Sparsity

1.5 Gb Storage

Sample PC Based MDDB

Base Table: MDDB Class:

5 Dimensions

10 Classification

Groups

4 Prestored

Statistics

Characteristics:

19.2 Million Potential

Cells

4.2 Million Input Cells

378 Mb Storage

65 Mb Minimal Storage

Page 14: Multidimensional Data Model Extensions to Data Warehouses · S Different Needs Knowledge Workers Satisfy need to have data reflect their business visiondata Exploratory ‘analysis’,

S

Exploit Improved RLS

Remote Data

Higher Transfer Speed

Less Data Transferred

MDDB

Page 15: Multidimensional Data Model Extensions to Data Warehouses · S Different Needs Knowledge Workers Satisfy need to have data reflect their business visiondata Exploratory ‘analysis’,

S

429 Million Records

29.8 % Sparsity

9 Gb Storage

Sample Server Based MDDB

Base Table: MDDB Class:

5 Dimensions

11 Classification

Groups

4 Prestored

Statistics

Characteristics:

94 Million Potential

Cells

28 Million Input Cells

1.7 Gb Storage

1 Gb Minimal Storage

Page 16: Multidimensional Data Model Extensions to Data Warehouses · S Different Needs Knowledge Workers Satisfy need to have data reflect their business visiondata Exploratory ‘analysis’,

S

MDDB Creation

Interactively using EIS

Interactively using SCL

Batch using Proc MDDB

Can be created and/or accessed on

any host

eg: MVS, VM, Unix, Windows, …

Including Partial Update

Page 17: Multidimensional Data Model Extensions to Data Warehouses · S Different Needs Knowledge Workers Satisfy need to have data reflect their business visiondata Exploratory ‘analysis’,

S

Demo

Page 18: Multidimensional Data Model Extensions to Data Warehouses · S Different Needs Knowledge Workers Satisfy need to have data reflect their business visiondata Exploratory ‘analysis’,

S

SAS MDDB - Features

Efficient storage, Sparsity control

Flexible tuning

Fast summarization

Automatic statistics

Fast information retrieval

Flexible Client/Server deployment

Reach through to source data

Multi-platform (“Mobile OLAPs”)

Integrated with Data Warehouse

Analysis

PC Personal Productivity tools

Page 19: Multidimensional Data Model Extensions to Data Warehouses · S Different Needs Knowledge Workers Satisfy need to have data reflect their business visiondata Exploratory ‘analysis’,

Business Intelligence Architecture

Warehouse

Administrator

Extract

Transform

“Scrub”

Add-value

Warehouse

Storage

Architecture

Business

Intelligence

Applied

Analysis

OLAP

MDDB

Page 20: Multidimensional Data Model Extensions to Data Warehouses · S Different Needs Knowledge Workers Satisfy need to have data reflect their business visiondata Exploratory ‘analysis’,

The SAS® System for successful decision making

Thank you for

your attention