BI Archiving by Usage of PBS-NLS

8/3/2019 BI Archiving by Usage of PBS-NLS

1/30

BI Archiving by usage of PBS-NLS

Marjolijn Berends (St-Addons) en Peter Tonies (NXP)

7 December 2011


2/30

NXPSystem/Application Landscape

Need for BI Archiving

ST-Addons: Near Line Storage (NLS) Solution

Proof of Concept BI Archiving

Next steps and Summary

2

Agenda


3/30

3

NXP Semiconductors

NXP Semiconductors N.V. (NASDAQ: NXPI)

provides High Performance Mixed Signal andStandard Product solutions that leverage itsleading RF, Analog, Power Management,Interface, Security and Digital Processingexpertise.

A global semiconductor company withoperations in more than 25 countries, NXPposted revenue of $4.4 billion in 2010.

Our innovations are used in a wide rangeof automotive, identification, wirelessinfrastructure, lighting, industrial, mobile,consumer and computing applications.


4/30

Key applications (1/2)

Lighting Industrial MobileWireless infra

4

Wireless basestations

Point-to-point

CATVinfrastructure

Broadcasting

Lighting drivers(CFL, LED)

Lightingnetworks

Backlighting

Smart grid

White goods

Home / buildingautomation

Power supplies

Mobile devices

Portable powersupplies

Personal health

Chargers


5/30

Key applications (2/2)

ComputingAutomotive Identification Consumer

5

In-vehiclenetworking

Car access &immobilizers

Car entertainment

Solid State Lighting Telematics

Lighting

Secure identity

Securetransactions

Tagging &authentication

TV

Satellite, Cable,Terrestrial and IPset-top boxes

Satellite outdoorunits

Tablet PCs

Note- /Netbooks

Desktops

Power supplies.Monitors and

peripherals


6/30

NXP

System/Application Landscape





6

Agenda


7/30

BI application landscape (green=used)

7

CHAMP(Netweaver)

Bexanalyzer

SAP BW Portal


8/30

Some SAP BW characteristics

Number per

June 2011 (+/-)

Active users 1200

Active queries used 2500

Infoproviders (cubes/DSO/info objects) > 1000

Database size 2.2 Terabyte

Nr. Of records loaded per week 10 billion


9/30

NXP






9

Agenda


10/30

1. BW Accelerator requires that data growth is controlled -> this can be

achieved by regularly archiving data

2. Reduce size of online database, which leads to: Improved reporting response times (reading from archive is faster then from online)

Improved data loading times -> more predictable times for data availability

Reduced costs in case we can store the archived data on a lower cost storage

medium OR in case the archived data uses less space due to compression

What if not? Strong growth of BW database leads to operational issues and complexity (adding

storage)

Performance decreasing over time Inefficient usage of storage

Why would we need to archive in SAP BW?


11/30

Archiving policy defined

Until December 2010: used standard SAP archiving functionality

Two areas piloted and archived: Inventory management

Profit Center Accounting

Main disadvantages of standard SAP archiving functionality: To read archived data it must be first reloaded into BW (Complex, time-

consuming)

This implies that we can only archive data once we hardly ever need to

access it again

No compression so hardly any reduction of storage costs

History regarding BI archiving at NXP


12/30

Other possibilities for Archiving -> Near LineStorage solutions from Development Partners


13/30

NXP






13

Agenda


14/30

NLS Solutions for SAP BW:Data Archiving Process DAP


15/30

Column-based Architecture

Relational Database

c5

c4

c3

c2

c1

c9

c8

c7

c6

r1

r2

r3

r4

r5

SYBASE IQ

c5

c4

c3

c2

c1

c9

c8

c7

c6

r1

r2

r3

r4

r5

Data is stored horizontally in rows

Reporting is very I/O-intensive

No effective query access

Data is stored vertically in columns

Each column acts as index for its data

Reporting: significantly reduced I/O

rate

Effective query access optionsSource: Sybase Inc.


16/30

NLS Solutions for SAP BW:PBS MultiProvider Integration for BW 7.0


17/30

NXP




Proof of Concept (PoC) BI Archiving Why PoC?

Scope PoC

Expectations PoC

Results PoC

Business CaseNext steps and Summary

17

Agenda


18/30

Need solution that can provide direct access to archived data via the

query, meaning that we can shorten time to archive -> PBS softwareMain expected benefits:

Complete integration between online SAP data and archived SAP data

Guaranteed flexible access to our SAP data in the future

Impact on SAP users is zero by using the SAP standard

reports/transactions Discussion what do I keep online moves from retention period to is this

document closed? Archive it a.s.a.p. (Information Lifecycle Mngt)

Reduces the load on SAP BW system and reduce TCO

Disadvantage:

Investment required (both license and hardware)

Proof Of Concept costs: appr. 35 kUSD

Reasons for executing PoC archiving with PBS

Proof of Concept (PoC) BI Archiving -> Why PoC?


19/30

Datamodel PCA (which is part of POC PBS NLS)

19

Scope of PoC Archiving with PBS

SFF_C63: PCA High Level SFF_C64: PCA Details

SFF_O66: PCA Container Line Items

SFF_O60 SFF_O63

NLS IQ

SFF_O64: PCA Actuals Line Items CLASS

SFF_O61: PCA Act Items SPEED

Proof of Concept (PoC) BI Archiving -> Scope PoC


20/30

Acceptance criteria PoC Archiving with PBS

Criteria Expected result

Data Quality / Data content consistency Yes

Possibility to archive DSO data Yes

Possibility to archive cube data Yes

Possibility to report directly on archived data Yes

Response time when reading from archived data at least 2times faster then from online db

In most cases

Database size of archived data is 10% or less from originaldb size

Yes

Data reload time 1 day

20Proof of Concept (PoC) BI Archiving -> Expectations


21/30

Acceptance criteria PoC Archiving with PBS

Criteria Expectedresult

Actual result

Data Quality / Data content consistency Yes Yes

Possibility to archive DSO data Yes Yes

Possibility to archive cube data Yes Yes

Possibility to report directly on archived data Yes YesResponse time when reading from archiveddata at least 2 times faster then from online db

In most cases Yes

Database size of archived data is 10% or lessfrom original db size

Yes No

Data reload time 1 day 4 a 5 hours

21Proof of Concept (PoC) BI Archiving -> Results I


22/30

22

Query 1 & 2 are real-world PCA querys

Query 3 is a test query aggregating 1 keyfigure of a large amount PCA data on yearlevel.Query 3 online data performance increase also due to other factors (upgrade Oracle 11)Correctness of output data all querys verified

37 32

65

96

218

155

9 13 6

92

1

68

0

50

100

150

200

250

Query 1, NLS data(3.016.771)

Query 1, Onlinedata (2.708.379)





Re

sponsetimeinSe

conds

Tested query ( avg. selected records )

Query response times NLS vs Online database(lower value means faster response time)

before archiving

After archiving

Proof of Concept (PoC) BI Archiving -> Results II


23/30

Monthly archiving of total PCA model will take approx. 4.5 hours

Monthly archiving run (6.5mln records) of the biggest data container,

the PCA integration layer (total 160mln records), takes +/- 1.5 hours.

Average archiving speed: 75k records / minute

Reloading time nearly equals original archiving time.

23

Archiving & reloading times

Write Store Delete

Restore

Proof of Concept (PoC) BI Archiving -> Results III


24/30

Decrease online storage (by the amount of archived data)

Increase NLS storage Compression factor: less promising results after Oracle 11.2g then initially,but measurements so far show a reduction of 50%

24

Sizing

Proof of Concept (PoC) BI Archiving -> Results IV


25/30

One-time investment required for BW ArchvingLicense 76%

Server 3%

Project costs 21%

Total one-time investment 100%

25

Required costs for BW archiving with PBS

Yearly fee (recurring) 2011 2012 2013 2014

Maintenance fee for PBS software (17%) 13% 13% 13% 13%

Server costs Production (. eur/mnth) 12% 12% 12% 12%

Optional: Server costs Quality assurance/test ( eur/mnth) 12% 12% 12% 12%

TAM costs 2% 2% 2% 2%

Total yearly fee (recurring) 39% 39% 39% 39%

Proof of Concept (PoC) BI Archiving -> Business Case I


26/30

Based on reduction of storage costs: Assumptions

Conclusion: no business case.BUT:

26

Business case PBS archiving - 1

Assumption: costs for storage (in eur/mnth/Gb (including backup)) 1

Assumption: costs for storage for archived date (in eur/mnth/Gb ) 0.75

Expected yearly database growth (%) 50

Remaining database size after archiving (in %) 50

-60000

-40000

-20000

0

20000

40000

60000

80000

100000

120000

2011 2012 2013 2014

Cost for storage (yearly) w/oarchiving

Net saving

Cost for storage (yearly) whenusing archiving

Proof of Concept (PoC) BI Archiving -> Business Case II


27/30

The BW Accelerator is growing fast in size and is currently almost full - >

archiving means that the size of the BWA can be controlled and therefore

avoids an additional investment in the BWA !

Assumptions:

Conclusion: savings as of 2012 (earn-back time appr. 1 year) PLUS

27

Business case PBS archiving - 2

Yearly BWA growth (in %) 60

Costs for additional storage BWA (in eur/Gb, one-time investment) 3400

-100000

0

100000

200000

300000

400000

500000

600000

700000

800000

900000

2011 2012 2013 2014

Net saving

Net saving includingavoidance ofadditional BWAcosts per year

Cumulative netsaving including

avoidance ofadditional BWAcosts

Proof of Concept (PoC) BI Archiving -> Business Case III

A d


28/30

NXP






28

Agenda


29/30

Decide on initial investment

Arrange license for PBS together with purchasing

Make PBS archiving productive Install production server and productive license

Determine order of infocubes/DSOs to archive (based on combination of

size and availability of a partitioning entity) Embed in structural process

29

Next steps


30/30

Archiving in BW is a must. There are two options:

30

Summary

Archiving solution Pro Con Remarks

Standard SAP (ADK) Cheap Investment in BWA expansionrequired

Time-consuming and cumbersomeprocess to read from archive plusissue when data structure changes

In case no investment in BWAexpansion is/can be done: certainfunctional areas will have to be

removed from the BWA ->performance decrease for endusers

No compression so hardly anysaving on storage costs

PBS archiving solution Reporting performanceimprovement, read directly fromarchive

PBS archiving solution Strong business case incase majority of data inBWA is suitable forarchiving

Data loading performanceimprovement

Enables control over growth ofBWA, no investment in BWArequired

Documents

BI Archiving by Usage of PBS-NLS