24
Data Mining & Warehousing

Data mining and data warehousing

Embed Size (px)

Citation preview

Page 1: Data mining and data warehousing

Data Mining & Warehousing

Page 2: Data mining and data warehousing

2

1) User expectat ion2) Systems opt imizat ion3) Data s tructur ing4) Prefabr icated vs . Custom warehouse5) Resource ba lancing

Challenges faced on Data Warehousing

Page 3: Data mining and data warehousing

3

As the vo lume of data in a warehouse increases , warehouse management sys tems need to move deeper in warehouses for data ana lys i s .

The end -user in these cases demands and expects more accurate and refined resu l ts in re turn o f process ing , however that i s not the case wi th warehouse sys tems.

The per formance decreases wi th exp lod ing data and so the effic iency o f the sys tem reduces .

1. User expectation

Page 4: Data mining and data warehousing

4

Regress ive ut i l i zat ion o f bus iness in te l l igence too ls require f requent maintenance and fine tun ing o f whole system in order to meet users ' expectat ions .

Carefu l ly des igned and configured data ana lys is too l he lps in prov id ing bet ter resu l ts for effect ive bus iness deve lopment dec is ions .

2. Systems optimization

Page 5: Data mining and data warehousing

5

Proper process ing o f data requires s t ructur ing i t in a des i red format so that fur ther operat ions can be executed .

As the vo lume of data increases the task o f s t ructur ing data o f system eventua l ly becomes hect ic for the system manager.

3. Data structuring

Page 6: Data mining and data warehousing

6

The var ie t ies of warehouses ava i lab le in market , create ambigui ty about which type to choose or go for.

Where custom warehouse saves the t ime o f bu i ld ing the warehouses f rom var ious operat iona l databases f rom weeks to days or even hours , pre fabr icated warehouses saves the t ime o f in i t ia l configurat ion and ins ta l la t ion .

4. Prefabricated vs. Custom warehouse

Page 7: Data mining and data warehousing

7

In order to draw benefit f rom data warehous ing , most depar tments ins ide an organizat ion tend to access the process ing capabi l i t ies o f the warehouse . Th is eventua l ly reduces the per formance o f the system and decreases the effic iency as the s tress on the sys tem increases . Access contro l and secur i ty are some techniques which can be used to mainta in a balance between the ut i l i zat ion and per formance o f warehouse systems .

5. Resource Balancing

Page 8: Data mining and data warehousing

8

Decis ion suppor t systems (DSS) are a spec ific c lass o f computer ized in format ion system that suppor ts bus iness and organ izat ional dec is ion -making act iv i t ies .

DSS is a we l l in tegrated ,user f r iend ly, computer based too ls that combine data wi th var ious dec is ion making mode ls to so lve semi s t ructure and unstructured problems.

Decision support system

Page 9: Data mining and data warehousing

9

Prov ide dec is ion support for several in terdependent dec is ion .

Ass is t the dec is ion maker to make dec is ion under dynamic bus iness condi t ions .

Supports a wide var ie ty o f dec is ion making processes and s ty le .

Characteristics

Page 10: Data mining and data warehousing

10

How a DSS works???

Page 11: Data mining and data warehousing

11

Database management system Model management   system Support too ls

Components of DSS

Page 12: Data mining and data warehousing

12

In database management , the problem necessary to so lve may come f rom interna l and ex terna l database .

With in the organ izat ion , in ternal data are generated by systems such as TPS and MIS; externa l data come f rom var ie ty o f sources such as per iod ica ls , databases , newspapers and on l ine data serv ices .

Database Management

Page 13: Data mining and data warehousing

13

I t s tores and access models that managers use to make dec is ions .

Models are in tegra l par t o f most dec is ion making and are used for many tasks , such as des ign ing a manufactur ing fac i l i ty, analys ing the financia l hea l th o f an organizat ion , forecas t ing demand for a product or serv ice , and determin ing the qual i ty o f a par t icu lar batch o f products .

Model Management Component

Page 14: Data mining and data warehousing

14

I t cons is t o f too ls such as pu l l down menus , on - l ine he lp , users in ter face , graphical analys i s and error -correct ion mechanisms a l l o f which fac i l i ta te users in teract ions wi th the system.

In ter faces are an important support too ls . Th is i s because middle and top managers have ne i ther the t ime nor the inc l inat ion to learn d iff icu l t and compl icated procedures in order to run a sys tem. For better the in ter face , the greater the chances that users wi l l accept the system.

Support Tools

Page 15: Data mining and data warehousing

15

Cost sav ing Improve manager ia l effect iveness Flex ib le and adapt ive Improve the effect iveness o f the dec is ion Reduces the t ime and effor ts in co l lec t ing and analys i s

o f data for d ifferent sources , a large no o f a l ternat ives can be eva luated .

Advantages of DSS

Page 16: Data mining and data warehousing

16

I t i s a lso termed as Execut ive Support Sys tem[ESS] .

I t i s a spec ia l i zed dec is ion support system used to ass i s t sen ior execut ives in the dec is ion -mak ing process .  

I t inc ludes var ious hardware , so f tware , data , procedures and the people .

I t i s very user f r iendly in the nature .

I t i s suppor ted at a large ex tent by the graph ics .

Executive Information System[EIS]

Page 17: Data mining and data warehousing

17

Page 18: Data mining and data warehousing

18

1. In format iona l character i s t ics

2 . User in ter face /or ientat ion character is t ics

3 . Manager ia l / execut ive character i s t i cs

Characteristics of Executive Information System

Page 19: Data mining and data warehousing

19

i. Flex ib i l i ty and ease o f use .ii. Prov ides the t imely in format ion wi th the shor t

response t ime and a lso wi th the qu ick retr ieva l .iii. Produces the correct in format ion .iv. Produces the re levant in format ion .v. Produces the va l idated in format ion .

1. Informational characteristics

Page 20: Data mining and data warehousing

20

i. Consis ts o f the soph is t icated se l f he lp .ii. Contains the user f r iendly in ter faces cons is t ing o f the

graphic user.iii. Can be used f rom many p laces .iv. Offers secure re l iab le , confident ia l access a long wi th

the access procedure .v. Is very much customized. Su i tes the management s ty le

of the ind iv idual execut ives .

2. User interface/orientation characteristics

Page 21: Data mining and data warehousing

21

i. Supports the over a l l v i s ion , miss ion and the s trategy.ii. Prov ides the suppor t for the s trateg ic management .iii. Somet imes he lps to dea l wi th the s i tuat ions that have a

h igh degree o f r i sk .iv. I s l inked to the va lue added bus iness processes .v. Supports the access to database .vi. I s very much resu l t or iented in the nature .

3. Managerial / executive characteristics

Page 22: Data mining and data warehousing

22

1.Ach ievement o f the var ious organizat iona l ob ject ives .

2 .Faci l i ta tes access to the in format ion by in tegrat ing many sources o f the data .

3 . Fac i l i ta tes broad, aggregated perspect ive and the context .

4 . Offers broad h igh ly aggregated in format ion .

5 . User ’ s product iv i ty i s a lso improved to a large ex tent .

6 . Communicat ion capabi l i ty and the qual i ty are increased.

Advantages of EIS

Page 23: Data mining and data warehousing

1. In terna l fac tors - accurate & re l iab le in format ion , improve communicat ions , use o f h is tor ica l data

2. External fac tors - increas ing g lobal compet i t ion , changing the bus iness env ironment , government regulat ions .

Factors affecting EIS

Page 24: Data mining and data warehousing

24

DSS EIS

Used by professionals Required for day to day

operations Deals both with semi &

unstructured data

Consists only of internal information

Used by executives Required for strategic plans

and procedures Deals only with unstructured

data (which cannot be described in detail)

Consists of both internal & external information

Differences between DSS and EIS