Data mining and data warehousing

Data Mining & Warehousing

2

1) User expectat ion2) Systems opt imizat ion3) Data s tructur ing4) Prefabr icated vs . Custom warehouse5) Resource ba lancing

Challenges faced on Data Warehousing

3

As the vo lume of data in a warehouse increases , warehouse management sys tems need to move deeper in warehouses for data ana lys i s .

The end -user in these cases demands and expects more accurate and refined resu l ts in re turn o f process ing , however that i s not the case wi th warehouse sys tems.

The per formance decreases wi th exp lod ing data and so the effic iency o f the sys tem reduces .

1. User expectation

4

Regress ive ut i l i zat ion o f bus iness in te l l igence too ls require f requent maintenance and fine tun ing o f whole system in order to meet users ' expectat ions .

Carefu l ly des igned and configured data ana lys is too l he lps in prov id ing bet ter resu l ts for effect ive bus iness deve lopment dec is ions .

2. Systems optimization

5

Proper process ing o f data requires s t ructur ing i t in a des i red format so that fur ther operat ions can be executed .

As the vo lume of data increases the task o f s t ructur ing data o f system eventua l ly becomes hect ic for the system manager.

3. Data structuring

6

The var ie t ies of warehouses ava i lab le in market , create ambigui ty about which type to choose or go for.

Where custom warehouse saves the t ime o f bu i ld ing the warehouses f rom var ious operat iona l databases f rom weeks to days or even hours , pre fabr icated warehouses saves the t ime o f in i t ia l configurat ion and ins ta l la t ion .

4. Prefabricated vs. Custom warehouse

7

In order to draw benefit f rom data warehous ing , most depar tments ins ide an organizat ion tend to access the process ing capabi l i t ies o f the warehouse . Th is eventua l ly reduces the per formance o f the system and decreases the effic iency as the s tress on the sys tem increases . Access contro l and secur i ty are some techniques which can be used to mainta in a balance between the ut i l i zat ion and per formance o f warehouse systems .

5. Resource Balancing

8

Decis ion suppor t systems (DSS) are a spec ific c lass o f computer ized in format ion system that suppor ts bus iness and organ izat ional dec is ion -making act iv i t ies .

DSS is a we l l in tegrated ,user f r iend ly, computer based too ls that combine data wi th var ious dec is ion making mode ls to so lve semi s t ructure and unstructured problems.

Decision support system

9

Prov ide dec is ion support for several in terdependent dec is ion .

Ass is t the dec is ion maker to make dec is ion under dynamic bus iness condi t ions .

Supports a wide var ie ty o f dec is ion making processes and s ty le .

Characteristics

10

How a DSS works???

11

Database management system Model management   system Support too ls

Components of DSS

12

In database management , the problem necessary to so lve may come f rom interna l and ex terna l database .

With in the organ izat ion , in ternal data are generated by systems such as TPS and MIS; externa l data come f rom var ie ty o f sources such as per iod ica ls , databases , newspapers and on l ine data serv ices .

Database Management

13

I t s tores and access models that managers use to make dec is ions .

Models are in tegra l par t o f most dec is ion making and are used for many tasks , such as des ign ing a manufactur ing fac i l i ty, analys ing the financia l hea l th o f an organizat ion , forecas t ing demand for a product or serv ice , and determin ing the qual i ty o f a par t icu lar batch o f products .

Model Management Component

14

I t cons is t o f too ls such as pu l l down menus , on - l ine he lp , users in ter face , graphical analys i s and error -correct ion mechanisms a l l o f which fac i l i ta te users in teract ions wi th the system.

In ter faces are an important support too ls . Th is i s because middle and top managers have ne i ther the t ime nor the inc l inat ion to learn d iff icu l t and compl icated procedures in order to run a sys tem. For better the in ter face , the greater the chances that users wi l l accept the system.

Support Tools

15

Cost sav ing Improve manager ia l effect iveness Flex ib le and adapt ive Improve the effect iveness o f the dec is ion Reduces the t ime and effor ts in co l lec t ing and analys i s

o f data for d ifferent sources , a large no o f a l ternat ives can be eva luated .

Advantages of DSS

16

I t i s a lso termed as Execut ive Support Sys tem[ESS] .

I t i s a spec ia l i zed dec is ion support system used to ass i s t sen ior execut ives in the dec is ion -mak ing process .  

I t inc ludes var ious hardware , so f tware , data , procedures and the people .

I t i s very user f r iendly in the nature .

I t i s suppor ted at a large ex tent by the graph ics .

Executive Information System[EIS]

17

18

1. In format iona l character i s t ics

2 . User in ter face /or ientat ion character is t ics

3 . Manager ia l / execut ive character i s t i cs

Characteristics of Executive Information System

19

i. Flex ib i l i ty and ease o f use .ii. Prov ides the t imely in format ion wi th the shor t

response t ime and a lso wi th the qu ick retr ieva l .iii. Produces the correct in format ion .iv. Produces the re levant in format ion .v. Produces the va l idated in format ion .

1. Informational characteristics

20

i. Consis ts o f the soph is t icated se l f he lp .ii. Contains the user f r iendly in ter faces cons is t ing o f the

graphic user.iii. Can be used f rom many p laces .iv. Offers secure re l iab le , confident ia l access a long wi th

the access procedure .v. Is very much customized. Su i tes the management s ty le

of the ind iv idual execut ives .

2. User interface/orientation characteristics

21

i. Supports the over a l l v i s ion , miss ion and the s trategy.ii. Prov ides the suppor t for the s trateg ic management .iii. Somet imes he lps to dea l wi th the s i tuat ions that have a

h igh degree o f r i sk .iv. I s l inked to the va lue added bus iness processes .v. Supports the access to database .vi. I s very much resu l t or iented in the nature .

3. Managerial / executive characteristics

22

1.Ach ievement o f the var ious organizat iona l ob ject ives .

2 .Faci l i ta tes access to the in format ion by in tegrat ing many sources o f the data .

3 . Fac i l i ta tes broad, aggregated perspect ive and the context .

4 . Offers broad h igh ly aggregated in format ion .

5 . User ’ s product iv i ty i s a lso improved to a large ex tent .

6 . Communicat ion capabi l i ty and the qual i ty are increased.

Advantages of EIS

1. In terna l fac tors - accurate & re l iab le in format ion , improve communicat ions , use o f h is tor ica l data

2. External fac tors - increas ing g lobal compet i t ion , changing the bus iness env ironment , government regulat ions .

Factors affecting EIS

24

DSS EIS

Used by professionals Required for day to day

operations Deals both with semi &

unstructured data

Consists only of internal information

Used by executives Required for strategic plans

and procedures Deals only with unstructured

data (which cannot be described in detail)

Consists of both internal & external information

Differences between DSS and EIS