35
Mastering Data with CA ERwin Data Modeler Jump Start Your Data Quality Initiatives

Mastering your data with ca e rwin dm 09082010

Embed Size (px)

DESCRIPTION

 

Citation preview

Page 1: Mastering your data with ca e rwin dm 09082010

Mastering Data with CA ERwin Data Modeler

Jump Start Your Data Quality Initiatives

Page 2: Mastering your data with ca e rwin dm 09082010

PAGE 2

Abstract

• Data is a company’s greatest asset. Enterprises that can harness the power of their data will be strategically positioned for the next business evolution. But too often businesses get bogged down in defining a data management process, awaiting some “silver bullet”, while the scope of their task grows larger and their data quality erodes. Regardless of your eventual data management solution is implemented, there are processes that need to occur now to facilitate that process. In this webinar we will discuss using your current data modeling assets to build the foundations of strong data quality.

Page 3: Mastering your data with ca e rwin dm 09082010

PAGE 3

Biography

• Victor Rodrigues brings 10 years of experience of advanced usage of the CA ERwin Modeling suite first as a Senior Support Engineer for the CA ERwin Modeling suite of products and currently as a Senior Software Engineer for Programmer’s Paradise. In this time he has used his extensive experience to implement the tool with various large and small enterprises. This experience includes customization of the CA ERwin tool via the API and Forward Engineering template editor as well as maximizing modeling by integrating the product suite which includes CA Model Validator, CA Model Manager, CA Process Modeler, SAPhir, and now CA Data Profiler.

Page 4: Mastering your data with ca e rwin dm 09082010

PAGE 4

Agenda: The Road to Data Quality

• Start Trusting Your Data

• Obstacles & Object Lessons

• Essentials

• The Data Quality Steps

Page 5: Mastering your data with ca e rwin dm 09082010

Trusting Your Data

Page 6: Mastering your data with ca e rwin dm 09082010

PAGE 6

Data Quality Realities

• Data is a company’s greatest asset.

• Accenture survey shows 40% trust “gut” over BI.

• 61% say good data was not available.

• Data plus quality equals information.

Page 7: Mastering your data with ca e rwin dm 09082010

Obstacles

Page 8: Mastering your data with ca e rwin dm 09082010

PAGE 8

Obstacles to Data Quality

• People, Process or Software related…

– All of the above.

Page 9: Mastering your data with ca e rwin dm 09082010

PAGE 9

Silver Bullets?

• Isn’t the Data Warehouse/ERP solution supposed to be doing this?– Definitions can be context specific.

– Delays taking ownership of your data.

Nike/I2 CMS example.

Page 10: Mastering your data with ca e rwin dm 09082010

The Essentials

Page 11: Mastering your data with ca e rwin dm 09082010

PAGE 11

Data Governance Essentials

1. Metadata Standards

2. Collaboration

3. Structure

4. Policies and Standards

5. Cultural Change

6. Getting from “as is” to “to be”

Page 12: Mastering your data with ca e rwin dm 09082010

PAGE 12

Data Modeling as the Hub

ERP

Data Warehouse

DataModel

Database Management &Administration

Application Development

Business Intelligence (BI)

Master Data Management (MDM)

Page 13: Mastering your data with ca e rwin dm 09082010

The Steps

Page 14: Mastering your data with ca e rwin dm 09082010

PAGE 14

1 – Defining Metadata Standards

Page 15: Mastering your data with ca e rwin dm 09082010

PAGE 15

Why Metadata Matters

• Start by Defining Meta Data– Disagreements as to what a definition is

• Too Conceptual – Definitions are not possible

• Too strict

– Everything can be defined.

Page 16: Mastering your data with ca e rwin dm 09082010

PAGE 16

Strict Yet Flexible

• Too Strict Example.– Phone number as a single entry.

• Too Flexible.– Phone number as XML?

Page 17: Mastering your data with ca e rwin dm 09082010

PAGE 17

Data Warehouse Example

Page 18: Mastering your data with ca e rwin dm 09082010

PAGE 18

Data Warehouse Example

Page 19: Mastering your data with ca e rwin dm 09082010

PAGE 19

Translation Example

Page 20: Mastering your data with ca e rwin dm 09082010

PAGE 20

Translation Example

Page 21: Mastering your data with ca e rwin dm 09082010

PAGE 21

Translation Example

Page 22: Mastering your data with ca e rwin dm 09082010

PAGE 22

2 - Collaboration

• Share designs and templates.

• Model lineage and history.

• Centralized reporting.

Page 23: Mastering your data with ca e rwin dm 09082010

PAGE 23

Overcoming Silo Mentality

• Director of National Intelligence

• “A Space” encourages collaboration.

Page 24: Mastering your data with ca e rwin dm 09082010

PAGE 24

Collaboration

• Updates to apps migrate to source DBMS models and vice-versa.

• Define and enforce your glossary and standard abbreviations.

• Create templates.

Page 25: Mastering your data with ca e rwin dm 09082010

PAGE 25

3 - Organization

• Build on Existing Processes– You are already governing data (informally).

– Identify your assets.

Page 26: Mastering your data with ca e rwin dm 09082010

PAGE 26

We Need Structure

• Add structure to your existing process.

• Link your models.

• Create libraries in your Model Manager that contain linked application models, related DBMS models, etc.

• Create your Model Manager security roles.

Page 27: Mastering your data with ca e rwin dm 09082010

PAGE 27

Possible Library Structure

Page 28: Mastering your data with ca e rwin dm 09082010

PAGE 28

Define your Security

Page 29: Mastering your data with ca e rwin dm 09082010

PAGE 29

4 - Enforcing Standards

• Generate diagram and repository reports to other teams.

• Promote your value to your Business Analysis teams.

• A bidirectional hub to report your standards and update your policies.

Page 30: Mastering your data with ca e rwin dm 09082010

PAGE 30

5 - The Hard Part – Cultural Change

• Data Quality requires a change of culture.

• There is no silver bullet. It is a process.

• Like any habit, it becomes easier with time.

• Replacing bad habits with good ones.

• The process must me bottom up and top down.• NUMMI plant example

Page 31: Mastering your data with ca e rwin dm 09082010

PAGE 31

Good Habits

• Model Everything

– Applications

– DBMS

– Data Warehouses

– ERP systems

– Others

• NoSQL databases, UML models, etc.

• Model your Data Entry.

– Valid Values?

– Nullability?

– Proper and matching Datatypes/Domains.

• Own your (meta)data.– Be a good shepherd.

– Do not pass along bad data.

Page 32: Mastering your data with ca e rwin dm 09082010

PAGE 32

6 - Create Your “TO BE” Design

• Create the “To Be” model.

• Compare “As Is” and “To Be” environments

• Create a process.

Page 33: Mastering your data with ca e rwin dm 09082010

PAGE 33

Conclusion

• Treat data like the asset that it is.

• Data quality creates information.

• Strong metadata definitions + good habits = data quality.

• Data modeling allows us to structure our metadata.

• Data quality is a process and requires cultural changes.

Page 34: Mastering your data with ca e rwin dm 09082010

PAGE 34

Questions?