CON-6627 Enterprise Data Quality · Import Reference Data from EDQ-P Enterprise Manager integration Monitoring of EDQ Jobs and Web Services from EM Publication of DQ results into

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. |

CON-6627 Enterprise Data Quality Overview and Roadmap

Mike Matthews Senior Director, Product Management September 2016


Safe Harbor Statement

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.


Agenda

Enterprise Data Quality Overview

Latest Releases

Roadmap and Product Vision

Customer Spotlight - ESC

Q & A

1

2

3

4

5


Your data may be your most valuable asset

Treat it wisely

Profiling

Business Rules

Deduplication

Standardization

Remediation

Enhancement


What you would expect of EDQ

• Fast and highly scalable - proven with very large record volumes

• Single configuration UI - from the very beginning of the product

• Easily integrated in batch or real-time

• Works with virtually any type of data in any format or language

• UIs and Documentation available in 9 languages

• Available On Premise or in the Oracle Public Cloud


What you may not know

• EDQ is the DQ engine powering a range of Oracle Cloud Services:

– Sales Cloud

– Customer Data Management

– Procurement Cloud

– Data as a Service for Sales

– Address Verification

• EDQ includes a highly flexible and fully integrated Case Management application


The DNA of EDQ

• Data first approach

• Fast time-to-results

• Self-service for business users to analyze data

• Designed for collaboration

• Easy Data Stakeholder engagement


Improved User Productivity Multi-attribute capability in many more processors Additional processors for working with array attributes from hierarchical sources Support for arrays in Match processors

Additional Customer Data Services and Processors New Country, Name and Email Services Additional Customer Data Processors

Now Available: EDQ 12.2.1.1, EDQ AV 16.2

Case Management Flexibility Access to more Extended Attributes

Configuration API for Integrated Profiling REST Web Services provided to allow programmatic generation and running of profiling jobs Link to results of profiling job in EDQ

Address Verification 16.2 Focus on quality in verification and search.


Additional Customer Data Services

Name Services

Validation, parsing, standardization and transliteration of individual and entity names

Country Service

Validation, standardization, and code derivation for countries and nationalities

Email Service

Validation and standardization of email address formats

All services are powered by reusable packaged processors that can be used in your own projects >>


REST Configuration Web Services

REST configuration web services are available, offering some ability to configure EDQ programmatically, and get info on EDQ configuration objects

Supports the generation and running of profiling jobs externally

A URL can be constructed that links to the results in EDQ once generated

Suitable for other integrations (including Oracle Cloud Services), for example:

Read or create reference data externally

Dynamic read of web service interfaces

Read which jobs are available

Run, monitor and cancel jobs remotely


Improved Productivity with Hierarchical Data

~20 processors have been enhanced to add support for multiple attributes, and array attributes

17 new processors to work with array attributes

Match processors now support arrays, matching on all elements, making it no longer necessary to ‘explode’ records to work with multiple values such as email addresses and phone numbers

The new capabilities improve performance and productivity when working with hierarchical data sources, where arrays can be used to store multiple values


Roadmap and Product Vision Seamless Enterprise Data Governance in the Hybrid Landscape



EDQ on Oracle Public Cloud

In 2017, EDQ will be available on Oracle Public Cloud with subscription pricing and simplified provisioning

EDQ will run on the Java Cloud Service (PaaS) and will be compatible with all PaaS options:

Scale Up/Down/Out/In

Automated Backup and Restore

JCS Patching

Provisioned as part of Data Integration Suite (TBC)


EDQ 12.2.1.3

The following features are currently targeted for EDQ 12.2.1.3

Product Data Services: New services and processors for working with Product Data

Extraction, Classification, Matching, Reference Data

Import Reference Data from EDQ-P

Enterprise Manager integration

Monitoring of EDQ Jobs and Web Services from EM

Publication of DQ results into new Data Governance application

Targeted for release in CY 2017


Enterprise Data Governance

• First version (CY 2017/2018) will be focused on Data Quality Governance

Advanced Dashboarding of DQ Results (with Drilldowns, Charting)

Business Rule Management

Trend Analysis and Alerts

Issue Management

Built-in analysis of data issues

• Application will be integrated with EDQ and

other Oracle Cloud Services

• Open interface (REST API) to enable easy

integration with other DQ / DI / BI software

• Vision is to provide a Control Center for enterprise data that enables you to treat it as a capital asset


Changing forces in Data Quality, Integration & Management

• Move to the Cloud, creating a Hybrid Landscape for data

• Imperative to Govern data (flows and content), treating it as a Capital Asset

• Even greater user expectations in Time-to-results and Self Service

• No let-off in the needs for Accuracy and Compliance

• Growing need for Reusable Data Services, in applications & cloud services, in integration pipelines, and in Hadoop


A portfolio of Integrated Cloud Services for: • Fast Data Integration • Self-Service Data Preparation • Data Governance

Using a common framework for: • Data Storage & Asset Management • Reusability of Data Services • Data Governance • Machine Learning & Automation

With the benefits of Cloud Computing: • Elastic Scalability • High Availability • Automated Backups

Available in the Oracle Public Cloud, or in your Data Centre of choice

Ready-integrated with Oracle Cloud Services: • BI Cloud Service • Big Data Cloud Service • Big Data Discovery • Oracle Applications

Internet

Logs

On-Premise and Cloud Data Assets

Structured and Unstructured

Cloud Data Integration and Governance

Profiling Workflow & Stewardship

Service Design

Recommendations, Metadata, Asset Inventory

Next Generation Data Integration, Management and Governance in the Hybrid Landscape

Asset Explorer


Customer Spotlight Enterprise Service Center EDQ for US Dept of Transportation and other customers


Debra Allen - Requirements Manager, US Department of Transportation/ESC

John Stover - Supervisory Accountant, FAA

Elevating service by understanding data

Agenda

• Who we are

• Goals in implementing EDQ

• The EDQ Pilot

• Pilot Results

• Future for EDQ at ESC

• Q&A

Who we are

• Enterprise Services Center (ESC) is a Federal Shared Service Provider (FSSP) for Financial Services, Information Systems Security and Technology Solutions

• FSSP of Choice for 21 customers who share a single production environment of Oracle EBS Federal Suite version 12.1.3 with over 12TB of data

• Located in Oklahoma City, Oklahoma with a supporting staff of 1,000+

Goals in implementing EDQ

• Ground-breaking effort to increase awareness of data issues to accomplish:

– an increase in efficiencies

– reduction of manual labor hours

– opportunity to re-purpose a number of resources for other tasks

– increase in data integrity and accuracy

The EDQ Pilot

• Product purchased as part of Oracle engineered Data Warehouse deal

• Originally intended for Data Warehouse cleansing

• ESC utilized EDQ as a proactive measure against live Oracle EBS Federal Production

– Supplier Table

– Customer Table

– General Ledger Application Integrator (ADI) Spreadsheets

Pilot Results

• Supplier Table

– 57K Duplicate Suppliers

– 37K Missing DUNs

– 141K TAXID not on SAM Active or Inactive record

• Customer Table

– 4,425 records, or 1 in 21 customers, was found in violation of Standard Procedures

• General Ledger ADI Spreadsheets

– Validated compliance with one auditable business rule

– Validated compliance with two DATA act mandates

Future Vision of EDQ

• Continuation of EDQ as a driver for Data Governance

• Utilized at an Enterprise Level; all source systems to adhere to EDQ rules (whether Oracle or non-Oracle)

• Continue to implement new processes for compliance and increased customer experience

• Current projects: • Improper Payments

• Enforcement of Standardization – Data Act Mandates

• Integrity and Accuracy for Financial Management Reporting

• Exception Reporting for Faster Reconciliation Measures

Thank you

Questions Discussions Comments


Presen-tations on:

Data Integration Solutions Program - tinyurl.com/DISOOW16

Demo Stations:

Hands-on labs:

Oracle Enterprise Metadata

Management

Oracle Enterprise

Data Quality

Oracle GoldenGate

Oracle Data

Integrator

Oracle Big Data

Preparation Cloud Service

Oracle Enterprise

Data Quality HOL7466

Oracle GoldenGate Deep Dive HOL7528

ODI and OGG for Big Data

HOL7434

Oracle Big Data Preparation

Cloud Service HOL7432

Middleware Demoground

- Moscone South

Big Data Showcase

- Moscone South

Database Demoground

- Moscone South


Data Integration Solutions Program - tinyurl.com/DISOOW16

Monday, Sept 19 • Oracle Data Integration Solutions – Platform Overview and Roadmap

[CON6619 ] • Oracle Data Integration: the Foundation for Cloud Integration [CON6620 ] • A Practical Path to Enterprise Data Governance with Cummins [CON6621] • Oracle Data Integrator Product Update and Strategy [CON6622] • Deep Dive into Oracle GoldenGate 12.3 New Features for the Oracle 12.2

Database [CON6555]

Tuesday, Sept 20 • Oracle Big Data Integration in the Cloud [CON7472] • Oracle Data Integration Platform: a Cornerstone for Big Data [CON6624] • Oracle Data Integrator and Oracle GoldenGate for Big Data [HOL7434] • Oracle Enterprise Data Quality – Product Overview and Roadmap

[CON6627] • Self Service Data Preparation for Domain Experts – No Programming

Required [CON6630] • Oracle Big Data Preparation Cloud Service: Self-Service Data Prep for

Business Users [HOL7432] • Oracle GoldenGate 12.3 Product Update and Strategy [CON6631] • New GoldenGate 12.3 Services Architecture [CON6551] • Meet the Experts: Oracle GoldenGate Cloud Service [MTE7119]

Wednesday, Sept 21 • Data Quality for the Cloud: Enabling Cloud Applications with Trusted Data

[CON6629] • Oracle Enterprise Data Quality for All Types of Data [HOL7466] • Oracle GoldenGate for Big Data [CON6632] • Accelerate Cloud On-Boarding using Oracle GoldenGate Cloud Service

[CON6633] • Oracle GoldenGate Deep Dive and Oracle GoldenGate Cloud Service for Cloud

Onboarding [HOL7528]

Thursday, Sept 22 • Best Practices for Migrating to Oracle Data Integrator [CON6623] • Best Practices for Oracle Data Integrator: Hear from the Experts [CON6625] • Dataflow, Machine Learning and Streaming Big Data Preparation [CON6626] • Data Governance with Oracle Enterprise Data Quality and Metadata

Management [CON6628] • Faster Design, Development and Deployment with Oracle GoldenGate Studio

[CON6634] • Getting started with Oracle GoldenGate [CON7318] • Best Practice for High Availability and Performance Tuning for Oracle

GoldenGate [CON6558]


Connect with Oracle Data Integration

@OracleDI

Blogs.oracle.com/DataIntegration/

Oracle Data Integration

Oracle Data Integration


Documents

CON-6627 Enterprise Data Quality · Import Reference Data from EDQ-P Enterprise Manager integration Monitoring of EDQ Jobs and Web Services from EM Publication of DQ results into