Get Proactive with DBA Task Automation

Business-DrivenIT Management

Oracle Enterprise Manager:Empowering IT to Drive Business Value

Get Proactive with DBA Task Automation

Jagan Athreya

Director of Product Management

Oracle Corporation

Scott McNeil

Senior Product Marketing Manager

Oracle Corporation

© 2010 Oracle Corporation – Proprietary and Confidential 2

Managing the Rapid Rise in Database Growth2011 IOUG Survey on Database Manageability

Background:

• 445 Independent Oracle Users Group (IOUG) members

community took part

• Respondents included; Oracle technologists, architects,

developers, and DBAs

• Purpose: find out the database management challenges

administrators face


Managing the Rapid Rise in Database Growth2011 IOUG Survey on Database Manageability

33%Handle close to 100

database instances each

14%Experienced 4 or more

episodes of unplanned down

time per month

33%Report their data stores are

expanding by more than

20% per year

60%Use SQL tuning to address

performance issues

27%Restrict user access to fix

problems

90%Experienced unplanned

downtime resulting from DB

changes not properly tested

20%Admit doing nothing to

address performance issues

12%Can tell if a problem was

caused by an unauthorized

database change

31%Add more hardware to fix

performance problems

Source: Managing the Rapid Rise in Database Growth: 2011 IOUG Survey on Database Manageability


Top DBA Challenges

Keeping databases at current patch levels 45%

13%Performing repetitive tasks and processes

42%Diagnosing database performance problems

35%Managing security threats

33%Managing more databases with same resources

33%Identifying resource-intensive SQL in real-time

26%Tracking configurations for compliance purposes

21%Promoting DB changes from dev/test to prod

21%Provisioning test or development systems

17%Dealing with rapidly growing database structures


Polling Question

What is your top database management challenge?

1. Dealing with rapidly growing database structures

2. Diagnosing database performance problems

3. Identifying resource-intensive SQL statements in real-time

4. Keeping databases at current patch levels

5. Managing increasing security threats

6. Managing larger number of databases with same resources

―Bottom line:

The faster the data growth, the greater the inclination

to adopt methodologies and proactive solutions that

provide better database manageability.‖

2011 IOUG Survey on

Database Manageability


Why Automation?For Better Database Manageability

• Automation helps lower costs and improve IT efficiencies

• Automate tasks for:

• Deployment and provisioning

• Monitoring

• Day-to-day administration

• Benefits:

• Reduce manual tasks

• Improve DBA productivity

• Minimize human errors

• Improve service quality

• Maximize resource utilization

Keys to Database Automation

Know WhatYou Have

• Discovery and

asset tracking

• Real-time change

detection

ImplementStandards

• Use standard

processes

• Deploy standard

configurations and

monitor for

compliance

Manage Manyas One

• Group IT assets in

order to perform

mass operations

• Automate group

operations

Know WhatYou Have

• Discovery and

asset tracking

• Real-time change

detection

ImplementStandards

• Use standard

processes

• Deploy standard

configurations and

monitor for

compliance

Manage Manyas One

• Group IT assets in

order to perform

mass operations

• Automate group

operations

Keys to Database Automation

Best-in-Class Database Management

Full support for Oracle Database 11g with new features and

capabilities so you can:

• Deploy systems with confidence

• Proactively monitor and manage systems through 1 console

• Manage and automate day-to-day DBA tasks

Deployment

• Discovery and asset tracking

• Database and RAC provisioning

• Test system provisioning

Monitoring

• Implement monitoring standards

• Corrective actions

• Auto-clearing old alerts

Day-to-Day Administration

• Automated Backups

• Job System

• Automated Patching

• Schema Change Detection

Automating Database Management Tasks

Deploy

Monitor

Manage

Deployment




Monitoring






• Job System




Deploy

Monitor

Manage

Challenge: Controlling Configuration Drift


―Experience unplanned downtime

due to configuration drift, which

results as changes are made.‖80%

Know What You HaveDiscovery & Asset Tracking

• Effective use of your assets

• Proactively identify and fix problems

• Automated, daily collection of configuration data

• Search & reports across enterprise

• Compare configurations to ―gold‖ standards and baselines

Automated Configuration Drift CheckingQuickly Identify Differences Impacting Operations

• Complex configuration comparison

• Compare one-to-one, one-to-many

• Save comparisons and versions

• Compare entire application stacks or technology layers

• Compare all components of your operation

• Understand what has changed over time

Features Benefits

Web

Applications

Mid

Tiers

Business

Applications

Database

<Insert Picture Here>

―Most respondents do not have systematic means or

practices to address surging business requirements.

Most are unable to automatically bring new

databases online fast enough to meet demand.‖

2011 IOUG Survey on

Database Manageability


•Supports gold images, reference systems, or bandwidth optimized local stage location

•Supports both cloning and fresh installation methods for software provisioning

• Mass deployment—multiple database deployments across multiple servers

•Template based database creation

•Database cloning using RMAN

•Several applications: test to production; production to test; EBS environment cloning

Templates

Gold ImagesDevelopment

Test QA

Mass Deployment

Database Provisioning

• Gold image based provisioning

• Simplified RAC provisioning with automation

• Single click RAC scale-out and scale-back

• Automated migration to Oracle Grid

• Provision full RAC and Clusterware systems

• ASM Support

4 Steps to RAC Provisioning

Create Reference RAC System

1

Stage Gold Image

2

Scale-Out RAC

4

Create Production RAC System

3

Provisioning Test DatabasesIncrease Productivity—Automate Error Prone Manual Tasks

Clone and Mask DataProduction Database

Test Database

• Build new application environments more efficiently

• Automate repetitive deployment tasks

• Provision changes completely

• Validate changes were made correctly

Secure Test System Deployment Oracle Data Masking

• Deploy secure test system by masking sensitive data

• Sensitive data never leaves the database

• Extensible template library and policies for automation

• Sophisticated masking: Condition-based, compound, deterministic

• Integrated masking and cloning

• Leverage masking templates for common data types

• NEW: Command line (EMCLI) support for data masking actions

LAST_NAME SSN SALARY

SMITH 111—23-1111 60,000

MILLER 222-34-1345 40,000

LAST_NAME SSN SALARY

AGUILAR 203-33-3234 40,000

BENSON 323-22-2943 60,000

Production Test

Oracle Data MaskingComprehensive and Extensible Mask Library

Ensures consistent enforcement of policies

Define once, apply everywhere

Accelerates solution deployment of masking

Mask formats for common sensitive data

Enables customization of business rules

Extensible mask routines

Time Savings with ProvisioningDeployment of Pre-Patched Software

Manual operation time

Clusterware

installation

45 minutes

ASM installation 1 hour

Database software

installation

45 minutes

Database creation 30 minutes

Clusterware patching 12 minutes

ASM patching 12 minutes

Database patching 20 minutes

0

50

100

150

200

250

Without EM With EM

Steps

Time (in minutes)

Reliably and repeatedly provision multiple databases in a single

change window with 100% time saving. Skill agnostic process

ensure compliance to standards.

s

© 2010 Oracle

Reduce Operations Cost with AutomationForrester Total Economic Impact of Configuration and Provisioning Packs

• Reduction in costs of

managing IT

• Increase staff productivity

• Increased agility to

business needs

• Reduction on capital

spending

Deployment




Monitoring






• Job System




Deploy

Monitor

Manage

Metric Warn CritCorr

Action

Table-

space

75 90 xxx

Archive

Area %

70 80 yyy

• Custom metric settings containing your standards for monitoring

• Monitoring templates for test, production, and supporting specific applications

• Fully automated template deployment with target discovery via Default Templates

• Deploy against many targets at a time using groups

• Support for inclusion in scripted workflows via EMCLI apply template verb

• Adhoc and scheduled template compliance reports

Database Monitoring Implement Monitoring Standards Using Monitoring Templates

MonitoringTemplates

ProductionDatabase Group

ApplyTemplates

1100001110100

010111010011

10100110101

EM CommandLine Utility

Grid Control Console

• Automates resolution for well-known, common problems

• User-defined tasks that trigger in response to alerts

• Defined on a per metric or per metric severity basis

• Single task or multi-task with dependencies between tasks

• Corrective Actions Library for code re-use

• Notification support for corrective action success or failure

Database Monitoring Automate Alert Resolution Using Corrective Actions

Critical Alert Corrective Action Automated Alert

Resolution

Database Monitoring Automated Clearing of Old Alert Log Alerts

• Enforce operational policies to auto-clear old ‗Alert Log‘ alerts

• Prevents unwanted accumulation of past alerts

• Eliminates burden on DBA to manually clear alerts after issues are resolved

• Automated, bulk clearing of old ‗alert log‘ alerts in 2 ways:

• Notification Rule with duration condition (e.g. 30 days) on the alert log

metrics and ‗Clear Alert‘ action. Applies to groups of databases

• EMCLI script to clear stateless alerts for specified database

Alert Log Auto-Cleared

Alerts After N DaysDBA Fixes IssuesIssues Identified

Deployment




Monitoring






• Job System




Deploy

Monitor

Manage

28

Backup & Recovery FoundationComplete Oracle Solution From Disk-to-Tape

• Oracle backup and recovery for your entire IT environment

• Multiple media options available to meet the most stringent SLAs

• Local disk, remote Cloud storage, physical and virtual tape

File System Data

UNIX Linux

Windows NAS

Oracle Databases

Oracle Secure Backup

(OSB)


(OSB) Cloud Module

Cloud Storage

Tape Backup

Fast Recovery AreaOracle Recovery

Manager (RMAN)

29 Copyright © 2010, Oracle. All rights reserved

Automated Database BackupUsing Oracle Enterprise Manager & RMAN

•Automated, scheduled database

backup using RMAN & Grid Control

•Status tracking & notifications for

backup success or failure

•Leverage RMAN intrinsic knowledge

of database file formats & recovery

procedures

• Block validation

• Online block-level recovery

• Tablespace/data file recovery

• Online, multi-streamed backup

• Unused block compression

• Native encryption

• Label Security

• Integrated disk, tape & cloud backup

leveraging the Fast Recovery Area

& Oracle Secure Backup

Cloud

Tape Drive


Data

base

RMAN

Fast Recovery Area

Oracle Enterprise Manager Job System

Key Capabilities:• Numerous out-of-box job types

• Schedule and execute jobs

• View job output and status

• Manage job lifecycle

• Create new job definitions and define

dependencies

• Save pre-configured jobs in Job Library

• Diverse scheduling options

• Automate bulk operations

• Access control and integrated credential management

• Notifications for various job states

• Comprehensive reporting

• Easy to use

• Centralized console

• Supports numerous job types & common use cases

• Create new job types and define dependencies

• Performs mass operations across multiple targets & systems

• Notifications on job states

• Extremely scalable

Benefits

Challenge: Patch Management


―Number of DBAs who said

keeping databases at current

patch levels was their top

challenge.‖45%

• Proactive advisories, recommendations, and analysis

• One-off patches, patch set updates, and critical patch updates

• Zero downtime patching for RAC

• Integrated patch management & deployment automation

• Patch intelligence and community

• Streamlined conflicts and merge patch process

Automating PatchingFully Integrated with My Oracle Support

Analyze TestPatch ReportStage

Stage

Provision

Integrated FeaturesPatches & Updates

Patch Management Features Community Driven Patch Information

• Enhanced patch advise

with comprehensive patch

recommendations

• Comprehensive patch

information; new additions

like patch popularity,

downloads trend and

community integration

• Creating patch plans allows

patches to be applied in

single downtime

• Automated validation for

conflict checks

• Single click simplified merge

patch request process

• Integrated with patch rollout

procedure

Patch Management FeaturesPatch Plans and Patch Validation

Patch Management Case Study: Bayer

**Assumes DBA FTE cost at $100/hr

"We manage thousands of databases and application servers with Enterprise Manager, and we have been able to reduce the time for database upgrades from 4 hours down to 1 hour, as well as reduce patch application time from 1 hour down to 1 minute per database. Enterprise Manager Grid Control allows us to automate this process, which translates into huge savings in time and money.―

Andreas Stephan, Sr. DBA Consultant Bayer Business Services

2000 Databases, 5 Full time DBAs, 1 Hour per patch, 4 Times a year

$160,000**Before EM8,000

person hrs

$2,666**After EM133

person hrs

http://www.oracle.com/pls/ebn/live_viewer.main?p_direct=yes&p_shows_id=6265113

One Unified System @ WorkBenefits of My Oracle Support and Enterprise Manager

We have saved 25% of internal support time across our DBA team.

Personalized

ProactiveIt took the initial 36 hours of trying to understand what the configuration out of the equation completely.

CollaborativeMy Oracle Support Community now goes beyond ‘customer satisfaction’ and even beyond ‘customer delight’. The new paradigm is… ‘customer ecstasy.’

IntegratedWe've been able to reduce the amount of time to apply critical patch updates by up to 80%.

Challenge: Change Management


―Number of DBAs who said they

avoid making changes to

production databases because of

negatively impacting performance.‖50%

Automated Change Management Reduce Time and Effort of Database Change Management

Change Automation

• Automated process for capturing and propagating

planned database schema changes from development

to production environments

• Eliminates manual error-prone processes

• Accelerate application upgrades by tracking impact of

upgrades on customizations

• Reduce downtime and speeds up recovery by ensure

compliance of production environments with

established standards

• Capture information on all schema objects for an application:

• Tables, Views, Indexes

• Procedures, Packages, Triggers

• Users, init.ora

• Capture & Compare scope:• Database, Schema, Objects

• Compare Modes• Baselines to Baselines

• Baselines to Database

• Database to Database

Schema Change Detection & AutomationCapture & Compare Application Baselines / Workflows

HR

Order

Entry

CRM

Baseline 1

Baseline 21100001110100010111010011

10100110101

1100001110100010111010011

10100110101

1100001110100010111010011

10100110101

SALES

DEPTEMP

ORDERS

PRODUCT PRICE

Baseline 3

Syncing Application EnvironmentsOracle Change Management

ReportingProduction

TrainingStage

Disaster Recovery

Test

1100001110100

010111010011

10100110101

• Tracking changes to production databases

• Promoting changes from testing to staging to production

• Transferring schema & other database changes to DR, training, and

reporting environments

DBA Task Automation for Exadata DB Machine

• Monitoring and Configuration Management

• Entire stack from database to disk

• Provisioning

• Initial setup performed through ―onecommand‖

• Ongoing database provisioning performed through

Enterprise Manager Grid Control

• Patching

• Ongoing database patching automated through

Enterprise Manager Grid Control

• Database nodes can be patched horizontally with

other databases in the data center

• Cell patching done through ―patchmgr‖

Keys to Database Automation Benefits

Know What

You Have

• Simplify

management

• Proactively identify

and fix problems

Implement

Standards

• Control

configuration drift

• Enforce policies

and compliance

Manage Many

as One

• Improve scalability

• Enhance service

quality with self-

management

Final Recommendations

• Move away from separate or siloed administrative

practices and methods

• Look at the big picture, not just the database

• Adopt or update change management practices

• Testing is essential

• Keep up to date with the techniques and technology

Oracle Enterprise ManagerResource Center

Access Videos, Webcasts, White Papers, and More

Oracle.com/goto/enterprisemanager

Technology

Get Proactive with DBA Task Automation