Getting More From Your Data With Oracle Management Cloud · 2018-02-15 · Oracle Cloud and non-Oracle clouds •OMC services leverage a unified big data platform to provide deep

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

Getting More From Your Data With Oracle Management Cloud Integrating Oracle Enterprise Manager and Oracle Management Cloud

Courtney Llamas, Oracle


Safe Harbor Statement

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Oracle Confidential – Internal 2


01100100 01100001 01110100 01100001 0110010001100001 01110100 0100 01100001 01100100 01100001 0111010001100001 0110010001100001 01011 01110100 110000101100100 01100001 01110100 110000101100100 0110000101110100 01100001 0110010001100001 01110100 110000101100100 0100111 01100001 01110100 11000010110010001100001 01110100 01100001 011010 0110010001100001 01110100 01100001 0110010001100001 01110100 0100101100001 0110010001100001 01110100 01100001 0110010001100001 01001 01110100 01100001 011001000110000101110100 01100001 0100101001 001 0110010001100001 01110100 01100001 0110010001100001 01110100 01001101100001 0110010001100001 01110100 01100001 01100100 01100001 01001 01110100 01100001 011001000110000101110100 01100001 01100100 0100 01100001 01110100 01100001 0110010001100001 01110100 01000100 0100110000101100100 01100001 01110100 110000101100100 01100001 01110100 01100001 0110010001100001 01110100110000101100100 01100001 010001 01110100 110000101100100 01100001 01110100 01100001 01000100 0100110110010001100001 01110100 01100001 0110010001100001 01110100 01000 01110100 110000101100100 0110000101110100 01100001 01000100 010011 0110010001100001 01110100 01100001 0110010001100001 01110100 010011

Oracle Management Cloud

3

END USER EXPERIENCE/ACTIVITY

APPLICATION

MIDDLE TIER

DATA TIER

VIRTUALIZATION TIER

VM CONTAINER

INFRASTRUCTURE TIER

VM CONTAINER

Real UsersSynthetic Users

Unified Platform

App metricsTransactions

Server metricsDiagnosticsLogs

Host metricsVM metricsContainer metrics

CMDB/ComplianceTicketsAlerts

INTELLIGENT, UNIFIED PLATFORM

POWERED BY MACHINE LEARNING

INFORMED BY A COMPLETE DATA SET

HETEROGENEOUS AND OPEN

✔

✔

✔

✔

Security Events

Global Threat FeedsCloud AccessIdentity


• OMC is a next-generation suite of management and monitoring services

• OMC is designed for heterogeneous environments, across on-premise, Oracle Cloud and non-Oracle clouds

• OMC services leverage a unified big data platform to provide deep insights across technical and business data

• EM is a traditional active management and deep diagnostics solution, highly tailored for the Oracle red stack

• EM is deployed on-premise to manage Oracle private, public or hybrid clouds

• EM data is harvested and uploaded to the OMC data platform

4

Oracle Management Cloud Oracle Enterprise Manager

Using Oracle Management Cloud With Enterprise Manager


Types of Data Collected with Oracle Enterprise Manager

• Metadata

• Metrics

• Configuration

• Logs (not collected/stored by OEM)

• AWR (not collected/stored by OEM)

Oracle Confidential 5


Resource Analytics



How do you answer questions about your resources?

• Identify your highest CPU consuming hosts?

• What host is not consuming allocated memory?

• What database can I move to an underutilized box?

• Which server can I add databases on?



Host Resource Analytics

• What is my breakdown by platform type?

• How many hosts have high CPU and Memory utilization?

• What is my aggregate CPU usage of all hosts? Of only Linux?

• Which hosts have available CPU and Memory resources?



Breakdown of Capacity Headroom


Copyright © 2015 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 10


• Storage cells: forecast storage consumption and read/write performance

• Databases: forecast resource consumption to identify outliers and those needing more resources

• Machine learning: Project future capacity needs based on intelligent forecasts of databases workload growth

Resource Analytics for Exadata

Confidential – Oracle Internal/Restricted/Highly Restricted 11


Database Resource Analytics

• Which database is consuming the most CPU?

• How much storage am I using for databases in my environment?

• What is the growth trend and forecast for tablespaces in a database?



Performance Analytics



Identify Systemic Problems in Your Databases• Classify performance on databases based

on:

– Performance degradation, variable performance, database inefficiency and resource bottlenecks

• Breakdown performance degradation based on positive (normal) and inverse (anomalous) correlation with demand

• Identify host resources bottlenecks (paging & swapping, CPU run queues) and its impact on database performance

• Analyze SQL performance based on change in response time to identify slow degradation based on data growth, abnormal change based on plan changes


• EM provides visibility to SQL for a specific database

• OMC Provides visibility to SQL Across databases and across time period

– Which are Top SQL by CPU, Response time, Average Active sessions?

– Check the trends of Top SQLs using various measure like Average Active Session, Response Time, IO Wait, Executions/Hour

• Has the SQL started showing performance degradation?

– Is the same SQL behaving differently in two different databases?

Identify Common SQL Performance issues


Copyright © 2015 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 16

Identify Systemic Middleware Issues

• Identify common issues such as Heap, Garbage Collection, etc.

• Visibility into configuration profiles of the middleware assets based on performance

• Mapping performance issues with configuration profiles to highlight concentration of issues for a particular configuration

• Actionable insights using correlations and trends for analyzing cause and impact of the bottlenecks


Availability Analytics



Availability Analytics for IT Infrastructure

• Which targets in our enterprise have availability and performance issues?

• Are we able to meet Availability SLA?

• Are these due to capacity, load, performance issues?

• Which databases have frequent outages?

• Are we able to recover quickly from database failures?





Log Analytics



• Leverage all targets, associations defined in EMCC

• Easily collect Logs from targets managed by EMCC

• Rapid time-to-value with automatic, secure ingestion of ANY Log data

• Topology Aware Log Exploration

• Machine Learning Based Pattern and Outlier Detection

• Gain business and IT insights from log data


Diagnose System Issues by Gaining real-time insight from Logs


Customizing Log Analytics

• Customize a log source to adjust for alternate paths/standards

• Create a log source using generic parser to read a custom file type

• Create log parser using REGEX expressions to parse custom file type more

• On Demand Upload (targets w/o agents, or one time loads)



Summary



OMC ArchitectureWith Gateway and OEM Integration

Oracle Confidential – Internal

CorporateProxy

(optional)

Gateway

Cloud Agent

REST APIs

26

HTTPS

HTTPS

HTTPS

SSHSQL

APM Agent

Data Collector

OEM Repository

HTTPS

Corporate Firewall

End User

End User

HTTPS


• Cloud Agent– Collects monitoring data, metrics, log

files from entities on the OS

– Any host or VM• including syslog aggregator

• APM Agent

– Collects from application server and enables EUM from browsers

– Installed in application container

• Data Collector– Extracts target, config, metric, alerts

from OEM if used

– Discovers entities automatically

• Gateway– Consolidates and forwards data to

OMC from all other agents

OMC Agents


curl -I --tlsv1.2

https://b56789.itom.management.us2.oracl

ecloud.com

HTTP/1.0 200 Connection established

HTTP/1.1 200 OK

https://b5678.itom.management.us2.oraclecloud.com/


$300 credit for Oracle Cloud

• Sign up for a free trial

• Take a test drive using our sample scripts and logs

• Expand your knowledge and identify relevant use cases

• Deploy Agents to test additional features


How Do You Get Started?

cloud.oracle.com

https://community.oracle.com/thread/4083226

https://www.youtube.com/user/OracleEnterpriseMgr


Agent Install Kit Download

• Review Prerequisites

• Download tenant specific installation kit and regKey from OMC

• Transfer to target servers and extract zip file

• Run ./AgentInstall.sh command


https://docs.oracle.com/cloud/latest/em_home/EMCAD/GUID-07DAA810-4733-4DF9-9622-C157A535C004.htm


Configuration and Customization

• Entities will be created by data harvested from OEM–Other ways to create entities when not using OEM

• Enable Services to begin collection – ITA, Monitoring

– Associate Logs

– Enable EUM collection for APM

• Create Alerts

• Create Dashboards


https://docs.oracle.com/en/cloud/paas/management-cloud/gfadg/index.html


Maintaining OMC

• Stay up to date on monthly releases with New Features documentation

• Update Agents easily from OMC dashboard

• Review dashboards and alerts regularly


https://docs.oracle.com/en/cloud/paas/management-cloud/omcwn/index.html


Advanced Topics

Oracle Confidential – Internal 32


• Missing Patch: Which databases do not have a specific patch and having higher CPU utilization?

• Asset retirement based on data dormancy: which servers running older OS versions are running no active workloads?

• Which operating systems have shown the highest growth in CPU?

Custom Analytics



• Is there a correlation between between business metric and IT demand?

• What are my data center assets and how are they distributed across my organization?

• Do I have under-utilized servers that can be leveraged?

• Which cost center generated most events?

Correlate with Business Performance



Build Your Own Dashboard



Customize Thresholds and Analytics



Creating Widgets and Dashboards

• Dashboards allow to have all important and meaningful data views available at a one-stop place

• From a Dashboard, the user can drill down into the very details, if desired

• The data views (Widgets) available for a Dashboard can be created using Log or Data Explorer

• Example from Log Analytics:– construct a search query for a given use case

– save the query as Widget while giving it a meaningful name

–when creating a Dashboard you can select from the list of saved Widgets












Topology Viewer

• OMC understands the associations between the different entities

• The topology view gives you a complete overview of the selected entities and their relationships

• It provides easy access to main entity facts or its details

• It is available from each Service (APM, LA, IM or ITA)



Topology Viewer - relationships of selected entities



Topology Viewer – main facts of an entity



Topology Viewer – details of an entity



Creating Custom Tags

• Tags allow you to organize your entities by properties you define

• A tag is a key-value pair that can be assigned to an entity



Using Custom Tags

• Tags can be used for dynamic groups

• Dynamic groups can be used to select all entities with a given property



Oracle Management Cloud REST API

• OMC REST API allows to– enable extensibility and customization

– query and manipulate metrics, data and metadata

– upload metric data for Infrastructure Monitoring and IT Analytics

– upload log files for Log Analytics

– submit Log Analytics search queries exactly like run from OMC UI

– scripting will allow you to automate tasks en masse

• Use tools of your choice like Postman, cURL to access the API



Oracle Management Cloud REST API – Overview

• Required parameters: – Domain ID

– Domain URL

–Username / Password

– API Endpoint

• Available actions:– GET, POST, PUT, DELETE

• Input / Output:– text files in JSON format



REST API – Example: Get summary of managed entities

• API Endpoint: ${DOMAIN_URL}/serviceapi/entityModel/data/entities

• Result: Name, Type, Entity ID, API Endpoint of all entities

• Will allow to get quick summary overviews like this and others:

Count Entity type66 omc_host_linux

64 omc_weblogic_j2eeserver

44 omc_oracle_db_instance

38 omc_host_solaris

36 omc_oracle_db_listener

36 omc_oracle_db



REST API – Example: Get all properties of an entity

• API Endpoint: ${DOMAIN_URL}/.../entities/{entityID}/properties

• Result: All property names and values of an entity

• Example Output:{

"audit_dest": {

"displayName": "Audit Log Location",

"value": "/u01/app/oracle/admin/omctestdb/adump„

},

...

},

"host_name": {

"displayName": "Server Name",

"value": "bookable-10-163-223-196.uk.oracle.com„

},

"adr_home": {

"displayName": "ADR Home",

"value": "/u01/app/oracle/diag/rdbms/omctestdb/omctestdb„

}

}



REST API – Example: Log Analytics Search Query

• Example Use Case: Query for all DBs affected by error ORA-1688

• API Endpoint: $DOMAIN_URL/serviceapi/querylanguage.query"

• Input: Query string, start- / end-time"queryString" : " 'Entity Type' = 'Oracle Database Instance'

and 'Error ID' = ' ORA-1688' | stats count by Entity"

• Example Output:

"results": [

["pdb_01/omctest" 240],

["demodb_02", 1426]

],...


Documents

Getting More From Your Data With Oracle Management Cloud · 2018-02-15 · Oracle Cloud and non-Oracle clouds •OMC services leverage a unified big data platform to provide deep