31
Ultimate Exadata IO monitoring Flash, HardDisk , & Write back cache overhead Presented by: Karl Arao 1

OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

Embed Size (px)

DESCRIPTION

 

Citation preview

Page 1: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

Ultimate Exadata IO monitoringFlash, HardDisk , & Write back cache

overhead

Presented by: Karl Arao

1

Page 2: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

whoami

Karl Arao• Senior Technical Consultant @ Enkitec• Performance and Capacity Planning Enthusiast

7 years DBA experienceOracle ACE, OCP-DBA, RHCE, OakTableBlog: karlarao.wordpress.comWiki: karlarao.tiddlyspot.comTwitter: @karlarao

www.enkitec.com 2

Page 3: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

www.enkitec.com 3

200+

3

Booth #501 Moscone

South

Page 4: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

Agenda

• Performance scenario

• WBFC

• Different ways to Monitoring IO• AWR IO data• Correlate up to the workload and sqlstats data – feedback loop• Cell data - cell_iops.sh

• Scaling it!

www.enkitec.com 4

Page 5: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

www.enkitec.com 5

Page 6: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

The workload

www.enkitec.com 6

Page 7: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

Performance page

www.enkitec.com 7

Page 8: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

OEM12c storage grid perf

www.enkitec.com 8

Page 9: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

WBFC

www.enkitec.com 9

http://goo.gl/2WCmw

Page 10: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

www.enkitec.com 10

Write-Through Write-Back

Page 11: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

www.enkitec.com 11

Page 12: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

www.enkitec.com 12

Page 13: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

www.enkitec.com 13

Page 14: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

www.enkitec.com 14

Page 15: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

Tableau demo on AWR IOPS and Workload data

www.enkitec.com 15

Page 16: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

Different views of IO performance with AWR datahttp://goo.gl/i660CZ

SECTION 1: USER IO wait class and cell single block reads latency with curve fitting

SECTION 2: Small IOPS vs Large IOPS

SECTION 3: Flash vs HD IOPS

SECTION 4: Flash vs HD IOPS with read/write breakdown

SECTION 5: IO throughput read/write MB/s

SECTION 6: Drill down on smart scans affecting cell single block latency on 24hour period

www.enkitec.com 16

Page 17: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

www.enkitec.com 17

Measuring the effect of IORM on latency

Page 18: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

www.enkitec.com 18

Page 19: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

www.enkitec.com 19

IORM BASIC IORM AUTO IORM LOW

LATENCY

Page 20: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

Tableau demo on Cell data - cell_iops.sh

www.enkitec.com 20

Page 21: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

www.enkitec.com 21

Page 22: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

How do you scale?

www.enkitec.com 22

Page 23: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

Metric Extensions + BIP

www.enkitec.com 23

Page 24: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

www.enkitec.com 24

DB and CELL IOPS/MBs comparison:

1)Create metric extensions for DB and CELL

2)Create the model

3)Graph it in Tableau and BIP

4)Schedule the email of final reports/visualization

Page 25: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

www.enkitec.com 25

Page 26: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

www.enkitec.com 26

Reference band for HardDisk IOPS capacityCheck the _OTHER_DATABASE_ IOPS and compare with AWR and CELL numbers for WBFC destage & flash cache metadata operations overhead

Page 27: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

www.enkitec.com 27

Page 28: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

Workload AAS by day per node

www.enkitec.com 28

Page 29: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

Summary• WBFC

• Different ways to Monitoring IO• AWR IO data• Correlate up to the workload and sqlstats data – feedback loop• Cell data - cell_iops.sh

• Scaling it with Metric Extensions and BIP

www.enkitec.com 29

Page 30: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

References• WBFC patent http://goo.gl/2WCmw• AWR scripts and cell_iops.sh

http://karlarao.wordpress.com/scripts-resources/• SQL Developer ready AWR scripts http://goo.gl/ocv5b• Different views of IO performance with AWR data http://goo.gl/i660CZ

www.enkitec.com 30

Page 31: OakTableWorld 2013: Ultimate Exadata IO monitoring – Flash, HardDisk , & Write back cache overhead

Questions?

karlarao.wordpress.comkarlarao.tiddlyspot.com

@karlarao

www.enkitec.com 31

[email protected]