01 Sun Oracle Exadata V2 Technical Overview

Embed Size (px)

Citation preview

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    1/72

    Sun Oracle Exadata and Database Machine Overview

    Copyright 2009, Oracle Corporation and/or its affiliates

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    2/72

    Copyright 2009, Oracle Corporation and/or its affiliates 2

    The Architecture of the Future

    Massively Parallel Grid

    Best for Data Warehousing

    Best for OLTP

    Best for Consolidation

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    3/72

    Copyright 2009, Oracle Corporation and/or its affiliates 3

    Database Machine Success

    Database Machine is succeeding in all geographies andindustries against every competitor

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    4/72

    Copyright 2009, Oracle Corporation and/or its affiliates 4

    The Oracle Database Machine is an ideal cost-effectiveplatform to meet our speed and scalability needs.

    Ketan Parekh, Manager Database Systems

    After carefully testing several data warehouse platforms, wechose the Oracle Database Machine. Oracle Exadata was able tospeed up one of our critical processes from days to minutes..

    Brian Camp, Sr. VP of Infrastructure Services

    A query that used to take 24 hours to complete now runs inless than 30 minutes. The Oracle Database Machine beatscompeting solutions onbandwidth, load rate, disk capacity,and transparency.

    Christian Maar, CIO

    Database Machine Success

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    5/72

    Copyright 2009, Oracle Corporation and/or its affiliates 5

    Agenda

    Overview

    Exadata Based Product Offerings

    Exadata Architecture and Features

    Best Data Warehousing Machine Best OLTP Machine

    Best Consolidation Machine

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    6/72

    Copyright 2009, Oracle Corporation and/or its affiliates 6

    The ProductsExadata Storage Server & Database Machine

    Exadata Storage Server

    Storage Product Optimized for OracleDatabase

    Extreme I/O and SQL Processingperformance

    Combination of hardware and

    software

    Exadata Storage Server Software

    Sun Oracle Database Machine

    Pre-Configured High Performance

    Balanced performanceconfiguration

    Takes the guess work out ofbuilding an Oracle deployment

    Exadata Storage Server Software

    Oracle Database 11.2

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    7/72Copyright 2009, Oracle Corporation and/or its affiliates 7

    Business Value of Exadata

    Extreme Performance: Dramatic performanceimprovements (10-100X) for your data warehouses.Dramatic performance improvements (20X) for OLTPapplications

    Linear Scalability: Performance scales linearly with

    increase in data volumes. Enterprise Ready: Get up and running quickly with a

    complete system containing all the required hardware andsoftware. Single enterprise level support for all hardwareand software from Oracle.

    Standard: Works transparently with existing applications.Manage your databases and applications the same wayyou do today.

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    8/72Copyright 2009, Oracle Corporation and/or its affiliates 8

    Storage Bottlenecks

    Today, database performance is limited by storage

    Storage systems limit data bandwidth from storage to servers

    Storage Array internal bottlenecks

    SAN bottlenecks

    Random I/O bottlenecks due to physical disk speeds Data Bandwidth limits severely restrict performance for data

    warehousing

    Random I/O bottlenecks limit performance of OLTP applications

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    9/72Copyright 2009, Oracle Corporation and/or its affiliates 9

    Exadata Smart StorageBreaks Data Bandwidth and Random I/O Bottleneck

    Oracle addresses data bandwidth bottleneck 3ways

    Massively parallel storage gridof high performanceExadata storage servers (cells).

    Data bandwidth scales with data volume

    Data intensive processingruns in Exadata storage. Queries run in storage as data streams from disk,

    offloading database server CPUs

    Columnar compression reduces data volume up to 10x

    Exadata Hybrid Columnar Compression provides10x lower cost, 10x higher performance

    Oracle solves random I/O bottlenecks using ExadataSmart Flash Cache

    Increase random I/Os by factor of 20X

    Exadata Storage Cells

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    10/72Copyright 2009, Oracle Corporation and/or its affiliates 10

    Exadata Based Product Offerings

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    11/72

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    12/72

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    13/72

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    14/72

    Copyright 2009, Oracle Corporation and/or its affiliates 14

    Scale Performance and Capacity

    Scalable Scales to 8 rack database machine

    by just adding wires

    More with externalInfiniBand switches

    Scales to hundreds of storage servers

    Multi-petabyte databases

    Redundant and Fault

    Tolerant

    Failure of any componentis tolerated

    Data is mirrored acrossstorage servers

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    15/72

    Copyright 2009, Oracle Corporation and/or its affiliates 15

    Drastically Simplified Deployments

    Database Machine eliminates thecomplexity of deploying databasesystems

    Months of configuration, troubleshooting, tuning

    Database Machine is ready on dayone

    Pre-built, tested, standard, supportable configuration

    Runs existing applications unchanged

    Extreme performance out of the boxMonths toDays

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    16/72

    Copyright 2009, Oracle Corporation and/or its affiliates 16

    Sun Exadata Storage Server Hardware

    Building block of massively parallel Exadata Storage Grid

    Up to 1.5 GB/sec raw data bandwidth per cell

    Up to 75,000 IOPS with Flash Sun Fire X4275 Server

    2 Quad-Core Intel Xeon E5540 Processors

    24GB RAM

    Dual-port 4X QDR (40Gb/s) InfiniBand card

    Disk Options

    12 x 600 GB SAS disks (7.2 TB total) 12 x 2TB SATA disks (24 TB total)

    4 x 96 GB Sun Flash PCIe Cards (384 GB total)

    Software pre-installed

    Oracle Exadata Storage Server Software

    Oracle Enterprise Linux

    Drivers, Utilities

    Single Point of Support from Oracle

    3 year, 24 x 7, 4 Hr On-site response

    Sun Exadata Storage

    Server Hardware

    Hardware by

    Software by

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    17/72

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    18/72

    Copyright 2009, Oracle Corporation and/or its affiliates 18

    Sun Oracle Database Machine Full Rack

    Pre-Configured for Extreme Performance

    8 Sun FireX4170 Oracle Database servers

    14 Exadata Storage Servers (All SAS or allSATA)

    3 Sun Datacenter InfiniBand Switch 36

    36-port Managed QDR (40Gb/s) switch

    1 Admin Cisco Ethernet switch Keyboard, Video, Mouse (KVM) hardware

    Redundant Power Distributions Units (PDUs)

    Single Point of Support from Oracle

    3 year, 24 x 7, 4 Hr On-site response

    Add more racks for additional scalability

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    19/72

    Copyright 2009, Oracle Corporation and/or its affiliates 19

    4 Sun FireX4170 Oracle Database servers

    7 Exadata Storage Servers (All SAS or allSATA)

    2 Sun Datacenter InfiniBand Switch 36

    36-port Managed QDR (40Gb/s) switch

    1 Admin Cisco Ethernet switch Keyboard, Video, Mouse (KVM) hardware

    Redundant PDUs

    Single Point of Support from Oracle

    3 year, 24 x 7, 4 Hr On-site response

    Can Upgrade to a Full Rack

    Sun Oracle Database Machine Half Rack

    Pre-Configured for Extreme Performance

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    20/72

    Copyright 2009, Oracle Corporation and/or its affiliates 20

    2 Sun FireX4170 Oracle Database servers

    3 Exadata Storage Servers (All SAS or allSATA)

    2 Sun Datacenter InfiniBand Switch 36

    36-port Managed QDR (40Gb/s)

    InfiniBand switch 1 Admin Cisco Ethernet switch

    Keyboard, Video, Mouse (KVM) hardware

    Redundant PDUs

    Single Point of Support from Oracle

    3 year, 24 x 7, 4 Hr On-site response

    Can Upgrade to an Half Rack

    Sun Oracle Database Machine Quarter Rack

    Pre-Configured for Extreme Performance

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    21/72

    Copyright 2009, Oracle Corporation and/or its affiliates 21

    Sun Oracle Database Machine Basic SystemEntry Level non-HA Configuration

    1 Sun FireX4170 Oracle Database servers 1 Exadata Storage Servers (All SAS or all

    SATA)

    1 Sun Datacenter InfiniBand Switch 36

    36-port Managed QDR (40Gb/s)

    InfiniBand switch InfiniBand Cables

    Installed in Customer supplied Rack

    Customer supplied Ethernet and KVMInfrastructure

    Single Point of Support from Oracle

    3 year, 24 x 7, 4 Hr On-site response

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    22/72

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    23/72

    Copyright 2009, Oracle Corporation and/or its affiliates 23

    Exadata Product Capacity

    Single Server Quarter Rack Half Rack Full Rack

    Raw Disk1SAS 7.2 TB 21 TB 50 TB 100 TB

    SATA 24 TB 72 TB 168 TB 336 TB

    Raw Flash1 384 GB 1.1 TB 2.6 TB 5.3 TB

    User Data2(assuming nocompression)

    SAS 2 TB 6 TB 14 TB 28 TBSATA 7 TB 21 TB 50 TB 100 TB

    1Raw capacity calculated using 1 GB = 1000 x 1000 x 1000 bytes and 1 TB = 1000 x 1000 x 1000 x 1000 bytes.

    2 - User Data: Actual space for end-user data, computed after single mirroring (ASM normal redundancy) and afterallowing space for database structures such as temp, logs, undo, and indexes. Actual user data capacity varies by

    application. User Data capacity calculated using 1 TB = 1024 * 1024 * 1024 * 1024 bytes.

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    24/72

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    25/72

    Copyright 2009, Oracle Corporation and/or its affiliates 25

    Exadata Architecture and Features

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    26/72

    Copyright 2009, Oracle Corporation and/or its affiliates 26

    Exadata Configuration

    Each Exadata Cell is a self-contained server which houses diskstorage and runs the Exadata software

    Oracle Databases are deployed across multiple Exadata Cells

    Oracle Database enhanced to work in cooperation with ExadataStorage Server

    No practical limit to number of Cells that can be in the grid

    Exadata Cell

    InfiniBand Switch/Network

    Single-Instance

    Database

    RAC

    Database

    Exadata Cell Exadata Cell

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    27/72

    Copyright 2009, Oracle Corporation and/or its affiliates 27

    Exadata Architecture

    DB Server

    DB InstanceDBRM

    ASM

    Single-Instance

    Database

    RAC

    DatabaseDB Server

    DB InstanceDBRM

    ASM

    DB Server

    DB InstanceDBRM

    ASM

    OELCELLSRV MS

    RS

    IORM

    iDB Protocol over

    Inf iniBand w ith

    Path Failover

    InfiniBand Switch/Network

    CellControl

    CLI

    EnterpriseManager

    OELCELLSRV MS

    RS

    IORM

    OELCELLSRV MS

    RS

    IORM

    Exadata Cell

    Exadata Cell

    Exadata Cell

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    28/72

    Copyright 2009, Oracle Corporation and/or its affiliates 28

    Exadata Software Features

    Exadata Smart Scans 10X or greater reduction in data sent to database servers

    Exadata Storage Indexes Eliminate unnecessary I/Os to disk

    Hybrid Columnar Compression (HCC) Efficient compression increases effective storage capacity and increases

    user data scan bandwidths by a factor of 10X

    Exadata Smart Flash Cache Breaks random I/O bottleneck by increasing IOPs by 20X

    Doubles user data scan bandwidths

    I/O Resource Manager (IORM) Enables storage grid by prioritizing I/Os to ensure predictable performance

    Inter-leaved Grid Disks Enables storage grid that allows multiple applications to place frequently

    accessed data on faster portions of the disk

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    29/72

    Copyright 2009, Oracle Corporation and/or its affiliates 29

    Exadata Smart Scan

    Exadata cells implement scan offload to greatlyreduce the data sent to database servers

    Row filtering based on where predicate

    Column filtering

    Join filtering

    Incremental backup filtering Scans on encrypted data

    Data Mining model scoring

    10x data reductionis common

    Completely application transparent

    Even if cell or disk fails during a query

    11.2

    11.2

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    30/72

    Copyright 2009, Oracle Corporation and/or its affiliates 30

    Traditional Scan Processing Smart Scan Example:

    Telco wants to identifycustomers that spend

    more than $200 on asingle phone call

    The information aboutthese premium customersoccupies 2MB in a 1terabyte table

    With traditional storage, alldatabase intelligence residesin the database hosts

    Very large percentage of datareturned from storage isdiscarded by database

    servers Discarded data consumesvaluable resources, andimpacts the performance ofother workloads

    I/Os Executed:

    1 terabyte of data

    returned to hosts

    DB Host reduces

    terabyte of data to 1000

    customer names that

    are returned to client

    Rows Returned

    SELECT

    customer_name

    FROM calls

    WHERE amount >

    200;

    Table

    Extents

    Identified

    I/Os Issued

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    31/72

    Copyright 2009, Oracle Corporation and/or its affiliates 31

    Exadata Smart Scan Processing

    Only the relevant columns

    customer_nameand required rows

    where amount>200

    are are returned to hosts

    CPU consumed by predicate

    evaluation is offloaded toExadata

    Moving scan processing off thedatabase host frees host CPUcycles and eliminates massive

    amounts of unproductivemessaging Returns the needle, not the

    entire hay stack

    2MB of data

    returned to server

    Rows Returned

    Smart Scan

    Constructed And

    Sent To Cells

    Smart Scan

    identifies rows and

    columns within

    terabyte table that

    match request

    Consolidated

    Result Set

    Built From All

    Cells

    SELECT

    customer_nameFROM calls

    WHERE amount >

    200;

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    32/72

    Copyright 2009, Oracle Corporation and/or its affiliates 32

    Smart Scan Transparency

    Smart scans are transparent to the application No application or SQL changes required

    Returned data is fully consistent and transactional

    If a cell dies during a smart scan, the uncompleted portionsof the smart scan are transparently routed to other cellscontaining a replica of the data

    Smart Scans correctly handle complex cases including Uncommitted data and locked rows

    Chained rows

    Compressed tables

    National Language Processing

    Date arithmetic Regular expression searches

    Partitioned tables

    High Throughput, Reduced Overhead, No Complex Tuning

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    33/72

    Copyright 2009, Oracle Corporation and/or its affiliates 33

    Exadata Smart Scans:

    Offloaded data mining scoring

    Data mining scoring executed in Exadata:

    All data mining scoring functions offloaded to Exadata

    Up to 10x performance gains

    Reduced CPU utilization on Database Server

    select cust_idfrom customerswhere region = USand prediction_probability(churnmod, Y using *) > 0.8;

    Scoring functionexecuted in

    Exadata

    11.2

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    34/72

    Copyright 2009, Oracle Corporation and/or its affiliates 34

    Exadata Storage IndexTransparent I/O Elimination with No Overhead

    Exadata Storage Indexes maintain summaryinformation about table data in memory

    Store MIN and MAX values of columns

    Typically one index entry for every MB of disk

    Eliminates disk I/Os if MIN and MAX can nevermatch where clause of a query

    Completely automatic and transparent

    A B C D

    1

    35

    5

    8

    3

    Min B = 1

    Max B =5

    Table Index

    Min B = 3

    Max B =8

    Select * from Table where B

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    35/72

    Copyright 2009, Oracle Corporation and/or its affiliates 35

    Data Growth Challenges

    IT must support exponentiallygrowing amounts of data

    Without hurting performance

    Without growing cost

    Powerful and efficientcompression is key

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    36/72

    Copyright 2009, Oracle Corporation and/or its affiliates 36

    50XUp To

    Exadata Hybrid Columnar Compression

    Data is stored by columnand then compressed

    Query Modefor datawarehousing

    Optimized for speed

    10X compression ratio is typical

    Scans improve proportionally

    Archival Modefor

    infrequently accessed data Optimized to reduce space 15X compression is typical

    Up to 50X for some data

    11.2

    E d t H b id C l C i

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    37/72

    Copyright 2009, Oracle Corporation and/or its affiliates 37

    Exadata Hybrid Columnar Compression

    How it works

    Tables are organized into sets of a few thousandrows called Compression Units (CUs)

    Within Compression Unit, data is Organized byColumn and then compressed

    Column organization brings similar values closetogether, enhancing compression

    Useful for data that is bulk loaded and queried

    Update activity is light

    Reduces

    Table Size

    4x to 40x4x to 50x

    Reduction

    Compression

    Unit

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    38/72

    Copyright 2009, Oracle Corporation and/or its affiliates 38

    Exadata Hybrid Columnar CompressionWarehousing and Archiving

    Warehouse Compression

    10x average storage savings 10x Scan I/O reduction

    Archive Compression

    15x average storage savings

    Up to 50x on some data Some access overhead

    For cold or historical data

    Optimized for Speed Optimized for Space

    Smaller WarehouseFaster Performance Reclaim 93% of DisksKeep Data Online

    Can mix compression types by partition for ILM

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    39/72

    Copyright 2009, Oracle Corporation and/or its affiliates 39

    10 10 10 1116

    19 19 19 20 21

    29

    43

    05

    10

    15

    20

    25

    30

    35

    40

    45

    50

    SizeRed

    uctionFactorbyTable

    OLTP Compression (avg=3.3)

    Query Compression (avg=14.6)

    Archive Compression (avg=22.6)

    Real-World Compression RatiosOracle Production E-Business Suite Tables

    Columnar compression ratios

    Query = 14.6X

    Archive = 22.6X

    Vary by application and table

    52

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    40/72

    Copyright 2009, Oracle Corporation and/or its affiliates 40

    Exadata Smart Flash CacheBreaks the Disk Random I/O Bottleneck

    Trade-off between traditional disks drives and

    Flash Disk drives are cheap, high capacity but low I/Os per

    second (300 IOPS per disk)

    Flash is expensive, lower capacity but can supporttens of thousands of I/Os per second

    Ideal Solution - Exadata Smart Flash Cache Keep most data on disk for low cost

    Transparently move hot data to flash

    Use flash cards instead of flash disksto avoid diskcontroller limitations

    Flash cards in Exadata storage High bandwidth, low latency interconnect

    4 x 96GB PCI Express Flash Cards per ExadataServer

    11.2

    300 I/O per Sec

    Tens of Thousands ofI/Os per Second

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    41/72

    Copyright 2009, Oracle Corporation and/or its affiliates 41

    Exadata Smart Flash Caching Algorithm

    Caches data intelligently to maximize Flash memoryusage for frequently read data

    Automatically skips caching of infrequently read objects Backups not cached

    Secondary copy of mirrored user data not cached

    I/Os due to ASM rebalance operations not cached.

    User can further optimize caching policies by specifyingwhether or not to cache specific database objects.

    11.2

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    42/72

    Copyright 2009, Oracle Corporation and/or its affiliates 42

    Benefits of Exadata Smart Flash Cache

    Integrated solution provides performance of Flash at the price oftraditional disks

    Exadata Flash Cache is shared across all the database nodes of acluster unlike flash cards inserted in a database server

    Exadata Flash Cache does not duplicate data cached in otherExadata Storage Servers

    Exadata Flash Cache benefits from Exadatas scale-out architecture.More capacity and bandwidth as you add more Exadata StorageServers

    Can run Smart Scans against contents in the Exadata Flash Cache

    Can simultaneously issue I/O to the Flash cards and the physicaldisks for even higher performance

    11.2

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    43/72

    Copyright 2009, Oracle Corporation and/or its affiliates 43

    Exadata Logical Flash Disks

    Configure a portion or all of the Flash memory to act as

    persistent Logical Flash Disks Treat them just like regular disks

    Create ASM diskgroups across these Flash disks like any otherASM diskgroup

    Data is automatically mirrored by ASM across these Flash diskswith the mirrored copy on other Exadata Storage Servers

    High Performance for write-intensive workloads

    Logical Flash

    Disks

    11.2

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    44/72

    Copyright 2009, Oracle Corporation and/or its affiliates 44

    Exadata I/O Resource ManagementMixed Workload Environments

    With traditional storage,creating and

    managing shared storage ishampered by the inability to balancethe work between users on the samedatabase or on multiple databasessharing the storage subsystem

    Hardware isolation is the

    approach to ensure separation Exadata I/O resource managementensures different users and taskswithin a database are allocated thecorrect relative amount of I/Oresources

    For example: Interactive: 50% of I/O resources

    Reporting: 30% of I/O resources

    ETL: 20% of I/O resources

    DatabaseServer

    Exadata Cell

    InfiniBand Switch/Network

    Exadata Cell Exadata Cell

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    45/72

    Copyright 2009, Oracle Corporation and/or its affiliates 45

    Exadata I/O Resource ManagementMulti-Database Environment

    Ensure different databases areallocated the correct relative amount ofI/O bandwidth

    Database A: 33% I/O resources

    Database B: 67% I/O resources

    Ensure different users and tasks within

    a database are allocated the correctrelative amount of I/O bandwidth

    Database A:

    Reporting: 60% of I/O resources

    ETL: 40% of I/O resources

    Database B: Interactive: 30% of I/O resources

    Batch: 70% of I/O resources

    Exadata Cell

    InfiniBand Switch/Network

    Database A Database B

    Exadata Cell Exadata Cell

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    46/72

    Copyright 2009, Oracle Corporation and/or its affiliates 46

    Exadata Scale-Out Storage Grid

    Dynamic virtualized storage

    resources using Automatic StorageManagement (ASM)

    Simple and non-intrusive resourceallocation, and reallocation, enablingtrue enterprise grid storage

    Database work spread acrossstorage resources for optimalperformance

    Powerful storage allocation optionsand management

    Flexible configuration forperformance and availability

    Exadata Cell

    InfiniBand Switch/Network

    Single-Instance

    Database

    RAC

    Database

    Exadata Cell Exadata Cell

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    47/72

    Copyright 2009, Oracle Corporation and/or its affiliates 47

    Exadata Storage Layout

    Cell

    Disk

    Sys Area Sys Area

    Grid Disk n

    Grid Disk 1

    ASM disk

    ASM disk

    Physical disks map to Cell Disks

    Cell Disks partitioned into one or multiple Grid Disks Grid Disks created in order of hottest first to coldest portion of the

    disk last

    ASM diskgroups created from Grid Disks

    Transparent above the ASM layer

    Physical

    Disk

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    48/72

    Copyright 2009, Oracle Corporation and/or its affiliates 48

    Exadata Storage Layout ExampleASM Mirroring and Failure Groups

    Example shows cell disks divided into two grid disks hot and cold

    Two ASM disk groups created across the two sets of grid disks ASM striping evenly distributes I/O across the disk groups

    ASM mirroring is used to protect against disk failures

    ASM failure groups are used to protect against cell failures

    Exadata Cell Exadata Cell

    Hot Hot Hot

    Cold Cold Cold

    ASM

    Disk Group

    ASM

    Failure Group

    Hot Hot Hot

    Cold Cold Cold

    ASM

    Failure Grou

    I l d G id Di k

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    49/72

    Copyright 2009, Oracle Corporation and/or its affiliates 49

    Interleaved Grid Disks

    Grid disks are optionally split andinterleaved to place frequently accesseddata in all grid disks on higher performingouter tracks

    All applications benefit from higherperformance outer tracks of disks

    Grid Disk 2

    Hot Data, Cold Data

    Grid Disk 1

    Hot Data, Cold Data

    11.2

    E d t St M t & Ad i i t ti

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    50/72

    Copyright 2009, Oracle Corporation and/or its affiliates 50

    Exadata Storage Management & Administration

    Enterprise Manager Manage & administer Database and ASM

    Exadata Storage Plug-in Enterprise Manager Grid Control Plug-in to monitor & manage

    Exadata Storage Cells

    Comprehensive CLI Local Exadata Storage cell management

    Distributed shell utility to execute CLI across multiple cells

    Sun Embedded Integrated Lights Out Manager (ILOM)

    Remote management and administration of hardware

    E d t St Pl i

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    51/72

    Copyright 2009, Oracle Corporation and/or its affiliates 51

    Exadata Storage Plug-in

    Enterprise Manager Grid Control Plug-in to monitor &

    manage Exadata Storage Cells Works with Enterprise Manager Grid Control 10.2.0.3and later versions

    D t P t ti S l ti

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    52/72

    Copyright 2009, Oracle Corporation and/or its affiliates 52

    Data Protection Solutions

    All single points of failure eliminated by the Exadata Storage architecture

    Hardware Assisted Resilient Data (HARD) built in to Exadata Storage Prevent data corruption before it happens

    Data Guard provides disaster protection and data corruption protection

    Automatically maintains one or more copies of the database

    Flashback provides human error protection

    Snapshot-like capabilities to rewind database to before error

    Recovery Manager (RMAN) provides backup to disk

    Archiving and corruption protection

    Can be used with Oracle Secure Backup (OSB) or third party tape backupsoftware

    These work just as they do for traditional non-Exadata storage

    Users and database administrator use familiar tools

    E d t C E i t d Mi ti

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    53/72

    Copyright 2009, Oracle Corporation and/or its affiliates 53

    Exadata Co-Existence and Migration

    Databases can be concurrently

    deployed on Exadata andtraditional storage Tablespaces can exist on Exadata

    storage, traditional storage, or acombination of the two, and is

    transparent to database applications SQL offload processing requires allpieces of a tablespace reside onExadata

    Online migration if currently using

    ASM and ASM redundancy Migration can be done usingRMAN or Data Guard

    Non-Exadata

    Database

    Server

    Online Migration

    Exadata

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    54/72

    Copyright 2009, Oracle Corporation and/or its affiliates 54

    Best Data Warehouse Machine

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    55/72

    E d t St F t

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    56/72

    Copyright 2009, Oracle Corporation and/or its affiliates 56

    Exadata Storage Features

    Exadata Smart Scans 10X or greater reduction in data sent to

    database servers

    Exadata Storage Indexes Eliminate unnecessary I/Os to disk

    Hybrid Columnar Compression Efficient compression increases user data scan

    rates

    Flash doubles scan rates Combined with Hybrid Columnar Compression,

    scan rate is 20X more

    I M P ll l E ti

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    57/72

    Copyright 2009, Oracle Corporation and/or its affiliates 57

    In-Memory Parallel Execution

    A single database machine has over400GB of memory usable for caching

    Database release 11.2 introduces parallelquery processing on memory cached data

    Harnesses memory capacity of entire database clusterfor queries

    Foundation for world record 1TB TPC-H

    Exadata Hybrid Columnar Compressionenables multi-terabyte tables or partitionsto be cached in memory

    315,842

    1,018,321

    1,166,976

    ParAccel Exasol Oracle & HP

    Exadata

    QphH: 1 TB TPC-H

    Faster than specialized in-memorywarehouse databases

    Memory has 100x more bandwidth than Disk

    Source: Transaction Processing Council, as of 9/14/2009:

    Oracle on HP Bladesystem c-Class 128P RAC, 1,166,976 QphH@1000GB, $5.42/QphH@1000GB, available 12/1/09.Exasol on PRIMERGY RX300 S4, 1,018,321 QphH@1000GB, $1.18/QphH@1000GB, available 08/01/08.

    ParAccel on SunFire X4100315 842 hH 1000GB $4.57 / hH 1000GB available 10/29/07.

    11.2

    B fit M lti l

    http://www.tpc.org/tpch/results/tpch_result_detail.asp?id=107102903http://www.tpc.org/tpch/results/tpch_result_detail.asp?id=107102903
  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    58/72

    Copyright 2009, Oracle Corporation and/or its affiliates 58

    Benefits Multiply

    1 TBwith compression

    10 TB of user dataRequires 10 TB of IO

    100 GBwith partition pruning

    20 GBwith Storage Indexes

    5 GBwith Smart Scans

    SubsecondOn Database

    Machine

    Data is 10x Smaller, Scans are 2000x faster

    DBFS Scalable Shared File S stem

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    59/72

    Copyright 2009, Oracle Corporation and/or its affiliates 59

    DBFS - Scalable Shared File System

    Database Machine comes with DBFS shared Linux file system Shared storage for ETL staging, scripts, reports and other application files

    Files stored as SecureFile LOBs in database tables stored inExadata

    Protected like any DB datamirroring, DataGuard, Flashback, etc.

    5 to 7 GB/sec file system I/O throughput

    ETL Files in DBFS

    Load into databaseusing External Tables

    ETL

    More File Throughput than High-End NAS Filer

    11.2

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    60/72

    Copyright 2009, Oracle Corporation and/or its affiliates 60

    Best OLTP Machine

    Best OLTP Machine

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    61/72

    Copyright 2009, Oracle Corporation and/or its affiliates 61

    Best OLTP Machine

    Only Oracle runs real-world businessapplications on the Grid

    Unique fault-tolerant scale-out OLTPdatabase

    RAC, Data Guard, Online Operations

    Unique fault-tolerant scale-out storagesuitable for OLTP

    ASM, Exadata

    Dramatic New OLTP Capabilities

    Exadata Flash 11 2

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    62/72

    Copyright 2009, Oracle Corporation and/or its affiliates 62

    Exadata FlashSolves the Random I/O Bottleneck

    Oracle is the First FlashOptimized Database

    11.2

    Sun Oracle Database Machine has

    5+ TBof flash storageExadata Smart Cache caches hotdata

    Database Machine achieves:

    20x more random I/Os

    Over 1 million per second

    2x faster sequential query I/O

    50 GB/sec

    10x better I/O responsetime

    Sub-millisecondGreatly Reduced Cost

    10x fewer disks for IOPS

    Lower Power

    Complete Open Integrated Availability

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    63/72

    Copyright 2009, Oracle Corporation and/or its affiliates 63

    WAN

    Complete, Open, Integrated AvailabilityMaximum Availability Architecture

    Protection from Server Failures Storage Failures

    Network Failures

    Site Failures

    Real-time remote standby open for queries

    Human error correction Database, table, row, transaction level

    Online indexing and table redefinition

    Online patching and upgrades

    Real

    ApplicationClusters

    ASM

    Fast

    Recovery Area

    Active

    Data Guard

    SecureBackup

    Complete Open Integrated Security

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    64/72

    Copyright 2009, Oracle Corporation and/or its affiliates 64

    Complete, Open, Integrated Security

    DataMasking

    AdvancedSecurity

    SecureBackup

    Encryption and Masking

    DatabaseVault

    LabelSecurity

    Access Control

    ConfigurationManagement

    AuditVault TotalRecall

    Monitoring

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    65/72

    Copyright 2009, Oracle Corporation and/or its affiliates 65

    Best Consolidation Machine

    Consolidation

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    66/72

    Copyright 2009, Oracle Corporation and/or its affiliates 66

    Consolidation

    Biggest driver of ongoingcost is

    Multitudes of special-purpose systems

    Consolidate onto DatabaseMachine

    High performance for all applications

    Low cost platform for all applications Predictable response times in a shared

    environment

    Handles all data management needs

    Complete, Open, Integrated

    ERP

    CRM

    Warehouse

    Data Mart

    HR

    CRMERP

    Warehouse Data Mart

    HR

    Best Consolidation Machine

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    67/72

    Copyright 2009, Oracle Corporation and/or its affiliates 67

    Best Consolidation Machine

    Consolidation mixes many different

    workloads in one system Warehouse oriented bulk data processing

    OLTP oriented random updates

    Multimedia oriented streaming files

    The Sun Oracle Database Machinehandles any combination of workloadswith extreme performance And predictable response times

    Dramatic new consolidationcapabilities

    ERP

    CRM

    Warehouse

    Data Mart

    HR

    Consolidate Storage

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    68/72

    Copyright 2009, Oracle Corporation and/or its affiliates 68

    Consolidate Storage

    Exadata and ASM allow all storage servers to be

    shared across databases

    Shared Configuration Advanced data striping spreads every database across

    all storage servers

    Eliminates hot-spots and captive unused space

    Full storage grid performance available to all databases

    Database or cluster level storage security

    Predictable Performance

    Exadata I/O resource managerprioritizes I/Os to

    ensure predictable performance At user, job, application, or database level

    No need for isolated storage islands

    ERP

    CRM

    Warehouse

    Data Mart

    HR

    Consolidate Servers

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    69/72

    Copyright 2009, Oracle Corporation and/or its affiliates 69

    Consolidate Servers

    Many databases can run on Database

    Machine servers Shared Configuration

    Applications connect to a database servicethatruns on one or more database nodes

    Services can grow, shrink, & move

    dynamically Large databases can span nodesusing RAC

    Multiple small databases can run on a single node

    Predictable performance

    Instance cagingprovides predictable CPUresources when multiple databases run on thesame node

    Restricts a database to subset of processors

    ERP CRM

    Warehouse

    Data

    Mart

    HR

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    70/72

    Copyright 2009, Oracle Corporation and/or its affiliates 70

    The Architecture of the Future

    Massively Parallel Grid

    Best for Data WarehousingBest for OLTP

    Best for Consolidation

    Resources

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    71/72

    Copyright 2009, Oracle Corporation and/or its affiliates 71

    Resources

    Oracle.com:http://www.oracle.com/exadata

    Oracle Exadata Technology Portal on OTN:http://www.oracle.com/technology/products/bi/db/exadata

    Oracle Exadata white papers:http://www.oracle.com/technology/products/bi/db/exadata/pdf/exadata-technical-whitepaper.pdf

    http://www.oracle.com/technology/products/bi/db/exadata/pdf/migration-to-exadata-whitepaper.pdf

  • 8/12/2019 01 Sun Oracle Exadata V2 Technical Overview

    72/72