02 THI0430 HardwareOverview 2-0

Embed Size (px)

DESCRIPTION

Hitachi

Citation preview

  • 6/2/2008

    1

    2008 Hitachi Data Systems

    Hitachi Data Systems Enterprise Storage Boot CampHitachi Universal Storage Platform, Hitachi Universal Storage Platform V, Hitachi Universal Storage Platform VM, and Hitachi Network Storage Controller Hardware and Architecture

  • 6/2/2008

    2

    2

    Module Objectives

    Upon completion of this module, the learner should be able to: Describe the Network Storage Controller hardware architectural concepts and

    fundamentals Describe the Universal Storage Platform VM hardware architectural

    concepts and fundamentals Describe the Universal Storage Platform hardware architectural concepts and

    fundamentals Describe the Universal Storage Platform V hardware architectural concepts

    and fundamentals

  • 6/2/2008

    3

    6/2/2008

    3

    3

    Func

    tiona

    lity

    Dem

    ande

    d

    WMS100AMS200

    AMS500 AMS1000

    Hitachi Storage Families

    All product families are managed from one integrated software suite

    All models are designed for tiered storageAdvanced Midrange

    Storage Systems

    Intelligent Virtual Storage Controllers

    Network Storage Controller

    Model NSC55

    Size of Organization Served

    Small Business or Department

    Large BusinessMid-size Business or Department

    Universal Storage Platform V

    Universal Storage Platform Universal

    Storage Platform VM

    In the diagram above, and on subsequent pages,

    WMS100 = Hitachi Workgroup Modular Storage system Model WMS100

    AMS200 = Hitachi Adaptable Modular Storage system Model AMS200

    AMS500 = Hitachi Adaptable Modular Storage system Model AMS500

    AMS1000 = Hitachi Adaptable Modular Storage system Model AMS1000

  • 6/2/2008

    4

    4

    Alternate System Names

    Unofficial product names occasionally appear in documentation.

    StorEdge 9970, 9980

    StorageTek 9985V

    StorageTek 9985

    StorageTek 9990

    StorageTek 9990V

    Sun

    R450

    R600-RK

    R500-RK

    R500

    R600

    Hitachi RSD

    Universal Storage Platform VM

    Universal Storage Platform V

    Lightning 9900 V Series

    Network Storage Controller

    Universal Storage Platform

    Hitachi Data Systems

    RSD is a unit of Hitachi Ltd., RSD stands for Raid Storage Division.RAID500-RK (rack) instead of RAID500-FC (flexible cabinet)

    Lightning 9900 V Series stands for Hitachi Lightning 9900 V Series enterprise storage system

  • 6/2/2008

    5

    5

    Key Components Logical Layout

    Hi-Star Crossbar Switch Architecture

    CHANNEL ADAPTER - CHA

    DISK ADAPTER - DKA

    CACHE SWITCH - CSW

    CACHE SHAREDMEMORY

    Host Host

    PARITY GROUPS

    Ent

    erpr

    ise

    Sto

    rage

  • 6/2/2008

    6

    6

    Architecture Key Components

    Channel Adapter (CHA) Disk Adapter (DKA) Shared Memory Cache Memory Cache Switch Service Processor (SVP)

    Channel Adapter CHA or Front End Director-FED - Provides ports that control data transfer between the host and the cache memory.

    Disk Adapter DKA or Back End Director-BED. Provides ports that control data transfer between the disk drive and cache memory.

    Shared Memory (SM) - This is the memory that stores configuration data, plus information and status for controlling cache memory, disk drives and the logical devices.

    Cache Memory (CM) - This is the memory that stores user data in order to perform I/O processing asynchronously with the reading and writing to a disk drive.

    Cache Switch (CSW) - Provides multiple switched data paths between the CHA/DKA and Cache memory

    Service Processor (SVP) - Exclusive PC for performing all hardware and software maintenance functions on the

    Network Storage Controller.

  • 6/2/2008

    7

    7

    Key Components Physical Layout

    Hi-Star Architecture

    CHANNEL ADAPTER - CHA

    DISK ADAPTER - DKA

    CACHE SWITCH - CSW

    CACHE SHAREDMEMORY

    Host Host

    PARITY GROUPS

    Uni

    vers

    al S

    tora

    ge P

    latfo

    rm

  • 6/2/2008

    8

    8

    Key Components Physical Layout

    Hi-Star Architecture

    CHANNEL ADAPTER - CHA

    DISK ADAPTER - DKA

    CACHE SWITCH - CSW

    CACHE SHAREDMEMORY

    Host Host

    PARITY GROUPS

    Net

    wor

    k S

    tora

    ge C

    ontro

    ller

    Mix Adapter

    Base Adapter

  • 6/2/2008

    9

    9

    Architecture Storage

    Storage Overview

    00:0000:0100:02

    1. Physical Devices - PDEV

    3. Virtual Device(s) - VDEV

    5. Logical Devices - LDEV

    2. PDEV grouped together with RAID type.RAID 1+, RAID 5, RAID 6

    4. EMULATION specifies smaller logical unit sizes

    6. Assign addresses in CU:LDEV format

    Parity Groups are created from the physical disks.

    A RAID Level and emulation is applied to the group.

    The emulation creates equal sized stripes called LDEVs (Logical Devices).

    LDEVs are mapped into a Control Unit matrix (CU#:LDEV#).

  • 6/2/2008

    10

    10

    Network Storage Controller

    Network Storage Controller

    For entry-enterprise storage customers or the high-end of modular storage customers with either open or mainframe servers who seek to exploit the reliability, availability and unique software capabilities of the Universal Storage Platform at a lower capacity and price point with a smaller form factor.For disaster recovery programs where it can be deployed as a more cost-effective data mover between primary and secondary sites (will support both Hitachi TrueCopy Heterogeneous Remote Replication Software and Universal Replicator)For customers seeking to aggregate or consolidate and simplify the management of a heterogeneous storage poolFor customers who wish to deploy a storage solution across multiple differentiated tiers of heterogeneous storage with common management, replication, and data movement software

  • 6/2/2008

    11

    11

    Cabinet Layout

    15U

    1U

    12U

    12U

    SVP

    Logic/Power Supply Box

    Initial disk chassis is required

    Optional disk chassisDKC-F515-B2R

    Primary Rack

    12U

    12U

    Two more optional B2R disk chassis

    Secondary Rack

    Hardware Structure Primary/secondary racks

    are identical components

    The Global Rack provides 42U of useable space. Any portion not covered by a bezel will be covered by a flat filler plate. Additional bezels may be ordered as a line item.Note: If a Hitachi Thunder 9500 V Series modular storage system is mounted in place of the optional disk chassis, its standard bezel will be installed instead of the flat filler panel.The primary rack is composed of the DKC Box, SVP and up to two disk chassis, which can hold a total of 120 disk drives. The DKC can control a maximum of 240 HDDs when connected with four disk chassis. Disk ControllerThe DKC consists of the DKC Box in which the MIX-PCB (channel adapters & disk adapters), BASE-PCB (cache memories, shared memories, and CSW) are installed, and power supplies and battery boxes that supply power to the components above. Most of the main components have been designed with a duplex or redundant configuration, to achieve non-stop operation against failures at a single point. In addition, components can be replaced and added, and the microcode can be upgraded while the subsystem is in operation. The control unit is equipped with an SVP, which is used to service the subsystem, monitor its running condition, and analyze faults. Connecting the SVP with a service center enables remote maintenance of the subsystem.

    The secondary rack is composed of two disk chassis, which can hold 60 disk drives.The disk chassis consists of the four HDU boxes in each, of which 15 disk drives can be installed, cooling fans, and power supplies that supply power to the components above. It can have up to 60 disk drives installed.This disk unit is configured from duplex power supply system and cooling fans with redundancy introduced. In addition, the disk drives achieve non-stop operation against failure of one piece of components by employing the RAID1, RAID5, or RAID6 levels. Components can be replaced and added while the subsystem is in operation.

  • 6/2/2008

    12

    12

    Disk Chassis

    Disk Chassis Overview Includes a total of 60 slots for HDDs Four HDDs (data) plus one HDD (spare) must be included in initial

    configuration

    12U

    12U

    Initial disk chassis is required

    DKC-F515-B2R

    Optional disk chassisDKC-F515-B2R

    The Disk chassis is comprised of two assemblies

    Each assembly consists of two rows of 15 slots for HDDs

    The disk chassis does not include any HDDs. The HDDs must be ordered as a separate line item

    Parity groups of four HDDs are installed vertically in one disk chassis for RAID 1 or RAID5 (one disk in each of the four rows)

    Parity groups of eight HDDs are installed vertically in two adjacent columns for RAID6 (two disks in each of the four rows)

    Disk ChassisThe disk chassis consists of two physical HDD boxes which contains two HDU Boxes in each, of which 15 disk drives can be installed, cooling fans, and power supplies that supply power to the components above. It can have up to 60 disk drives installed.This disk unit is configured from a duplex power supply system and cooling fans with redundancy introduced. In addition, the disk drives achieve non-stop operation against failure of one piece of components by employing the RAID1, RAID5 or RAID6 level. Components can be replaced and added while the subsystem is in operation.

  • 6/2/2008

    13

    13

    Hardware Specifications

    Hardware SpecificationsConnectivity Fibre CHA, FICON, ESCON, NAS, ISCSI

    Min/Max ports16/48 Fibre Channel, 16 FICON,

    16 ESCON, 8 NAS, 8 ISCSIMinimum HDD 4 Data + 1 SpareMaximum HDD 240 HDDDrive Types 73GB, 146GB, 300GB

    Maximum External Capacity 16PBMinimum Cache 4GBMaximum Cache 64GB

    Min/Max Control Memory 1GB/6GBMax No. LUNs 16384

    Max Virtual Host Ports 1024 per physical portMax Private Virtual Storage Machines 8

    Max Internal Capacity 72TB

  • 6/2/2008

    14

    14

    RAID Levels Supported

    RAID1 (2D+2D), RAID5 (3D+1P), RAID5 (7D+1P) and RAID6 (6D+2P)

    RAID1 (4D+4D) (two concatenation RAID1 (2D+2D) RAID / Emulation types supported by the 300GB HDD

    (code 50-05-xx): RAID1 (2D+2D), RAID5 (7D+1P, 3D+1P), and RAID6 (6D+2P) Open Systems: OPEN-V, OPEN 3, 8, 9, E and L Mainframe: 3380-3, 3390-9, -L, and -2L are supported

  • 6/2/2008

    15

    15

    Architecture

    MIX (DKA/CHA)

    MIX (DKA/CHA)

    CSW CSW

    CACHE CACHE

    SM SM

    Channel Interface

    FCAL(2Gbps/port)

    Cache Path(8.5GB/s)

    SM Path (3.6GB/s)

    Max. 60HDD

    DKU

    Battery Box Battery

    Box

    DKC Power Supply

    Max. 240 HDD/subsystem

    Disk Path (max.8path)

    AC-DC Power Supply

    Input Power AC-DC

    Power Supply

    AC-DC Power Supply

    Power Supply

    PDB-Box PDB-Box

    Input Power

    PDB-Box PDB-Box AC-DC Power Supply

    CHA CHA

    The Network Storage Controller is divided into the Power Supply section, DKC section, and DKU section.The Power Supply section consists of AC-DC power supplies and battery boxes (only for DKC).The DKC section consists of channel adapters (CHAs), disk adapters (DKAs), cache memories (CACHEs), shared memories (SMs).The DKU section consists of FSWs and HDDs.

  • 6/2/2008

    16

    16

    Architecture

    M IX (C H A & D K A )(B as ic )

    C H A(A dd .1 )

    C lus te r1 C lus te r2

    2pa th

    2pa th

    C ache D IM M

    M IX (C H A & D K A ) (B as ic )

    C H A (A dd .1 )

    C S W (B A S E P C B ) C S W (B A C E P C B )

    C ache (B A S E P C B )

    C ache M em ory (m ax16G B )

    C ache (B A S E P C B )

    C ache M em ory (m ax16G B )

    M ax.8 .5G B /s

    Cluster1 Cluster2

    2Path

    SM DIMM

    CHA(Add.1)

    MIX(CHA&DKA)(Basic)

    SM(BASE)

    CHA(Add.1)

    MIX(CHA&DKA)(Basic)

    SM(BASE)

    Universal Star Network The data path bandwidth maximum

    is 8.5GB/s (C-HSN) The control path bandwidth

    maximum is 3.6GB/s (S-HSN)

  • 6/2/2008

    17

    17

    Disk Controller Unit (DKC)

    The Logic Box has six slot locations

    Rear Side

    Power supply sphere boundary

    Cluster 2

    CHA&DKA

    CHA1

    BASE

    SMDIMM

    A

    Logic PL

    PCB Location

    BASE(Basic)

    MIX (Basic)

    CHA (Add.1)

    B C D E F

    CMDIMM

    BASE

    SMDIMM

    CMDIMM

    CHA1

    CHA&DKA

    BASE(Basic)

    MIX (Basic)

    CHA (Add.1)

    Cluster 1

    The Network Storage Controller has a structure in which the Base, Mix, and CHA PCBs are arranged on the rear side of the storage system. The domain power supply is divided into left and right halves forming the center of the L/G PL boundary. The left half (front view) is the cluster 1 and the right half, the cluster 2.Numbers of PCBs that can be installed are as follows: MIX PCB: 2 Standard CHA PCB: 2 Optional BASE PCB: 2 StandardThe shared memory modules and cache memory modules are mounted on the BASE PCB. The Base PCB also houses the CSW hardware.

  • 6/2/2008

    18

    18

    Universal Storage Platform VM

    Universal Storage Platform VM

    Universal Storage Platform VM is targeted at the small enterprise. It sits between the Network Storage Controller Model NSC55 and the Universal Storage Platform V. It can be replicated to and from a Network Storage Controller Model NSC55 and can be replicated to a Universal Storage Platform V.

    All of the Hitachi Data Systems Adaptable Modular Storage and Workgroup Modular Storage systems in additional to the legacy product lines, can be virtualized behind the Universal Storage Platform VM for maximum ROI and reduced storage management.

  • 6/2/2008

    19

    19

    Overview

    Smaller businesses can exploit enterprise-class software and intelligent storage controller architecture with their existing modular storage

    Virtualization Services that simplifies: Non-disruptive Data Migration Data Replication

    Local Long Distance

    Thin Provisioning of internal and virtualized external storage that:

    Reduces storage management Reduces capital expenditures and

    monthly electrical and cooling costs

    Dual-Rack Configuration

    PrimaryRack

    Single-RackConfiguration

    PrimaryRack

    PrimaryRack

    On September 10, 2007 Hitachi introduced the Hitachi Universal Storage Platform VM

    The only intelligent virtual storage controller with the option to add internal disk storage. This enables the Universal Storage Platform VM to deliver Tier 1 storage with 100% data availability along with storage virtualization services.

    Converts into a complete platform for delivery of storage services for mainframes and open systems. This reduces the requirement for separate storage arrays for each open systems and mainframes and simplifies management.

    Smaller businesses can exploit Hitachi enterprise-class software and Intelligent Storage Controller architecture with their existing modular storage

    Reduces complexity with common data management and data mobility software across a heterogeneous storage pool

    Non-disruptive data migration between heterogeneous storage systems

    Hitachi Volume Migration software or Hitachi Tiered Storage Manager software

    Services Oriented Storage Platform with advanced virtualization offers capabilities for block, file and object-based data.

    Virtualization Services that simplify:

    Non-disruptive Data Migration

    Data Replication

    Local

    Long Distance

    Thin Provisioning of internal and virtualized external storage that:

    Reduces storage management

    Reduces capital expenditures and monthly electrical and cooling costs

  • 6/2/2008

    20

    20

    Unique Embedded Virtualization Layer Simplifies Tiered Storage Management

    Simplifying operations with as much as 96PBs of storage managed as one common pool

    Increase Efficiency

    Simplified infrastructure and management

    Maximize current and past investments

    Extend life of existing devices Provide the new functionality of the

    Universal Storage Platform V to existing storage

    Simplify Operations

    Move, migrate, or copy data across heterogeneous tiered storage Lightning 9900 V SeriesThunder 9585V WMS100

    Universal StoragePlatform VM

    EmailDataMiningOrder

    SystemPrint

    ServiceFile

    Service

    High Perf.99.99%

    100%GeneralPurpose

    ArchiveBackup

    IBM Shark-ESS 800

    EMC DMX2000

    Single set of tools for data management and replication

    SAN

    IBM Shark-ESS 800

    ERP

    HITACHI

    Hitachi Universal Storage Platform VM

    This diagram shows EMC DMX, the IBM Shark, and Hitachi storage systems that can be managed.

    Universal Storage Platform VM can virtualize multiple storage systems connected to the back-end Fibre Channel ports.

    Customers can keep existing storage and add value by being able to include Hitachis latest software functionality on them, and latest host connectivity, which far outpaces anyone else in the industry. Instead of managing all those different storage systems, can manage your entire storage pool through Universal Storage Platform VM. This allows the customer to extend the life of their existing devices and centrally manage and monitor all storage among all this complexity.

    Hitachi Thunder 9500 V Series with SATA disks are included in the same environment with Hitachi Lightning 9900 V Series enterprise storage system as high-performance, high-availability disk, and finally the ultra high-performance and availability from the internal disk of the Universal Storage Platform. Customers can provide the right storage to the right application at the right time.

  • 6/2/2008

    21

    21

    Hardware Specifications

    72TB (300GB FC) Maximum Internal Capacity

    8 (Max 8GB per Virtual Storage Machine)Max Private Virtual Storage Machines

    1024 per physical portMax Virtual Host Ports

    16,384Max # of LUNs

    4GB/16GBMin/Max Control Memory

    64GBMaximum Cache

    4GBMinimum Cache

    96PBMaximum External Capacity

    146GB, 300GB FC, 750GB SATA#Drive Types

    8/48 Fibre Channel8/24 FICON, 8/24 ESCON

    NAS (High Performance NAS)Min/Max Ports

    Fibre Channel, FICON, ESCON, NASConnectivity

    Specification/QuantityHardware

    # - GA November 2007

  • 6/2/2008

    22

    22

    Hardware Comparison of Crossbar Switch Architecture Net Control

    Control path bandwidth of Crossbar Switch Architecture Net: 3.6GB/sThe number of paths from CHA/MIX to each SM is 12. Shared memory is installed on BASE PCB

    Control path bandwidth of Crossbar Switch Architecture Net : 4.8GB/sThe number of paths from channel adapter/disk adapter to each SMA is increased from 12 to 16.Shared memory is installed on SMA PCB.

    Network Storage Controller Universal Storage Platform VM

    2Path

    Cluster1 Cluster2

    CHA (Option3)

    CHA (Option1)

    CHA (Option2)

    CHA (Option1)

    CHA (Option2)

    CHA (Option3)

    DKA (Option1)

    DKA (Option1)

    2Path

    4.8GB SMA SMA

    Cluster1 Cluster2

    2Path

    SM DIMM

    CHA(Add.1)

    MIX(CHA&DKA)(Basic)

    SM

    CHA (Add.1)

    MIX(CHA&DKA) (Basic)

    SM

    BASE PK

    On the graphic above, CHA stands for channel adapter

  • 6/2/2008

    23

    23

    Features

    Scalability Universal Storage Platform VM supports a wide range of configurations to

    address the scalability requirements of our customers Front-end directors: 1 to 3 features

    Fibre Channel, FICON, ESCON Cache memory: 4GB - 64GB Internal Disk Drives: Zero to 240

    Configurations with zero internal disks are referred to as Diskless. These configurations use Externally Attached Storage for all data storage.

    Disk drive capacities supported: 73GB, 146GB and 300GB

  • 6/2/2008

    24

    24

    Features

    High-performance All disks supported by Universal Storage Platform VM operate at 15K rpm. The data transfer rate between the back-end director Fibre Channel (FC)

    disk adapter and the disk drive is 4GB/sec. Overall system performance has been improved by installing

    microprocessors on the front-end directors and back-end director disk adapter that operate at twice the speed as those used on the Network Storage Controller.

  • 6/2/2008

    25

    25

    Expanded Configuration

    Disk Chassis(DKU-R3)

    Disk Chassis(DKU-R2)

    Disk Chassis (DKU-R1)

    Disk Chassis (DKU-R0)

    Disk Controller (DKC)

    Operator Panel

    Additional SVP/Battery Chassis

    Primary Rack

    Secondary Rack

    12U

    12U

    2U

    10U

    Components housed within the Secondary Rack:

    OPTIONAL: Disk Chassis Supports up to 60 disks. A maximum of two Disk Chassis may be installed in the Secondary Rack.Note: The secondary rack is only required for those configurations that include three or four Disk Chassis

    Components housed within the Primary Rack: Disk Controller Houses Cache/Shared Memory, up to three front-end directors, one

    back-end director, Hi-Star Net architectural components and a Service Processor (SVP).

    OPTIONAL: Additional SVP/Battery Chassis - Houses optional SVP for customers requiring the highest level of system mgmt availability. Houses an Additional Battery required when Cache Memory capacity exceeds 80B (*Note: Initial release of Chicago will only support a maximum of 64GB of Cache Memory.)

    OPTIONAL: Disk Chassis Supports up to 60 disks. A maximum of two Disk Chassis may be installed in the Primary Rack.

    (1) Disk ControllerThe disk controller consists of the disk controller box, in which the channel adapters, disk adapters, cache memory adapters, shared memory adapters, and CSW are installed, battery boxes and power supplies that supply power to the components above. Most of main components have been implemented with a duplex or redundant configuration, and achieve non-stop operation against a failure of a single point of the components. In addition, components can be replaced and added, and the microcode can be upgraded while the subsystem is in operation. The control unit is equipped with an SVP, which is used to service the subsystem, monitor its running condition, and analyze faults. Connecting the SVP with a service center enables remote maintenance of the subsystem.(2) Disk ChassisThe disk chassis consists of the four HDU boxes in each of which 15 disk drives, cooling fans, and power supplies that supply power to the components above can be installed. It can have up to 60 disk drives installed.This disk unit is configured from duplex power supply system and cooling fans with redundancy introduced. In addition, the disk drives achieve non-stop operation against the failure of one piece of the components by employing the RAID1, RAID5 or RAID6 level. Components can be replaced and added while the subsystem is in operation.

  • 6/2/2008

    26

    26

    Switched Loop Details

    Universal Storage Platform VM introduces a switched back-end, where the drives are still on arbitrated loops, but the switch logic bypasses all targets on that loop except for the one disk being addressed.

    On the previous Hitachi Universal Storage Platform model, all of the disks attached to a back-end director PCB were on eight shared loops. A transfer to the last disk on a loop (could be 32 or 48 disks per loop) would have to pass through bypass logic on all of the disks in front of it. The Universal Storage Platform VM introduces a switched back-end, where the drives are still on arbitrated loops (all Fibre Channel disks use Fibre Channel Arbitrated Loops (FC-AL, not FC-SW fabrics), but the switch logic bypasses all targets on that loop except for the one disk being addressed. This reduces the propagation time by some microseconds (not noticeable), but the primary effect of this change is improved accessibility to individual disks. Each HDU has four such FSW switches, two on the front side (32 disks) and two more on the back (32 disks). Each pair of switches is either an upper or a lower switch as seen in the figure above.

  • 6/2/2008

    27

    27

    Universal Storage Platform

    Universal Storage Platform

  • 6/2/2008

    28

    28

    Functional Descriptions

    Using the Universal Storage Platform: Connect all storage systems into a common storage platform

    Reduce complexity and extend the useful life of storage you already own

    Share that platform across virtual storage machines Address application-specific performance, availability, cost, and

    protection requirements Reduce data management cost by using a single replication engine

    Support all of data protection and lifecycle management needs Enhance server, application, and network performance

    Offload replication, migration, and data protection tasks Manage all of this from a single pane of glass

  • 6/2/2008

    29

    29

    Pricing Models

    Universal Storage Platform 100 - Entry Level Universal Storage Platform 600 - Enhanced Universal Storage Platform 1100 - High Performance

    Disk ControllerFrameDKC

    Array FrameDKU-L1

    Array FrameDKU-R1

    Array FrameDKU-L2

    Array FrameDKU-R2

    Disk ControlFrameDKC

    There are three Universal Storage Platform models, ranging from an entry-level to a high-performance configuration. You may nondisruptively upgrade from the smallest model to the maximum configuration.

  • 6/2/2008

    30

    30

    Product Overview

    Disk Controller Frame - DKC

    Operator Panel

    The Integrated Disk Controller (DKC) frame contains the operator panel, SVP, FEDs, BEDs, cache switch modules, cache memory boards, control memory boards, hard disk drives, power supplies, battery boxes, and cooling fans. The Universal Storage Platform consists of a disk controller (DKC) in which 128 disk drives can be installed and disk array frames (DKUs) in each of which 256 disk drives can be installed. The disk controller is capable of controlling up to 1,152 HDDs when it is connected with four disk adapters.

    Disk Controller The box frame contains channel adapters, disk adapters, cache memories, shared memories, CSWs, the HDU box containing disk drives, and power supplies and battery boxes.

    Most components have a redundant configuration, which achieves nonstop operation against failure of single points.Components can be replaced and added, and the microcode can be upgraded while the storage system is in operation.The control unit is equipped with an SVP (special PC), which is used to service the storage system, monitor its running condition andanalyze faults. Connecting the SVP with a service center enablesremote maintenance of the storage system.

  • 6/2/2008

    31

    31

    Product Overview

    Disk Array Frame - DKU

    The Universal Storage Platform Disk Array Frame (DKU) contains hard disk drives, power supplies, battery boxes, cooling fans, and communication interfaces to the control frame.

    Disk Unit A disk unit consists of four hard drive unit (HDU) boxes each with 64 disk drives, cooling fans, power supplies and battery boxes.It has a redundant power supply system and cooling fans.The disk drives achieve nonstop operation against failure by employing RAID1+0 or RAID5. Components can be replaced and added while the storage system is in operation.

  • 6/2/2008

    32

    32

    Architecture

    DKUFRAME(L2)

    DKUFRAME(L1)

    DKCFRAME

    DKUFRAME(R1)

    DKUFRAME(R2)

    925

    1860

    3382

    650

    750

    AC-Power Supply

    OP Panel

    HDD-BOX

    SW-PSSW-PS

    L/G-BOX

    (750) (650)

    BatteryBattery

    DKC Frame DKU Frame

    HDD-BOX

    DKC510I and DKU505I

    Measurements in millimeters

    The Universal Storage Platform consists of a disk controller in which 128 disk drives can be installed and disk array frames (DKUs) in each of which 256 disk drives can be installed. The DKC is capable of controlling up to 1,152 HDDs when it is connected with four DKUs.Disk Controller The box frame contains channel adapters, disk adapters, cache memories, shared memories, CSWs, the HDU box containing disk drives, and power supplies and battery boxes.

    The control unit is equipped with an SVP (Special PC), which is used to service the subsystem, monitor its running condition, and analyze faults. Connecting the SVP with a service center enables remote maintenance of the subsystem.

    Disk UnitA DKU consists of four hard drive unit (HDU) boxes each with 64 disk drives, cooling fans, and power supplies and battery boxes.It has a redundant power supply system and cooling fans.

  • 6/2/2008

    33

    33

    Universal Storage Platform 100

    Up to 256 disks (up to 74TB) Single back-end director (BED) pair Two cache memory cards, two cache switch cards,

    two shared memory cards Maximum 64GB cache, 17GB/s data bandwidth

    Up to 64 ESCON/32 FICON channels or 128 FC Front-end directors are the only optional features

    Upgradeable to Universal Storage Platform 600 Add second BED, cache switch pair and array frame

    The model Universal Storage Platform 100 is suitable for small to medium enterprises and or specific applications.

  • 6/2/2008

    34

    34

    Universal Storage Platform 600

    Up to 512 disks (96+1 minimum) ~148TB raw capacity

    Dual frame standard, specific cabling Two BED director pairs Four cache switch cards, two cache

    memory cards, two control memory cards Additional cache memory and control

    memory are available as an optional upgrade

    Maximum 64GB cache, 128GB after optional upgrade

    34GB/sec data bandwidth Up to 48 (96 in later release) FICON, 96

    ESCON channels, or 192 FC Upgradeable to model Universal Storage

    Platform 1100

    The Universal Storage Platform 600 performance capabilities are created to match most of the requirements of Fortune 500 customers. It offers full upgrade ability to the Universal Storage Platform 1100 model and excellent scalability in terms of features and functions.

  • 6/2/2008

    35

    35

    Universal Storage Platform 1100

    Up to 1152 disks (128+1 minimum) Aggregate up to 332TB of capacity

    Two or four back-end director pairs Two switch pairs, two cache memory pairs and two control memory pairs

    Max 256 GB cache, 68 GB/sec data bandwidth Up to 48 (96 in later release) FICON, 96 ESCON channels or 192 FC Ultimate consolidation and transaction machine

    The Universal Storage Platform 1100 is the ultimate configuration. It comes with everything standard and the only choices are the number of BEDs and FEDs installed. It is the most high performing configuration of the available of the models.

  • 6/2/2008

    36

    36

    Architecture - Clusters

    DKC Logic Box Slots

    Power supply sphere boundary

    Rear Side - Cluster 2 2X 2W 2V 2U 2T 2CB 2SB/2SD 2CD 2R 2Q 2P 2N 2M

    1L 1K 1J 1H 1G 1CC 1SA/1SC 1CA 1F 1E 1D 1B 1A

    C

    H

    A

    6

    D K A 0

    C

    H

    A

    3

    C

    H

    A

    0

    C

    H

    A

    2

    C

    H

    A

    7

    C

    H

    A

    1

    DKA5

    D K A 3 / C H A

    C

    H

    A

    4

    C

    H

    A

    5

    D K A 6 / C H A

    CACHE1

    CACHE3

    C

    S

    W

    3

    C

    S

    W

    1

    Cache (Add.)

    Cache (Basic)

    C

    S

    W

    0

    C

    S

    W

    2

    D K A 7 / C H A

    DIMM DIMM

    DIMM DIMM D K A 2 / C H A

    D K A 4

    CSW (Add)

    SM3

    SM1

    SM0

    SM2

    Front Side - Cluster 1

    2SB

    2SD

    1SC

    1SA CACHE2

    CA CH E 0

    DKA1

    DKC-F510I-CSW

    Controlled by CSW (Basic)

    Logic PL

    (Basic)

    (Basic)

    (Add)

    (Add)

    Upper

    Upper

    Lower

    Lower

    PCB Location

    PCB Location

    Cache (Basic)

    Cache (Add.)

    CSW (Add.)

    CSW (Basic)

    CSW (Basic)

    CHA (Basic)

    CHA (Basic)

    CHA (Add.1)

    CHA (Add.1)

    CHA (Add.2)

    CHA (Add.2)

    CHA (Add.3)

    CHA (Add.3)

    Option B

    Option B Option1

    Option1Option2

    Option2

    Option3

    Option3

    Controlled by CSW (Add)

    The Logic Box slots of the DKC are divided into two sections. One section is located on the front side of the DKC, and the other section is located on the rear side. These two sections function as Cluster 1 and Cluster 2, respectively. Each cluster has a structure in which two sets of CHAs, DKAs, Caches, and CSW are installed symmetrically to the right and left. The basic CSWs are installed at the PCB locations, 1D and 2P, and control the Basic CHA. Add CHA1, Option B, and Option DKA 1. When installing the channel adaptor/disk adaptor (CHA/DKA) in the location, 1G/2T, 1H/2U, 1K/2W, or 1L/2X, the DKC-F510I-CSW must be installed in location 1J and 2V. The locations for installing the shared memory PCBs are separated from the locations for other components. The shared memory PCBs are installed in two layers (upper and lower). The shared memory PCBs installed in the upper and lower layers are different from each other. Besides, locations for installing the basic and additional shared memory PCBs in Cluster 1 are different from those in Cluster 2.

  • 6/2/2008

    37

    37

    Cache Memory and Shared Memory

    Cache Overview

    Cache (Data)

    Shared Memory (Control)

    Non-volatile

    1024MB DIMMs = 12GB

    512MB DIMMs = 6GB

    2048MB DIMMs = 256GB

    1024MB DIMMs = 128GB

    Cache DirectoryConfiguration InfoDevice MappingTask Queues

    Customer Data

    Cache directory information allows a CHA microprocessor to find out if requested data is already cache-resident.Configuration Info is the configuration data specified via the SVP installation, maintenance, and change-configuration capabilities. Device mapping means LUNs mapping to a CU:LDEV, which maps to anarray-group. Logical-addressing has to be converted to physical-addressing to determine the specific drive containing the requested data. There are task queues that support front-end and back-end processor activities. Each MP runs a task created with and RTOS called VxWorks(WindRiver Inc.)

  • 6/2/2008

    38

    38

    Shared Memory

    Shared memory stores Cache directory Information Storage system configuration data Path group array information

    Dynamic path selection Contains the run-time task list for front-end directors and back-end directors

    Size of shared memory storage is determined by Total cache size Number of LDEVs Replication software in use

    Shared memory is duplexed Physical location

    In the Universal Storage Platform, shared memory is mounted on dedicated printed circuit boards

    In the Network Storage Controller, shared memory is mounted on the cache printed circuit boards

    The non-volatile shared memory contains the cache directory and configuration information for the Universal Storage Platform. The path group arrays (for example, the dynamic path selection) also reside in the shared memory. The shared memory is duplexed, and each side of the duplex resides on the first two shared memory cards, which are in clusters 1 and 2. The shared memory has separate power supplies and is protected by separate seven-day battery backup.For the Universal Storage Platform model, shared memory is now mounted on separate boards (previously on the cache boards). This new design eliminates the performance degradation (caused by write-through mode) that was previously experienced during shared memory replacement. The basic size of the shared memory is 3GB (two cards), and the maximum size is 6GB (four cards). The size of the shared memory storage is determined by several factors, including total cache size, number of LDEVs and replication functions in use. The replication functions affecting shared memory include Hitachi TrueCopyRemote Replication software Synchronous/Asynchronous software, Hitachi ShadowImage Heterogeneous Replication software, Hitachi Universal Replicator software, Hitachi Copy-on-Write Snapshot software, FlashCopy V2, Volume Migration, Serverless Backup Enabler (E-Copy), and Copy Manager for TPF. Any required increase beyond shared memory stores configuration data and the information for controlling the cache memory and disk drives. The memory can be accessed commonly from the CHA and DKA.

  • 6/2/2008

    39

    39

    Architecture

    Hi-Star Architecture

    THEORY 02-60

    Comprised of:CacheShared memoryNon-blocking cache switches

    The Universal Storage Platform has the power supply, DKC, and DKU section in which disk drives are installed. The High Performance Shared Memory Access Model, in which the shared memory-PCB (SM-PCB) is added optionally, realizes the bandwidth of up to 15GB/s. Hi-Star net performance according to system configuration: Cache (Basic) + CSW (Basic) -----------------------------maximum 17GB/sec Cache (Basic) + CSW (Basic + Option) -----------------maximum 34GB/sec Cache (Basic+Option) + CSW (Basic)-------------------maximum 34GB/sec Cache (Basic+Option) + CSW (Basic+Option) --------maximum 68GB/secThe power supply section consists of AC-Boxes, AC-DC power supplies and battery boxes. The system architecture adopts duplicated structure for the AC power reception. The AC power supplied is converted into 56V DC power by the AC-DC power supply and supplied to each component inside the subsystem. Each component has a DC-DC converter and generates necessary voltage from the 56V DC to supply it to itself.

    New generation non-blocking switching architecture Faster switch components Enhanced data and control bandwidth Helps consolidations and fast transactions applicationsSeparate control memory region for increased reliability and serviceability

    Expanded Cache Memory and flexible front-end/back-end configurationFaster and increased number of RISC processors across the system (2GB/s)Conform better to the applications needsImproved Fibre Channel and FICON designAdditional reliability: reduces outages, increases productivity

    Faster back-end design2Gbit/sec disk interface Optional faster back-end director (Later release)Ease performance bottlenecks, helps with applications consolidation and QoS

    Enhanced RAID-1+ and RAID-6 RAID-6 (6+2) for increased reliability, recovery and security

  • 6/2/2008

    40

    40

    Optional Disk Features

    Also called hard disk drives (HDDs) All Universal Storage Platform

    models support 73GB,15Krpm 146GB,10Krpm 146GB,15Krpm 300GB,10Krpm

    Dual vendor policy will be applied wherever possible

    HGST and Seagate Universal Storage Platform/Network

    Storage Controller hard disk drives are not interchangeable with other Hitachi Data Systems Storage Systems

    Universal Storage Platform supports four types of disk drives; these drives have a 2Gb/s fibre channel interface. The respective capacities of the disk drives are: 73GB/15k rpm 146GB/10k rpm 146GB/15k rpm 300GB/10k rpm Each disk drive can be replaced nondisruptively on site. The Universal Storage Platform utilizes diagnostic techniques and background dynamic scrubbing that detect and correct disk errors. Dynamic sparing is invoked automatically if needed. For an array group of any RAID level, any spare disk drive can back up any other disk drive of the same rotation speed and the same or lower capacity anywhere in the subsystem, even if the failed disk and the spare disk are in different array domains (attached to different disk adapter pairs). The Universal Storage Platform can be configured with a minimum of one and a maximum of 40 spare disk drives (Four slots for spare disks + 36 slots for spare or data disks). The standard configuration provides one spare drive for each type of drive installed in the storage system. The Hi-Track tool monitoring and reporting tool detects disk failures and notifies the Hitachi Data Systems Support Center automatically and a service representative is sent to replace the disk drive.

  • 6/2/2008

    41

    41

    HDU Box

    Configuration in HDU Box in which 32 HDDs are controlled by two Fibre Channel Arbitrated Loops (FC-ALs)

    The first FSWA1 is standard and is always installed.When connecting to the HDU using the two FC-ALs, installation of the second FSWA2 is needed.When using the second FSWA2, the HDU is configured as two separate HDUs.

    HDU Box

    FSW-A2

    FSW-A2FSW-A1

    FSW-A1

    07 06 05 04 03 02 01 00

    0F 0E 0D 0C 0B 0A 09 081F 1E 1D 1C 1B 1A 19 18

    17 16 15 14 13 12 11 10

    07 06 05 04 03 02 01 00

    0F 0E 0D 0C 0B 0A 09 081F 1E 1D 1C 1B 1A 19 18

    17 16 15 14 13 12 11 10

    FCAL boundary

    HDU

    HDD Location

    FC-AL boundary

    DKU F505IFSWA

    HDU

    Extension of FC-AL connection

    HDU Right SideHDU Left Side

    FSW-A2

    FSW-A2FSW-A1

    FSW-A1

    In the disk controller (DKC) and DKU frames, two HDUs each contain 32 HDDs. The HDDs are connected to the disk adapter (DKA) through the fibre channel interface switches (FSWs) with the FC-AL. When the FSW-A is installed, the HDDs in the HDU are controlled by the two FC-ALs. For the HDU box in the disk controller (DKC) (DKU-R0), the FSW-A is the standard installation. The HDDs are controlled by eight fibre channel ports in the first DKA pair.Fibre Channel interface switch PCB is a board that provides the physical interface (cable connectors) between the ACP ports and the disks housed in a given disk drive.A HDU box has been called a HDD canister in the past.

  • 6/2/2008

    42

    42

    DKU Hardware and Interconnections

    High Speed Disk Access Model - Four DKA Pair Configuration

    DKC R1 DKUL1 DKUL2 DKU

    HDU

    R0 DKU

    R2 DKU

    HDU HDU

    HDU HDU

    HDU HDU

    HDU HDU

    HDU HDU

    HDU HDU HDU HDU

    HDU HDU

    DKADKA(Opt.3)

    DKADKA(Opt.2)

    DKADKA(Opt.1)

    DKADKA(Opt.B)

    HDU

    The DKU section consists of HDU boxes and HDDs.FC-AL connections are used to access the HDDs installed in the HDU-boxes.A maximum of 48 HDDs on two FC-AL loops from the OPT B BED feature is possible and a maximum of 32 HDDs on two FC-AL loops from each of the other three BED features is possible. Every HDD is connected to two FC-ALs.Option B Base Option, standardHigh Performance Disk Access ModelDevice Interface Cable options: R0 R1 DKC R1 R1 R2 (two features) DKC L1 DKC L1 L1 L2 (two features)

  • 6/2/2008

    43

    43

    DKA Options - Enhanced Backend FC-AL

    48Processor per DKA

    3.212.8 or 6.4Total bandwidth (GBps)

    12Bandwidth of FC path (Gbps)

    48Number of Backend path DKA

    3264Number of Backend path (Max)

    Lightning 9900 VSeries system

    Universal Storage Platform

    Item

    In the Universal Storage Platform, the number of ports per disk adapter is increased to eight and furthermore, the transfer rate per fibre port is made higher to 2Gbps. In the storage system with the maximum configuration, disk drives are accessed through the four disk adapter pairs and 64 paths.

    The full specification model (DKA-F510I-400) controls one Fibre Channel port with one microprocessor (Eight FC-AL and eight microprocessors (MPs) per PCB).

  • 6/2/2008

    44

    44

    RAID Protection

    RAID 0/1 2D+2D (2 Disk+2 Mirror) 4D+4D (4 Disk+4 Mirror)*

    N/A Hitachi Lightning 9900 Series enterprise storage systems RAID 5

    3D+1P (3 Data Disk+1Parity Disk) 7D+1P (7 Data Disk+1Parity Disk) Also 16 or 32 Disk Groups*

    N/A Lightning 9900 Series systems RAID 6

    6D+2P (6 Data Disk+2Parity Disk) N/A - Lightning 9900 V Series system or Lightning 9900 Series system

    * With Concatenation on Universal Storage Platform, Hitachi Network Storage Controller or Hitachi Universal Storage Platform V only

  • 6/2/2008

    45

    45

    Cache Destaging Process

    Cache Destaging (new for the Universal Storage Platform) will beconfigured for either

    Backup mode Destaging mode Not supported network storage controller

    In the event of a power failure longer then one minute, the Universal Storage Platform will begin the backup process

    Backup process is configured when Universal Storage Platform is installed The backup process is set to either

    Destaging mode Destage to disk all write I/O in cache

    Backup mode Provide power to cache until power resumes

    Cache Destage Requires Cache memory batteries Disk adapter batteries Destaging Mode = On

    Battery backup and destage option for HDDs. The Universal Storage Platform provides separate battery backup for the hard disk drives with an optional setting to destage data from cache to the (internal) HDDs during a power outage. This feature is new with the Universal Storage Platform.Note: The destage option is not supported when external storage is connected and/or when Cache Residency Manager BIND mode is applied.Shared memory has separate power supplies and is protected by separate seven-day battery backup. Cache memory in the Universal Storage Platform is nonvolatile and is protected by 36-hour battery backup (without the destage option, cache size of 132GB or more) or 48-hour battery backup (without destage option, cache size of 128GB or less).

  • 6/2/2008

    46

    46

    Hi-Track Monitor

    Hi-Track Monitor call-home service and remote maintenance tool Hi-Track Monitor is a standard for all of the Universal Storage Platform

    models Monitors the operation of the Universal Storage Platform at all times

    Collects hardware status and error data Transmits this data through a modem to the Hitachi Data Systems

    Support Center The Support Center analyzes the data and implements corrective action

    as needed

    Hi-Track Monitor enables most problems to be identified and fixed prior to actual failure and the advanced redundancy features enable the system to remain operational even if one or more components fail.

  • 6/2/2008

    47

    47

    Hi-Track Monitor

    In the event of a component failure Calls the Hitachi Data Systems Support Center immediately to report

    the failure No customer action is required

    Provides for remote maintenance Hi-Track Monitor does not have access to any user data stored on

    the Universal Storage Platform The Hi-Track Monitor requires a dedicated RJ-11 analog phone line

  • 6/2/2008

    48

    48

    Universal Storage Platform V

    Universal Storage Platform V

  • 6/2/2008

    49

    49

    Specification Comparisons

    Feature USPV USPMaximum Internal Capacity 332TB (300 GB HDD) 332TB (300GB HDD)Maximum External Capacity 256PB 32PBMaximum Number of HDDs 1152 1152

    FC 73GB 15K RPM FC 73GB 15K RPMFC 146GB 10K RPM

    FC 146GB 15K RPM FC 146GB 15K RPMFC 300GB 10K RPM FC 300GB 10K RPM

    Maximum Cache Memory 256GB 256GBMaximum FC Ports 224 192

    Maximum ESCON Ports 112 96Maximum FICON Ports 112 96Maximum iSCSI Ports ** 32

    Max NAS Ports ** 32Max Back-End Paths 64 x 4Gbps 64 x 2GbpsInternal Bandwidth 106GBps 81GBps

    External Storage Connection Fibre Channel Fibre Channel128K mainframe 64K Mainframe

    64K Open Systems 16K Open SystemsMaximum Definable in 1 Ldev 4TB 2TB

    HDD Types

    Maximum Volumes

    ** iSCIS and NAS connectivity is scheduled for a later release.See Maintenance Manual pages THEORY03-310, THEORY03-320, THEORY02-220.

    In the table above, and subsequent pages,USPV or USP V stands for Universal Storage Platform VUSP stands for Universal Storage Platform

  • 6/2/2008

    50

    50

    Controller &128 drives

    Up to256 drives

    Overview

    Base controller frame and one to four optional disk array frames Controller boards are reduced to half previous size, fewer resources

    affected by a service action Improved availability, configurability

    and serviceability

    CHA TypeUSP USP-V USP USP-V

    Open Fibre 4 8 16,32 8,16ESCON 4 8 16 8FICON 4 8 8,16 8

    FED Packages Ports / Package

    USP USP-V USP USP-V1 BED 16 8 384 1922 BED 32 16 640 3843 BED 48 24 896 5124 BED 64 32 1152 6405 BED - 40 - 7686 BED - 48 - 8967 BED - 56 - 10248 BED - 64 - 1152

    Back-end Loops Max Disks

    The Universal Storage Platform V is a high performance and large capacity disk storage system at the high end that follows the architecture of the Universal Storage Platform and has an improved Hi-Star Net Architecture and a faster microprocessor. An Universal Storage Platform V can consist of one disk control frame (DKC) which can install 128 HDDs, and up to four disk array frames (DKU) which each can install 256 HDDs and a subsystem is a flexible configuration, which goes from 5 to 1,152 HDDs (minimum and maximum). The Universal Storage Platform V is lined up with two models of a 3-phase AC power model and a single-phase model, and each model is connectable to both mainframe systems and open systems.

    Number of disk drives:Up to 256 HDDs/16 disk paths (when 2 DKA pairs are installed), orUp to 640 HDDs/32 disk paths (when 4 DKA pairs are installed), orUp to 896 HDDs/48 disk paths (when 6 DKA pairs are installed), orUp to 1,152 HDDs/64 disk paths (when 8 DKA pairs are installed)

    The Universal Storage Platform Vs new half-sized PCBs allow for a less costly, more granular expansion of a system. For instance, there were typically 4-6 front-end director (FED) packages installed in a Model Universal Storage Platform 600, and they could be a mixture of Open Fibre, ESCON, FICON, and iSCSI. However, this gave you a large number of ports of a single type that you may not need, with a substantial reduction of other port types that you may need to maximize. With the new half-sized cards, you can have 8 CHA packages (or up to 16 at the expense of disk BED packages), using any mixture of the interface types as before. Only now though, there are half as many ports per board, smaller numbers of lesser used port types can be installed. Packages are still installed as pairs of PCB cards just as with the Universal Storage Platform.The Universal Storage Platform V back-end disk adapter (BED) has 4-4Gbit/sec loops supporting up to 128 physical disks. The Universal Storage Platform BED pair has 16-2Gbit/sec Fibre loops supporting up to 256 physical disks. There are up to eight BED packages (16 PCBs) in a Universal Storage Platform V, while a Universal Storage Platform has four BED packages (8 PCBs), both having the same number of loops.

  • 6/2/2008

    51

    51

    Overview

    Frame Types Disk Controller (DKC) Frame Disk Unit (DKU) or Disk Array

    Frame

    Disk Controller Frame Disk Array FRAME

    Logic-Box

    (750 mm) (650 mm)

    (1920 mm)

    HDD Box

    AC-DCPower Supply

    AC-DCPower Supply

    (75.59 in.)

    (25.59 in.)

    Disk Controller Frame (DKC):The DKC consists of the DKC box in which the channel adapters, disk adapters, cache memories, shared memories, CSWs are installed, and the HDU Box in which disk drives are installed, and power supplies and Battery Boxes that supply power to the components above.

    Disk Array Frame or Disk Unit Frame (DKU):The DKU consists of the four HDU Boxes in each of which 64 disk drives can be installed, cooling fans, and power supplies and Battery Boxes that supply power to the components above. It can have up to 256 disk drives installed.

  • 6/2/2008

    52

    52

    DKC Frame Logic Box Design

    The new Logic Box is divided into CL1 a CL2 with a lower and upper layer.

    All PCBs are half size.

    Power supply boundary

    Rear / Cluster 2

    1LU 1KU 1JU 1HU 1GU 1CE 1SA 1CA 1FU 1EU 1DU 1BU 1AU

    DKA1

    CHA6

    CHA1

    CHA5

    CHA2

    DKA6/CHA11

    CSW2

    CSW0

    DIMMDIMM

    DIMM DIMMDKA5/CHA12

    Front / Cluster 1

    SMA1

    DIMM

    DIMMCMA3

    CMA1

    DKA2

    Logic PL

    PCB Location

    PCB Location

    DKA3/CHA14

    CHA8

    CHA3

    CHA7

    CHA4

    DKA8/CHA9

    CSW3

    CSW1

    DKA7/CHA10

    SMA2

    CMA4

    CMA2

    DKA4/CHA13

    2XL 2WL 2VL 2UL 2TL 2CD 2SB 2CH 2RL 2QL 2PL 2NL 2ML

    CHA7

    CHA8

    DKA4/CHA13

    CHA3

    CHA4

    DKA7/CHA10

    CSW3

    CSW1

    DKA8/CHA9

    CMA2

    CMA4

    DKA3/CHA14

    SMA1

    2XU 2WU 2VU 2UU 2TU 2CC 2SD 2CG 2RU 2QU 2PU 2NU 2MU

    CHA5

    CHA6

    DKA2

    CHA1

    CHA2

    DKA5/CHA12

    CSW2

    CSW0

    DKA6/CHA11

    CMA1

    CMA3

    DKA1

    SMA2

    Option5 Option6 Option2 Option6 Option5 Option1 Option2 Option3 Option2 Option1 Basic Option2 Option1

    PCB Location

    1LL 1KL 1JL 1HL 1GL 1CF 1SC 1CB 1FL 1EL 1DL 1BL 1AL

    Upper

    Lower

    Lower

    Upper

    PCB Location

    Option7 Option8 Option3 Option8 Option7 Option2 Option1 Option4 Option4 Option3 Option1 Option4 Option3

    Option5 Option6 Option2 Option6 Option5 Option3 Option1 Option1 Option2 Option1 Basic Option2 Option1

    Option7 Option8 Option3 Option8 Option7 Option4 Option2 Option2 Option4 Option3 Option1 Option4 Option3

    DK

    A pair 1&

    2D

    KA

    pair 3&4

    DKA pair 5&6

    DKA pair 7&8

    Advantages of half size PCBs:More granular upgrades

    Smaller upgrade steps for host connectivity; easier for mixed connectivity type platformsIn a pure mainframe environment a half Fibre option is enough for replication, more Ficon ports for host connectionsiSCSI will not occupy a full sized feature like on the Universal Storage Platform

    Less impact on PCB maintenanceOnly half of the host ports need to be switched offline compared with the Universal Storage Platform Only four instead of eight backend loops will be unavailable during DKA maintenance

    DKA pairs are installed with two pairs at the time2 pairs of DKAs4 pairs of DKAs6 pairs of DKAs8 pairs of DKAs

  • 6/2/2008

    53

    53

    Back-end Connections

    HDU

    DKU-R0HDU

    USPDKU-L2

    L1 (Upper)

    HDUHDU

    L1 (Lower)

    HDUHDU

    L2 (Upper)

    HDUHDU

    L2 (Lower)

    HDUHDU

    R1 (Upper)

    HDUHDU

    R1 (Lower)

    HDUHDU

    R2 (Upper)

    HDUHDU

    R2 (Lower)

    HDUHDU

    DKU-L1 DKU-R1 DKU-R2

    1st2nd

    3rd4th

    5th6th

    7th8th

    DKA

    64sp64sp

    64sp 64sp 64sp 64sp

    64sp 64sp

    64sp64sp64sp64sp64sp64sp

    64sp 64sp 64sp 64sp

    -AKT Kit

    Front View of DKU

    DKUPS

    -xx3

    DKUPS

    -xx2

    DKUPS

    -xx1

    DKUPS

    -xx0

    BATTE

    RY

    -Uxx0

    BATTE

    RY

    -Uxx1

    BATTE

    RY

    -Uxx2

    BATTE

    RY

    -Uxx3

    BATTE

    RY

    -Uxx4

    BATTE

    RY

    -Uxx5

    BATTE

    RY

    -Uxx6

    BATTE

    RY

    -Uxx7

    FSWR01-UFSWR01-L

    SVRR05-L SVRR01-L

    SVRR05-U SVRR01-U

    HD

    DR

    05-0CH

    DD

    R05-0A

    HD

    DR

    05-08H

    DD

    R05-06

    HD

    DR

    05-04H

    DD

    R05-02

    HD

    DR

    05-00H

    DD

    R01-0E

    HD

    DR

    01-0CH

    DD

    R01-0A

    HD

    DR

    01-08H

    DD

    R01-06

    HD

    DR

    01-04H

    DD

    R01-02

    HD

    DR

    01-00

    HD

    DR

    05-0EH

    DD

    R05-0D

    HD

    DR

    05-0BH

    DD

    R05-09

    HD

    DR

    05-07H

    DD

    R05-05

    HD

    DR

    05-03H

    DD

    R05-01

    HD

    DR

    01-0FH

    DD

    R01-0D

    HD

    DR

    01-0BH

    DD

    R01-09

    HD

    DR

    01-07H

    DD

    R01-05

    HD

    DR

    01-03H

    DD

    R01-01

    HD

    DR

    05-0F

    SVRR05-EX

    The Standard DKC-F605I-18 Disk Unit frame is delivered with power and logic (FSW / SVR) installed in the lower section of the frame. This will allow to install HDDs in the Lower half only.It is now an option to use the Upper part of the frame, the option is:DKC-F605I-AKT = DKU Expansion KitDKUPS 2(FSW) 8(SVR) 18

  • 6/2/2008

    54

    54

    DKU - B4 Numbering

    B41-x

    B42-x

    B43-x

    B44-x

    B45-x

    B46-x

    B411-x

    B412-x

    B413-x

    B414-x

    B415-x

    B416-x

    B417-x

    B418-x

    B47-x

    B48-x

    B49-x

    B410-x

    L2 L1 R0 R1 R2

    1st DKA Pair2nd DKA Pair3rd DKA Pair4th DKA Pair

    5th DKA Pair6th DKA Pair7th DKA Pair8th DKA Pair

    See Maintenance Manual page INST03-10A-40 and INST03-14-10.

  • 6/2/2008

    55

    55

    DKU HDD Installation Order

    Universal Storage Platform V Universal Storage Platform

    HDU

    HDU-Box

    FSWA-RU

    FSWA-RL

    FSWA-LU

    FSWA-LL

    1F 1E 1D 1C 1B 1A 19 18 0F 0E 0D 0C 0B 0A 09 08

    17 16 15 14 13 12 11 10 07 06 05 04 03 02 01 00

    FSWA-RU

    FSWA-RL

    FSWA-LU

    FSWA-LL

    HDD-PL

    1F 1E 1D 1C 1B 1A 19 18

    17 16 15 14 13 12 11 10

    0F 0E 0D 0C 0B 0A 09 08

    07 06 05 04 03 02 01 00

    Order of HDD

    installation

    0F 0D 0B 09 07 05 03 01 0F 0D 0B 09 07 05 03 01

    0E0C 0A 08 06 04 02 00 0E0C 0A 08 06 04 02 00

    HDD-PL

    0F 0D 0B 09 07 05 03 01

    0E0C 0A 08 06 04 02 00

    0F 0D 0B 09 07 05 03 01

    0E0C 0A 08 06 04 02 00

    FC-ALboundary

    FSW-UFSW-L

    FSW-UFSW-L

    FC-ALboundary

    RightHDU

    See Maintenance Manual page INST01-200.

  • 6/2/2008

    56

    56

    BED

    C

    luster 2B

    ED

    Cluster 1

    Switched Loop Back-end Reduces impact during drive failure and/or sparing Improves Performance by reducing disk-to-disk daisy chain latency

    FSW Switch

    On the previous Universal Storage Platform model, all of the disks attached to a DKA PCB were on eight shared loops. A transfer to the last disk on a loop (could be 32 or 48 disks per loop) would have to pass through bypass logic on all of the disks in front of it. The Universal Storage Platform V introduces a switched back end, where the drives are still on arbitrated loops (all Fibre Channel disks use FC-AL, not FC-SW fabrics), but the switch logic bypasses all targets on that loop except for the one disk being addressed. This reduces the propagation time by some micro-seconds (not noticeable), but the primary effect of this change is improved accessibility to individual disks. Each HDU has four such FSW switches, two on the front side (32 disks) and two more on the back (32 disks).

  • 6/2/2008

    57

    57

    Backend Loops 2Gbit/sec 4Gbit/sec Rules

    Disk Adapter supports two kinds of transfer rate settings defined at installation time (4Gbit/sec and 2Gbit/sec).

    The setting of transfer rate must be set by the unit of 2 DKA Pairs. HDDs of 2Gbit/sec / 4Gbit/sec can be installed (mixed) in 2 DKA Pairs

    that are set to 2Gbit/sec (HDDs will operate at 2Gbit/sec). Only HDDs of 4Gbit/sec type can be installed in 2 DKA Pairs that are set

    to 4Gbit/sec. Different transfer rates cannot exist together in the same loop. The HDD-copy (spare and correction copy) between HDDs set by

    different transfer rates is not allowed. Off/On of the power supply for HDDs is needed for the switch of

    4Gbit/sec / 2Gbit/sec (disruptive change).

  • 6/2/2008

    58

    58

    Parallel Crossbar Switch Architecture

    Universal Storage Platform V logical design is similar to Universal Storage Platform

    DKA DKA DKA CHA DKA DKA DKA DKA

    DKA DKA DKA CHA DKA DKA DKA DKA

    CSW CSW CSW CSW

    CACHE CMA CACHE CMA

    SMA SMA

    Channel Interface

    FCAL(4Gbps/port)

    Cache Path(68GB/s)

    SM Path (38.4GB/s)

    Max. 48HDD

    DKU

    BatteryBox Battery

    Box

    DKC Power Supply

    Max. 1,152HDD/subsystem

    Disk Path (max.64path)

    Input Power

    AC-Box AC-Box

    AC-DC Power Supply

    Input Power

    AC-Box AC-Box

    AC-DC Power Supply

    AC-DC Power Supply

    Power Supply

    AC-DC Power Supply

    BatteryBox Battery

    Box

    At first glance, it is like the Universal Storage Platform but on a closer look, the details are different:Shared memory bandwidthEffective cache memory bandwidth usageBack-end loop speed and hardware designBattery usage andVery different physical hardware layout in the Logic Box

    Main design is like Universal Storage Platform but the differences include:Half sized Logic PCBs, all PCBs are like the shared memory boards on the Universal Storage Platform.The microprocessors (128 of them) have double clock speed compared with the Universal Storage Platform.A more effective (double) use of the 2x cached bandwidth2x speed of backend loops and HDDs to support those speeds

  • 6/2/2008

    59

    59

    Hardware Architecture

    CHA CHA

    DKA DKA

    CSWCSW CSWCSWCSWSMCSW

    Logic Box max28

    max16

    max4max8max8

    Connect to Host CPU

    FSW PCBS HDDs

    HDD Box

    Shared Data Path (SHSN)

    Main Data Path (CHSN)

    Back-end Fiber Pass

    Data Path

    Data Path

    max64max64

    Service Processor (SVP)

    Maintenance Path (LAN)

    Based on R500 architectureEnhanced Hi-StarEnhanced ProcessorEnhanced Back End FCHalf size PCB

    CSWCSWCSWCACHECSWCACHECACHECSWCSWCSWCSWCSWCSW

    Main design is like Universal Storage Platform, but again, when looked in detail, things are very different.Half sized Logic PCBs, all PCBs are like the shared memory blades on the Universal Storage Platform.Hitachi Data Systems have a microprocessor with double clock speed compared with the Universal Storage Platform.A more effective (double) use of the cached bandwidthDouble speed backend loops and HDDs to support those speeds

    In the diagram above, Hi-Star is Hitachi Crossbar Switch Architecture.

  • 6/2/2008

    60

    60

    Microprocessor (MP) clock speed doubled Same amount of MPs in a full system Escon uses the same MP as the Universal Storage Platform Fibre can have 1MP 1Port or 1MP 2Port

    Hardware Architecture New Microprocessor

    Item USP V USP

    Number of CPU (max) 128 128

    CPU Core Y-wing H Y-wing

    Relative Performance of 1CPU 2 1

    USP V = Universal Storage Platform V

  • 6/2/2008

    61

    61

    SVP Specifications

    Universal Storage Platform V SVPUniversal Storage Platform SVP

    OS Windows XP (SP1 or SP2) Windows XP (SP2)

    CPU

    Memory

    HDD

    Intel Celeron 1.2GHz

    512MB

    80GB 160GB

    1GB

    FDD

    CD Drive CD-ROM Drive None

    LAN Ethernet 10Base-T/100Base-TX

  • 6/2/2008

    62

    62

    Summary

    The Universal Storage Platform V is an evolution of the Universal Storage Platform architecture with refinements and extensions to existing architecture, functionality, performance, and scalability

    Proven 4th generation Hitachi Crossbar Switch Architecture Faster Internal bandwidth = 106GB/sec Increased IOPS/sec = 3.5M Faster Internal Processors = doubled Increased 4Gbit/sec end-to-end (FC Ports, disks, back-end) More Fibre Channel Ports = 224 max 5x external support performance 2x remote replication performance Increased external storage capacity = 247PB

  • 6/2/2008

    63

    63

    Questions/Discussion

  • 6/2/2008

    64

    64

    Module Review

    1. Which disk drives does the Universal Storage Platform support? 2. What is the maximum cache capacity in the Universal Storage Platform? 3. What is the maximum number of back-end directors supported by the

    Universal Storage Platform? 4. Which of the following components does the disk adapter section of the

    Universal Storage Platform contain? A. Front-end director featuresB. Cache switchesC. Shared memoryD. Disk drives

    1. 73GB / 15Krpm, 146GB / 10Krpm, 146GB / 15Krpm, 300GB / 10Krpm

    Fibre Channel Drives. SATA Drives are not supported2. 128GB of cache with a maximum of 4 cache boards 3. 64 BEDs; 4 BED Features = 8 DKAs x 8 BEDs per DKA4. Disk drives