DMX-3 & 5771 Config

8/7/2019 DMX-3 & 5771 Config

1/33

11

DMX-3 & 5771

Aug23, 2005

8/7/2019 DMX-3 & 5771 Config

2/33

8/7/2019 DMX-3 & 5771 Config

3/33

33

Physical System Layout

Broken from the wheel in, plug and play, model. Aspects of DMX 800 are incorporated. Grow the box as required. This means inter-frame cabling is required.

Base Unit is equipment bay and at least one drive bay.

1A2A 1B 2BSystem

8/7/2019 DMX-3 & 5771 Config

4/33

44

DMX-3 Front view

Take note and remember how bays are numbered.

8/7/2019 DMX-3 & 5771 Config

5/33

55

System Bay (Front)

Fans

System Midplane

Air Intake(8)1800W Power Supplies

(8)SPS(only 3 shown)

KVM

Server

Card Cage

8/7/2019 DMX-3 & 5771 Config

6/3366

System Bay (Rear)

(16) 8-Port Adapters

(2) XCM Boards

(8) Power Supply Cords

(UPS) Uninterruptible Power Supply

(2) (PDP) Power Distribution Panel

(2) (PDU) Power Distribution Unit

(8) (SPS) Standby Power Supplies(only 6 shown)

8/7/2019 DMX-3 & 5771 Config

7/3377

Midplane (Front)

Dir1

Pos1

SlotID0

TypeBE

Dir9

Pos17

SlotID8

TypeFE

Dir2

Pos2

SlotID1

TypeBE

Dir10

Pos18

SlotID9

TypeFE

Dir3

Pos3

SlotID2

TypeFE

Dir11

Pos19

SlotIDA

TypeBEorFE

Dir4

Pos4

SlotID3

TypeFE

Dir12

Pos20

SlotIDB

TypeBEorFE

Dir5

Pos5

SlotID4

TypeBEor

FE

Dir13

Pos21

SlotIDC

TypeFE

Dir6

Pos6

SlotID5

TypeBEor

FE

Dir7

Pos7

SlotID6

TypeFE

Dir8

Pos8

SlotID7

TypeFE

Dir16

Pos24

SlotIDF

TypeBE

M0

Pos9

SlotID10

M1

Pos10

SlotID11

M7

Pos16

SlotID17

M6

Pos15

SlotID16

M5

Pos14

SlotID15

M4

Pos13

SlotID14

M3

Pos12

SlotID13

M2

Pos11

SlotID12

Mirrored Memory Pairs

Director Pairs

14

Rev 2.0 9/11/03

15

8/7/2019 DMX-3 & 5771 Config

8/3388

Card Cage Front

Each Director has 4 slices

Each Slice has 2 ports

DAs come in pairs

Each DA pair drives 8 DAEs (Primary)

Dirs 5,6,11,12 could be HAs

Memory comes in pairs (Mirrored)

Both cards must be the same size

Available memory sizes are:8GB, 16GB, 32GB, 64GB

8/7/2019 DMX-3 & 5771 Config

9/3399

Universal Director

Jtag RS232 Ethernet

DisableInterface

Switch

Boot UpMode

Selection

StatusDisplay ProcessorSelectedDisplay

CPU SelectionSwitch for FBUart, Attn. and

Status Display

A,B,C,DMachineOk LED

MachineCheckError on

A,B,C,D

Attn.Switch

PICFault

LED

FRUBlue

LED

8/7/2019 DMX-3 & 5771 Config

10/331010

Cache Configuration Rules: Sym7 vs Sym6

Restrictions 1 and 3 exist on Sym6 to avoid I/O contention

Restrictions 4-5 are new to Sym7 due to mirroring method

Cache Boards are available in 8GB,16Gb, 32GB, 64GB capacities.

Rule Sym 6 Sym 7

1 2 board configs must use same size board 2 board configs must use same size board

2 Largest board no more than twice size of smallest board No restriction on largest vs smallest board

3 Cannot have fewer of the larger board than the smaller board Cannot have fewer of the larger board than the smaller board

Example: (2 x 8GB + 6 x 16GB) OK Example: (2 x 8GB + 6 x 16GB) OK

Example: (4 x 8GB + 4 x 16GB) OK Example: (4 x 8GB + 4 x 16GB) OK

Example: (6 x 8GB + 2 x 16GB) not allowed Example: (6 x 8GB + 2 x 16GB) not allowed

4 Odd no. of total boards allowed Odd no. of total boards not allowed

Example: 3 x 16GB OK Example: 3 x 16GB not allowed

5 Odd no. of individual boards allowed Odd no. of individual boards not allowed

Example: (3 x 16GB + 3 x 8GB) OK Example: (3 x 16GB + 3 x 8GB) not allowed

8/7/2019 DMX-3 & 5771 Config

11/331111

Card Cage Rear

B0B1

A0A1

D0D1C0C1

XCM Card

Combination of the

Communications Control Module(CCM) card and EnvironmentalControl Module (ECM) card

Handles communication

switching and card cageenvironmental monitoring

Directors responsible for localenvironmental monitoring

8/7/2019 DMX-3 & 5771 Config

12/331212

Drive Bay

1 Pod has 4 X DAEs

1 X DA pair drives 8 DAEsMinimum upgrade granularity @ GA

Drives count 0-E

E

0

Drive 2A 05 A

Drive slots 0, 1, 4, 5, 8, 9, C, D are one power branch.Drive slots 2, 3, 6, 7, A, B, E are the other branch.

Bay DAE Drive

8/7/2019 DMX-3 & 5771 Config

13/331313

DAEs Rear View

8/7/2019 DMX-3 & 5771 Config

14/331414

Connecting the Daes to Das

16 A0

16 B001 B0

01 A0

16 D0

16 C0

01 D0

01 C0

16 D116 C1

01 D1

01 C1

16 A1

16 B101 B1

01 A1

8/7/2019 DMX-3 & 5771 Config

15/33

1515

Note: At GA max of 4 Storage Bays, 8 Storage Bays post-GAMinimum GA Configuration will have 3 DA pairs

Yellow = Dir 1 & 16

Green = Dir 2 & 15

Orange = Dir 5 & 12

Blue = Dir 6 & 11

Connecting Up

FID 94; Symm7 only

8/7/2019 DMX-3 & 5771 Config

16/33

1616

PowerVault

Redesign of the power-down process to dump pertinent GlobalMemory information to specified Power Vault drives.

Need a predictable, fast and consistent solution to deal with Cache current method of de-staging Global memory is not scaleable.

Not predictable due to what's happening at the time. Increase in Global Memory sizes (512GB raw) along with stagnant battery

technology meant we could potentially run out of battery time before we hadcompletely de-staged memory.

Symmwin will automatically configure Vault devices. Do not block move or fiddle with Vault devices. Power Vault requirement is 4 unprotected volumes per DA slice.

Must be on primary DAEs which cannot be configured with less than 4 drives. Current Size is 5gb but appear as 0 cyls in bin file.

Power Vault devices are formatted as raw FBA drives and cannot be read using D0commands using Cyl and HD because of this.

Vault Devices are assigned to be the first logical position on a physical drive.

This is the fastest part of the physical drive (Outer Diameter) Insures the highest possible throughput

FID 94; Symm7 only

8/7/2019 DMX-3 & 5771 Config

17/33

1717

DAE

LCC

LCC

SPS

DAF1

DAF16

o 4 Vault Drives per DA slice

o 5 GB per Vault drive

To Daisy Chain DAE

PowerVault

8/7/2019 DMX-3 & 5771 Config

18/33

1818

Vault Save AllocationExample

PV

DEV

B

Dir

1B

PV

DEV

D

Dir16A

PV

DEV

A

Dir

1A

PV

DEV

D

Dir

1D

PV

DEV

A

Dir

16D

PV

DEV

B

Dir16C

PV

DEV

C

Dir16B

Region 0

Dir 1D

Region ABC

Region DEF

PV

DEV

C

Dir

1C

Dir 1C

Dir 1B

Dir 1ADir 16A

Dir 16B

Dir 16C

Dir 16D

Region

Region UVW

.

.

Each region issaved twice.

This is forredundancy.

You do NOT get acopy of each mirrorimage of memory

8/7/2019 DMX-3 & 5771 Config

19/33

1919

Changes to IML

Restore Global Memory from previously successful Vault Save image. This is done in step 14 of the IML

Step 14 also incorporates an extensive Sanity Check of global memory

Error codes that may be seen will reported as ECxx errors

Drive availability Sanity Check Check that all Drives previously in the System are in the same place by comparing

the S/N of the drives since the last successful restore.

Error DD10.01 will be issued if we find the drives in a different slot than before.

At the end of the Restore check that both images of GM match bycalculating the CRCs for the 2 matching Vault regions of memory

Error 3310.00

8/7/2019 DMX-3 & 5771 Config

20/33

2020

Vault Implications

System VTOC: the Vault drives will be formatted and a Vault Saveoperation will take place at the end of a successful VTOC.

When a System is taken Offline (DAs) a Vault Save operation will takeplace.

The Front End and RDF can be taken offline and back online without a Vault.

Can not take one DA offline, all or none.

Environmental triggers loss of a sufficient number of Fans

loss of a sufficient number of Vault drives

loss of Battery hold up time meaning we would not be able to Vault if AC Power waslost.

If the system determines theres not enough power to vault it wont come up.

A lack of SPS Battery hold up time will prevent the box from coming online

The box will still complete IML.

The state would remain in Post Restore IML.

8/7/2019 DMX-3 & 5771 Config

21/33

2121

Init Screen

Model name DMX3-24 or DMX3-6

Power vault wait time

Raid-S no longer supported

8/7/2019 DMX-3 & 5771 Config

22/33

2222

Dir Map tab Changes

8/7/2019 DMX-3 & 5771 Config

23/33

2323

DAE

Much like adding disks use the

wizard or type in the letter

8/7/2019 DMX-3 & 5771 Config

24/33

2424

Split Screen

Unlike the Hosts tab this one is compulsory

Helps to maintain addressing rules.

8/7/2019 DMX-3 & 5771 Config

25/33

2525

Addressing CKD devices

Gives the capability toaddress multiple CU imagesat the same time.

8/7/2019 DMX-3 & 5771 Config

26/33

2626

Disks

Add new option as to where you wantto place disks.

Note as you change DAE the colourschange.

Physical view functionality added.

8/7/2019 DMX-3 & 5771 Config

27/33

2727

Physical view from Vols Map

8/7/2019 DMX-3 & 5771 Config

28/33

2828

Vols Request

128 Vault devices. 16 per DA director. 4 per DA slice.

VCM data base now lives on SFS volumes so the device is samesize as a gatekeeper.

New protection type CDEV (cache only device)VDEV lives in Cache, no longer takes up Physical disk space.

Raid-S no longer supported.

Be Careful traditionally this would be a 9Gb drive Now its double that, remember this when playing with SRDF.

FBA track size Doubled to 64KB

Fewer tracks or slots per GB of user data

Both FBA and CKD will use a 64KB track, so any systemcan mix FBA and CKD devices

FIDs 420,662,663,664; Symm6 & Symm7

8/7/2019 DMX-3 & 5771 Config

29/33

2929

SRDF Inter-platform Support

Platform RDF Configuration Level of Support

Symm 4 5267 to 5x71 Migration only

Symm 5 5567 to 5x71 Migration only

5568 to 5671 Full support


Symm 6 5669 to 5x71 none


5670 to 5771 None

5671 to 5x71 Full support

Symm 7 5771 to 5771 Full support

Includes all link types: ESCON, FC, GigE

8/7/2019 DMX-3 & 5771 Config

30/33

3030

Numbers

5670 5671 5771

Volumes Supported 8,000 16,000 64,000*

CUs in a box 64 64 250

MF LPARs per slice 64 64 128MF ESCON concurrent I/O 4 8 8

MF Aliases 7 15 255

iSCSI Initiators per Slice 128 128 512

* 32,000 if everything is Raid 7+1

8/7/2019 DMX-3 & 5771 Config

31/33

3131

New and Noteworthy

Cable diagnostics Runs automatically during configure and install Symmetrix

Checks out basic cabling connectivity & functionality

Steps CE through a sequence where the DAEs are lit up First vertically thenhorizontally 1 frame at a time.

Provides opportunity to correct any problems before moving on.

Can also be run anytime from menu.

Drive replacement script Drive replacement script has been improved to run mostly unattended.

After testing basic drive functionality CE is released.

Script monitors and will dial home if problems occur.

SCSI code load Planning script and a load script.

Gives CE options on how when and where to load.

Can run in flavors ranging from Big Bang Mode to unattended Super safe mode.

8/7/2019 DMX-3 & 5771 Config

32/33

3232

5771 Procedure Wizard changes

Symm 7specificoptions

Starts vaultingprocess prior topower down.New cableoptions

Global sparing notyet available

No offlinechanges

8/7/2019 DMX-3 & 5771 Config

33/33

3333

Documents

DMX-3 & 5771 Config