How to tackle the storage overload

How to Tackle the Storage Overload

Graham RatcliffeStorage Product Manager

Apex Computers

1 ESG Impact Report™ Source: Compliance: The effect on Information management and the storage industry

Information Management and Storage challenges are impacting the ability to optimise information value and deploy Information On Demand solutions

Explosive Data Growth

• Surge in criticality, value and volume of data is overwhelming • Projected to grow at an annual rate of 64% percent1

Compliance Requirements

Fragmented Storage Environment

• Compliance with stringent regulatory requirements and audit procedures

• Estimated 20,000+ compliance regulations worldwide

• Lack of enterprise-wide storage strategy and disciplines• Effective disk utilisation is <50%, with 20-40% wasted space

Storage Challenges


Today’s Realities

“During 2002 the world created 5 exabytes of information. An exabyte is

the digital equivalent of a trillion novels. The yearly total amounts to

somewhat more than all the words ever spoken by human beings – and

it was up 68% from two years earlier” –

Forbes: Data of Reckoning, May 10, 2004

“ For email – so much of it is waste and so much can

be deleted. The idea of establishing what’ s actually important is

brilliant. Yes, ILM would change

my pain in that area.” –

Warner Comm.

“We are drowning in a sea of

information. No one knows the

value, how long it should be kept,

or what the risk of keeping or

getting rid of it is.” –

J.P. Morgan


1. Clean Data2. Limit Data (reduce copies or share data)3. Delete Data (when required – not before)

Improve: Manage Storage Service Delivery

1. Increase the return on IT Assets

2. Radically improve the migration time from old technology to new technology

3. Inter-operability across storage devices

4. Disk Consolidation/Financial Selling

5. Tiered Storage / Classes of Service

6. Archive

7. Business Continuity• Continuous Availability• Rapid Recovery• Backup/Restore

• Operational Effectiveness

Reduce: Manage Data Growth


3 Step Approach

1 Data Classification and Rationalisation

2 Establish Storage Tiers and Infrastructure

3 Determine Policies to Manage Data

Gold Silver Bronze

Data Classification

Data Rationalisation

Determine who owns, who is authorised to read,

and who is authorised to modify specific data, in

compliance with laws, regulations, security and

privacy policies

Determine appropriate business value and service

level of specific data, so that it can be placed on

the appropriate storage, and can be subsequently

moved to other storage or expired (deleted) at a

later date if the status changes over the lifecycle of

the information represented



Reclaim more of this

Delete this

Leave this alone

Delete / share this

Delete / archive this -Often

Clean this - Often

Invest in storing, accessing, managing and protecting this

Data Classification and Rationalisation


Rem

ainin

g S

torag

e C

apacity

System Files

Non Business

Files

Duplicate data

Redundant application

data, log files,

dump files, temporary

files

Stale / Orphan

DataValid Data






Gold Silver Bronze

Match tiers of storage to cost points and service

levels required



Service Level

Co

st p

er G

B

DS4000Flexibility

VirtualTape Server

UltraScalableTape Library

LTO

Enterprise TapeLibrary

3592

DS8000The Standard

DS6000Enterprise diskfor all clients

DS300 / 400New entry

point DR550Retention ManagedStorage

Platinum Gold Silver Bronze

Enterprise Tier

Midrange Tier

Cost Centric Tier

Mid-range Tape

Enterprise-class Tape

Virtual Tape

Mid-range Disk with S-ATA

Nseries


Enterprise-class Disk

Mid-range Disk with

Fibre Channel





Gold Silver Bronze

Data Lifecycle Management Compliance / Retention

Establish policies to move or expire

data based on external

characteristics

Establish policies based on internal

characteristics

Date Since Created (Age)

Date Last Referenced/ Updated

Size

Context of Information

Content Description


Reduce: Manage Data GrowthCustomer Reference – Data Management

Company Description

Solution Description

Leading Hospital

TotalStorage ESS

TPC for Data

Benefits Decreased storage costs by 50%

5X storage capacity than previous system

Maintained availability during multiple power outages

UK Manufacturing company

Consolidated and virtualised data center

Seamless capacity expansion

High availability

50% lower total cost of ownership due to higher system utilisation

Fortune 500 Energy company

Tiered storage solution with virtualisation

Large British telecom firm

Reduced management costs 30% (£450K per year)

Network performance increased 10%

SVC

TPC

DS4000

DS4000 Tape Library


1. Clean Data2. Limit Data (reduce copies or share data)3. Delete Data (when required – not before)


1. Increase the return on IT Assets

2. Radically improve the migration time from old technology to new technology

3. Inter-operability across storage devices

4. Disk Consolidation/Financial Selling

5. Tiered Storage / Classes of Service

6. Archive

7. Business Continuity• Continuous Availability• Rapid Recovery• Backup/Restore

• Operational Effectiveness




SAN

AdvFunction

AdvFunction

AdvFunction

AdvFunction

FileSystem

FileSystem

FileSystem

FileSystem

Storage capacity is isolated in SAN islands

Low capacity utilisation, difficult to pool volumes

SAN islands require unique management

Server downtime required to add/replace arrays, manage LUNs, migrate volumes

Copy services are unique to each storage array

Volume/Storage Management Issues File/Data Management IssuesFile tasks must be done on each server

Difficult to migrate applications to other servers

Application Downtime required for FS changes

No single view/access to files or data

Cannot pool files based on Quality of Service



Traditional SAN• Capacity is isolated in SAN islands• Multiple management points• Poor capacity utilisation• Capacity purchased for and owned by

individual processors

With SAN Volume Controller (SVC)• Combines capacity into a single pool• Better utilisation of storage assets• Single Management point• Capacity purchases can be deferred until

the physical capacity of the pool reaches a trigger point

SAN

95%capacity

25%capacity

50%capacity SAN

SANVolume Controller

65%capacity

Increase the Return on IT Assets


• Storage growth doubling every 12-18 months

• Effectively manage costs• Support dual vendor strategy• 28% Utilisation

• Implemented a Virtualised Storage Environment

• SAN Volume Controller

• Improved storage utilisation to 80%• Enables FlashCopy between different

classes of storage (ESS to DS4000)• Simplifies storage management• Enables data migrations without

disrupting applications • Drastic reduction in spend growth

Business Challenge

Solution

Benefits

Customer ReferenceImproved Utilisation at Regional Retail Bank



SANSAN

Volume Controller

SAN

Traditional SAN2. Stop the application3. Migrate the data4. Re-establish host connections5. Restart application

With SAN Volume Controller (SVC)

2. Migrate the data• Host systems and applications are not

affected.

VirtualDisk

Radically Improve the Storage Migration Time


Benefits• Enables replication between

different classes of storage• Uses low-cost storage and high-

performance storage in the same storage pool

• Virtualised storage complements virtualised servers for maximum flexibility

“The IBM solution... offered good price-to-performance

characteristics, and excellent availability.“Client CTO

Business Challenge• Ensure high data security for banking

operations, and build a storage infrastructure ready for the future

• Improve resilience of SAN for better disaster recovery capabilities; support storage for multiple platforms and offer high availability at low total cost of ownership

Solution• Created a SAN based on IBM

TotalStorage SAN Volume Controller, ESS 800’s & DS4400 storage servers

Customer ReferenceImproved Availability at Leading Scandanavian Bank


Improve: Manage Storage Service DeliveryArchive

Client Objectives:

• Improve efficiency– Enhance systems/Email performance

• Manage Risk and Streamline Compliance– Reducing organisational risk– Complying with governmental regulations

Results:• A leading energy company

reduced personal archiving disk space used by 75%, recovering 3TB of storage.

• Saved £100,000 in disk expansion.

• Improved backup times• Reduced management time


Archive

180 days

Tier 3 – SATA Drives or WORM Tape

Tier 2 – N Series or DR550

Tier 1 – High Performance Disk, such as DS8000

30 days

delete


Improve: Manage Storage Service DeliveryBusiness Continuity

Hardware, software and services to help keep your business running

► Implement reliable backup/restore

► Achieve continuity of business operations, reduce downtime

► Assure availability of critical business applications and data

► Stay competitive by reducing business risk, increasing business resiliency

Comprehensive

Integrated

Automated

Application aware

Cost-effective

Resiliency Family solutions can help you:

Continuous availabilityRapid recoveryBackup/restore

TIM

EHow to Tackle the Storage Overload


Recovery Time Objective

15 Min. 1-4 Hr.. 4 -8 Hr.. 8-12 Hr.. 12-16 Hr.. 24 Hr.. Days

Co

st

Tier 4 - Point in Time disk copy

Tier 3 - Electronic Vaulting

Tier 2 - Hot Site, Restore from Tape

Tier 7 – Disk Mirroring with automated recovery

Tier 6 - Disk mirroring

Tier 5 -Two phase commit (transaction integrity)

Tier 1 – Restore from Tape

Recovery from a disk image Recovery from tape copy

Advanced function copy and mirroring




Questions

Technology

How to tackle the storage overload