Oracle HSM - konferenz-nz.dlr.dekonferenz-nz.dlr.de/pages/samfs2019/present/1... · Oracle HSM 6.0 and beyond ―with tape I/O horizontal scalability Tape I/O Horizontal Scalability

1

Copyright©2019,Oracleand/oritsaffiliates.Allrightsreserved.|Copyright©2019Oracleand/oritsaffiliates.Allrightsreserved.|

OracleHSMUpdate

MartinMuellerSeniorPrincipal ProductManagerOracleInfrastructureProducts6June2019

Confidential– OracleRESTRICTED

Copyright©2019,Oracleand/oritsaffiliates.Allrightsreserved.|

SafeHarborStatementThefollowingisintendedtooutlineourgeneralproductdirection.Itisintendedforinformationpurposesonly,andmaynotbeincorporatedintoanycontract.Itisnotacommitmenttodeliveranymaterial,code,orfunctionality,andshouldnotberelieduponinmakingpurchasingdecisions.Thedevelopment,release,andtimingofanyfeaturesorfunctionalitydescribedforOracle’sproductsremainsatthesolediscretionofOracle.

Confidential– NDARequired


• PortfolioandMarketUpdate• HSMUpdate

4

Agenda


• LTO8MediaStatus– Sonyshipments(newformulation)expectedtocommenceinJuly(limitedavailability)– Negotiationsongoingre:Fujifilm– SL8500,SL4000,SL3000,andSL150supportLTO8andsupport/formatM8(LTO7mediaat9TB)

• ACSLSUpdate– 8.5released(SL4000support,M8support)– Linux6.8,Linux7.3support– Solaris11.3,Solaris11.4support– RunACSLSinsideSL4000(Linux)– “Warmstandby”andHA

5

PortfolioandMarketUpdate

Copyright©2019,Oracleand/oritsaffiliates.Allrightsreserved.| 6

ArchivingwithOracleHSM

• Endtoenddataintegrityvalidation(DIV)

• FileFixity• Openformats• HighAvailability• RemoteArchiving• Encryption KeyManagersupport

EnsureAccess

ü• Policybasedmovement• Capacityscalability• Horizontalscaling• Automatedmediamigration

• Minimalchangestotheapplication(standardNFS,CIFS,Swift)

• TieredStorageincludingflash,disk,objectcloud,andarchivecloud

• PrivateStorageClouds• Nosoftwarefee/TBasyougrow

LowerCosts ImproveEfficiencies


ArchiveStrategyOption1:On-PremiseStorageArchive

TapeArchive

PrimaryStorage

Applications

Ope

nStack

SwiftAPI

StandardPOSIXFile

System

API


ArchiveStrategyOption2:Hybrid-StorageCloud

TapeArchive

PrimaryDisk

CloudStorage

Applications

Ope

nStack

SwiftAPI

StandardPOSIXFile

System

API


TechnologyChoicesTodayandTrends• Tape’scostadvantageisexpectedtocontinuetogrow• Cloudisattractiveforoffsite,coldstoragebutcloudhas access fees

9

Technology Acquisition$/PBforOn-Prem;(Annual $/PBforCloud,Add’lfeesforaccess)

Annual $/PBDeclineTrend

SSD $5M 25-30%

Tier1Disk $1.5M <20%

Tier2 Disk $0.5M 20-25%

CloudArchiveTier $0.03M TBD

Tape $0.02M 30-35%

• StorageOutlookbyHorison InformationStrategies,IDC,andGartnerPower,cooling,floorspace,service,operationalcosts,etc.areadditional


TechnologyPricingTrends

10

https://jcmit.net/diskprice.htmhttps://jcmit.net/flashprice.htm


OracleHSM6.0andbeyond―withtapeI/OhorizontalscalabilityTapeI/OHorizontalScalability

StorageTek QFSClient

MetadataServer(MDS)

PrimaryDisk

TapeStorageTier

Orange=metadata/controlpathDarkBlue=diskdatapathRed=tapedatapath

• MetadatacontrolledbyMetadataServer(MDS)

• MDSandQFSclientsread/writetodisk• I/Ofortaperead/writecomesfromMDSandStorageTek QFSclients

• Nobottleneck―I/Oloadspreadevenlyacrossallservers

11


• Copydatatoaremotelocationdirectlytoatapelibrary

• Copysamfsdump fileandarchivelogstoremotesite• RemotetargetisatapelibrarywithinFCdistancesandpartoftheFCSAN

RemoteArchivingWithinFCDistancesForDisasterRecovery

Copy1TapeArchive

RemoteTapeDevice

StandbyHSMServerandDiskcachePrimary

HSMServer

Copy2TapeArchive

Content

samfsdumpandlogfiles

FC

IPorFC


• Copydatatoaremotelocationusingdiskarchive

• Copysamfsdump fileandarchivelogstoremotesite• RemotetargetisadiskarchivewhichisanHSMfilesystemthatisNFSmounted

RemoteforLongDistancesUsingTCP/IPForDisasterRecovery

Copy1TapeArchive

HSMServerandDiskcache

PrimaryHSMServer

Copy2DiskArchive

Content

samfsdumpandlogfiles

IP

IP


ArchitectureofOracleOptimizedSolutionforSecureTieredStorageInfrastructureandaPrivateStorageCloud

FCNetwork

OracleHSM

StorageTek SL4000StorageTek LTO8Drives

OracleOptimizedSolutionforSecureTieredStorageInfrastructureCustomerOpenStackSwiftClients

OpenStackSwiftSwiftProxyandStorageNodes

StorageTekQFSClients

OpenStackSwiftAPI

Flash,Disk- OR–

OracleZFSStorageAppliance

OpenStackSwiftAPIOpenStackSwiftAPIOpenStackSwiftAPI

14


Customer-ManagedSelectiveCloudEncryption

• PKCS#11keymanagementinterface• Customerownskeys(OKM,OKVorotherkeymanagementsystems)• Encryptiondoneinmemory• ObjectStorageandArchiveStorage

15

Enhancedsecurity– dataisencryptedbeforebeingsenttoOracleStorageCloud


OracleHSMAutomatedMediaMigration

16

Leveragehigherdensityformatswiththeefficiencyofautomaticmigration

Migratesmultipledatastreamswithoutimpactingproduction

CanbeusedforacceleratedtapevolumecopyusingOSmemory

Policy-basedforautomatic,behind-the-scenesmigrationincludingtotheCloud


AccelerateMigrationwithOracleHSMAutomatedMediaMigration

1717

FasterMigration withOracleHSMandMemory-AssistedCopy

• Copytomemoryandthentotape• Bypassdiskforfastermigration•Migratefourstreams(default)

ctrl

data

ctrl

data

HSM


Migrate AllDataorRepack aPortionofDataAutomatedMediaMigrationFeatureatScale

18

• Repack onlyactivesourcefilessequentially toasinglecartridge

•Migrate entirecontentsofmultiplecartridgestoasinglecartridge

Migrate Repack

Active

ExpiredActive

ExpiredActive

Expired

ActiveActiveActive

ctrl scsi/status

data

Active

ExpiredActive

ExpiredActive

Expired

Active

ExpiredActive

ExpiredActive

Expired

ActiveActiveActive

ActiveActiveActive


OracleHSMCloudIngestLeveragesMediaMigration• Copytomemoryandthentocloud• Bypassdiskforfastermigration• Migrateparallelstreams• Addingretentionofthesourcecopyforallmemorymigrations.

19

OracleHSMandMemory-AssistedCopy

ctrl

data

ctrl

data

HSM

Object/Archive


FixityChecking

• Amechanismusedbydataarchivistsandpreservationiststoensuretheintegrityofadigitalobject

• Assureadigitalobjecthasremainedunchanged,isconstant,andisstable

Fixity


Fixity

• Theprocessusedtoverifythatadigitalobjecthasnotbeenaltered

• Fixitychecksareruneachtimeanobjectistransferredorcopiedbetweenstoragetiers

• Fixitychecksidentifieschangestoanobject• Resultsoffixitychecksallowsarepository

toidentifycorruptedfilessocorrectiveactioncanbetaken- Replacetheobjectwithanalternative,known

copy- Identifythecauseandpreventarepeat

• Fixitycheckingalonedoesnotensurethepreservationofadigitalobject

FixityChecking


DataflowofSettingandUsingFixity

• IngestData•Writetodiskcache

•Runssum orAPI•Calculatethehashandstore•ORcalculateandcomparewithgivenhash•Updateattributes

•Accessfileforarchive•Validate

•Accessfileforstage•Validate

21 43 5 6

•Archivetotape

•Stagetodiskcache


WhatHappensIfThereIsAMiss-Match?• OnArchive– Thefilewillnotbearchived– Amessageiswrittentothelogfile

• OnStage– Thefileisnotreturnedtothediskcache– Amessageiswrittentothelogfile

23


OracleHSMEnsuresLongTermAccesswithFixitySupport

Verifieschecksumoneachread,write,orcopyofafile

MD5

SHA-1

SHA-256

SHA-384

SHA-512

Eachread

Eachwrite

Eachcopyofafile

Unchanged

Constant

Stable

Supports Verifies Validates


SearchingandIndexingviamoduledeliveredthroughServicesEngagementOracleHSM– WebCenter ContentIntegration

VerifiesfileisarchivedbyHSMbeforeitconsidersitstored

PoliciessetinWCCflowtoHSM

WCCknowsiffileisbeingrecalledfromdiskortape

EnsuredArchival

UnifiedRetention

StageAwareness LTStorage

SolutioniscompatiblewithOAISmodel


OracleHSM:LookingBack

DIV

WORMenhancements

Stagerenhancements

HorizontalScaling

Cloud

AutomatedDIV

LTFSImport/Export

MediaMigration

Fixity

ExpandedLUNSize

ExtendedAttributeMetadata

5.32012

6.02014

6.12016Upto5.2

Archive

Virtualization

Automation

MigrationtoCloud

CustomerManagedCloudEncryption

HighPerformanceCopy(memoryassistedcopy)

6.1.32018


MediaMigration• Acceleratesmigration

• FreesCPUcycles&personnel

FixityEnhancement• Supportsstandardchecksumalgorithms

• Verifiesfileintegritythroughoutentirelifecycle

ExtendedAttributeMetadata• Improvesfilesystemperformancebymovingextendedattributedatafromdiskcachetometadatatier

ExpandedLUNSizeto128TB• Supportshardwareadvancements

• Increasesdiskcachescalabilityto32PB!

OracleHSM6.1


MaxLUNSizeIncreased8x

28

16TBLUN4PB

128TBLUN32PB

PriortoOracleHSM6.1

OracleHSM6.1


CloudEnablement&HW/SWSupportFeature Release Comments/Recommendations

MigrationtoCloud 6.1.3 Ingestviainternet.Migrate existingtapedataintocloudoverinternet

SelectiveCloudEncryption 6.1.3 Security – customerrequirement

UseOracleHSMasaCloudTierofStorage 6.1.3 AlsoaSAM-REMOTE improvement

StorageTekSL4000 support 6.1.3 Sync withHWrelease

Expanded SL150librarysupport 6.1.3 Sync withHWrelease

High PerformanceTapeCopy 6.1.3 Uses tapemigrationmemory-assistedcopy

LTO8support 6.1.3 SyncwithHWrelease

OEL7.3Support(w/kernel3.10) 6.1.3 ContinuousLinux Integration

6.1.3

Confidential– OracleHighlyRestricted


OracleHSMCloudIngestLeveragesMediaMigration• Copytomemoryandthentocloud• Bypassdiskforfastermigration• Migrateparallelstreams• Addingretentionofthesourcecopyforallmemorymigrations.

30

OracleHSMandMemory-AssistedCopy

ctrl

data

ctrl

data

HSM

Object/Archive

6.1.3


Customer-ManagedSelectiveCloudEncryption

• PKCS#11keymanagementinterface• Customerownskeys(OKM,OKVorotherkeymanagementsystems)• Encryptiondoneinmemory• ObjectStorageandArchiveStorage

31

Enhancedsecurity– dataisencryptedbeforebeingsenttoOracleStorageCloud

6.1.3


UseOracleHSMasaCloudTierofStorageProvidesabetterremoteoptionthanSAM-REMOTE

32

cloud interface

DiskStorage

ArchiveStorageDiskStorage

ArchiveStorage

Second/RemoteSite

PrimaryOracleHSMsitewritesdatatosecondOracleHSMsiteusingcloudinterface

PrimarySite

6.1.3


6.1.3HW/SWSupportUpdates

SL4000 ExpandedSL150 LTO8 Oracle

Linux7.3


OracleHSMNextDiscussion(Shortterm)• Solaris11.4support– libc SRU

• M8mediasupport• Linux7.6support• ~40bugfixes• Filesystemrecoveryoptimizations

34


ShortTermFutureOracleHSM• Solaris11.4support– Had towait forSRUwithafixtolibC

• M8mediasupport– „Large“LTO7media

• Linux7.6support• ~40bugfixes• Filesystemrecoveryoptimizations

35


OracleHSMNextDiscussion(Longterm)• LTO9• Clientupdates• Ordering• Service• Transitionchoices– HSMisbuiltwithopenstandards,includingtarformatontape

36


LongTermFutureofOracleHSM• LTO9 mediasupport• Clientupdates– Besteffort only

• Ordering• Service• Transitionchoices– HSMisbuiltwithopenstandards,includingtarformatontape

37


39

Documents

Oracle HSM - konferenz-nz.dlr.dekonferenz-nz.dlr.de/pages/samfs2019/present/1... · Oracle HSM 6.0 and beyond ―with tape I/O horizontal scalability Tape I/O Horizontal Scalability