20

S3 Deduplication with StorReduce and Cloudian

Embed Size (px)

Citation preview

Page 1: S3 Deduplication with StorReduce and Cloudian
Page 2: S3 Deduplication with StorReduce and Cloudian

Agenda

1

2

3

4

5

Introductions

UseCases

Question&Answers

ProblemswithLegacyDeduplication

MovingDeduplicationtoaCloud1stModel

Page 3: S3 Deduplication with StorReduce and Cloudian

About Cloudian

3

CLOUDIAN PARTNERS

TECHNOLOGY

GLOBAL PRESENCE

HQ:SanMateo,CA;OfficesinUS,Japan,China,EMEA

TOP TECHNICAL TALENTWithdeepexperienceinstorage,bigdata&enterprisesoftware

TOP TIER INVESTORSIntel,Fidelity,GoldmanSachs,INCJ

BORN IN JAPANBASED IN SILICON VALLEYTofixstorageproblemscreatedbyexponentiallygrowingdata

�2011

�$44M

�80

�Global

CHANNEL

Page 4: S3 Deduplication with StorReduce and Cloudian

About StorReduce

Firsts:• Firstcloudcentricdeduplicationengine• 1 of8 launchpartnersGoogleColdline• 1 of4 launchpartnersAmazonS3-IA

Clientson3Continents

HQ:Sunnyvale,CAOffices:USA&AsiaPacific

“WeuseStorReduceinproductionforamajorUShealthcarecompany.StorReducedoesexactlywhatitsaysitwill.It'smarketchanging.”BillYoung,DirectorProfessionalServices,Equinix

Page 5: S3 Deduplication with StorReduce and Cloudian

ProblemswithLegacyDeduplication

Page 6: S3 Deduplication with StorReduce and Cloudian

NotBuiltforCloud

LegacyDeduplicationbuilttosupportCIFS/NFS• RequireExpensiveDiskBasedsolutions• Dataislockedintoandaccessibleonlyfromtheappliance• Unabletohandlehighlatencyconnections• NotStateless• MakesmovingtotheCloudharder&moreexpensive

Page 7: S3 Deduplication with StorReduce and Cloudian

NotallDeduplicationisEqual

FixedBlockSizeslimitefficiencyRequireaScale-UpapproachNoGlobalDeduplicationacrossDatasetsDatabasesbecomefragmentedon-recoveryFragmenteddataincreasesstoragecosts

Page 8: S3 Deduplication with StorReduce and Cloudian

PollIfyoucouldreuseyourbackupdata,howwouldyouuseit?DataMiningSearchDev/Test

Page 9: S3 Deduplication with StorReduce and Cloudian

IntroducingStorReduce withCloudianACloudFirstApproachtoDeduplication

Page 10: S3 Deduplication with StorReduce and Cloudian

10

CloudReadyBackups

Page 11: S3 Deduplication with StorReduce and Cloudian

11

CloudFirstDeduplication

StorReduce deduplicates S3streamsofdataPerfectfor:• PrimaryBackupData• TapeReplacement• HybridStorage• DatabaseBackups• HadoopBackups• OtherUnstructuredData

• VariableBlockDeduplication• ReduceNetworkBandwidthandDataStorage

• RemoteOfficeFriendly

Page 12: S3 Deduplication with StorReduce and Cloudian

StorReduce is…

Fast1400MBps/Instance,Inline&Multi-Threaded

StatelessAllData&MetaData storedinCloudian/PublicCloud

Scalable80PB/Instance

UnlimitedInstances

SoftwareDefinedDeployasVM,DockerContainerorRPM

SecureClientSideEncryption

orS3SSE

EnterpriseReadyHighAvailability,Read

Replicas&CloudReplication

Page 13: S3 Deduplication with StorReduce and Cloudian

CloudianScale-Out

13

HyperStore:ScaleOutPerformance&Capacity

CommodityServers ScaleOut Durable SimpletoUse

HeterogeneousNodes

500TB+Usable

Multi-Rack,Multi-Datacenter,Multi-Region

100TB+Usable

StartSmall&Expand

3PBUsable

Page 14: S3 Deduplication with StorReduce and Cloudian

StoragewithoutCompromise

REPLICATION(RF=1,2,3,4)

ERASURECODING(N+1,2,3,4)

CONSISTENCY(StrongorEventual)

PoliciesAppliedperBucket• ChooseDurability• ErasureCoded• Replicated

• ChooseGeographicAvailability• OneDatacenter• MultipleDatacenters• ReplicatedErasureCodes

• Plus+• StrongorEventualConsistency• TiertoAmazonS3orGoogleCloudStorage• Encryption

EncryptionSSEorSSE-C

GeographicDispersionAssignCopiesperDC

Page 15: S3 Deduplication with StorReduce and Cloudian

NewEconomicsofDeduplication

JBODStorReduce $0.07/GB

CloudianHyperStore$0.25

*BasedonAnalystreportedStreetPriceforObjectStorageandDeduplicationAppliances

JBOD

CPU/ControllerCloudian&StorReduce$0.32/GB

DataDomainorNetAppAltaVault

$1.00/GB• 66%CostSavingsincludingHardware• Payforwhatyouneed• NoForkliftUpgradeevery3-5Years

Page 16: S3 Deduplication with StorReduce and Cloudian

PollWhatisyourcurrentBackupApplication(s)NetBackupCommVaultIBMSpectrumProtect(TSM)VeeamOracleRMAN

Page 17: S3 Deduplication with StorReduce and Cloudian

UseCasesACloudFirstApproachtoDeduplication

Page 18: S3 Deduplication with StorReduce and Cloudian

18

NetBackup

NetBackupv7.7EnablesS3Backups• Full/IncrementalOnly• V8.0noannouncedsupportforDedupe

Clients NetBackupMediaServer(s)

StorReduce

CloudianHyperStore

Page 19: S3 Deduplication with StorReduce and Cloudian

19

Commvault

Clients CommvaultMediaAgent(s)

StorReduce

CloudianHyperStore

DeduplicationpoolbecomesfragmentedGarbagecollectionissuesonobjectstorage

Page 20: S3 Deduplication with StorReduce and Cloudian

Questions?ThankYou

www.cloudian.com

CloudStorageforEveryone