Upload
rainstor
View
108
Download
1
Tags:
Embed Size (px)
DESCRIPTION
What is an Archive? Industry Trends Key Requirements Best Practices Customer Examples
Citation preview
RRain
1
Archive is a No Brainer
Speakers & Topics
2
Philip Howard, Research Director Bloor
Deirdre Mahon, VP Marketing RainStor
§ What is an Archive § Industry Trends § Key Requirements § Best Prac>ces § Customer Examples
Database archiving
Philip Howard Research Director, Bloor Research
telling the right story Confidential © Bloor Research 2013
Agenda
" What is database archiving?
" Why is it increasingly important?
" What sort of features do you need?
" What trends do we see and what differentiates products?
telling the right story Confidential © Bloor Research 2013
What is database archiving?
Online, low cost, highly compressed storage that requires no change to access methods
Not back-up Not e-mail archive
Not CSV or XML files
telling the right story Confidential © Bloor Research 2013
Two scenarios
Access support for originating application
SQL support
telling the right story Confidential © Bloor Research 2013
Why is database archiving increasingly on the agenda?
" Availability of cloud-based archiving
" Availability of Hadoop/HDFS-based archiving
" Synergy with data migration
telling the right story Confidential © Bloor Research 2013
What you need 1
You need to know what data to archive
telling the right story Confidential © Bloor Research 2013
What you need 2
You don’t just archive a record, you archive all the other data related to that record – to preserve referential integrity – which means discovering
and understanding business entities in their entirety.
telling the right story Confidential © Bloor Research 2013
What you need 3
" High compression rates " Low cost storage
telling the right story Confidential © Bloor Research 2013
What you need 4
Loading and
access
Without indexes
telling the right story Confidential © Bloor Research 2013
What you need 5
Information Lifecycle Management not Industrial Light & Magic
telling the right story Confidential © Bloor Research 2013
What you need 6
telling the right story Confidential © Bloor Research 2013
The trend towards Hadoop
But Hadoop/HDFS is insufficient on its own because the compression is not good enough
and neither is the security
telling the right story Confidential © Bloor Research 2013
Other trends
" Compression will (almost) become commoditised (but not yet)
" Deployments will built on top of Hadoop/HDFS or in the cloud (or both)
" In data warehousing environments data virtualisation (federation) will be used to interconnect warehouses, marts and archives
" Differentiation will focus on: " Ease of establishing what data to archive " Performance – both for loading and retrieval
telling the right story Confidential © Bloor Research 2013
Conclusion
" Database archiving looks more and more like a mandatory activity
" DIY approaches won’t cut it because of a) the work involved and b) because you won’t get either the cost savings or performance you could do
" Deployments will increasingly be on low-cost clustered hardware or in the cloud
telling the right story Confidential © Bloor Research 2013
RainStor®
18
Create Value from Your Historical Data and Meet Regulatory Demands.
The Data Archive
RainStor® -‐ Proven
19
20 of World’s Largest Communica>ons
Providers
15 Strategic Solu>on & Technology Partners
10 of World’s Biggest Banks & Financial
Ins>tu>ons
Drivers & Business Challenges Solved
20
10X ReducGon (Compared to tradi>onal) Cost
Deployed in 90 Days (End-‐to-‐end Solu>on)
Complexity
Meets & Exceeds (Industry & Regulatory) Compliance
Historical AnalyGcs (Standards-‐based)
Create Value
Archive Solu>ons Analy>cal Archive Compliance Archive
21
Comply
Analy>cal Archive: End-‐to-‐end
22
QUERY/ ANALYZE
SQL BI Tools; Hive, MapReduce
SCALE -‐ Any PlaWorm
COMPRESS LOAD/ VALIDATE
Billions Records/Day
10-‐40X (90%+)
AVAILABILITY ReplicaGon
DW Source
Move RETAIN /DISPOSE
Rules Based
IN STORE QUERY GOVERN
SECURE -‐ Enterprise-‐grade
Analy>cal Archive -‐ Key Capabili>es
23
QUERY GOVERN
§ Standard SQL 92, 99 § MapReduce, Pig, Hive § BI Tools
§ Rules based Data Disposi>on § WORM (17a-‐4) § Legal Hold § Record-‐level Reten>on § Audit Trail
DATA IN
§ Works with standard ETL § ODBC/JDBC Compa>ble § FastConnect™ for Teradata § Validate -‐ Fingerprint
STORE
§ Compression -‐ 20-‐40X § Immutable Data Model § Encryp>on & Masking § Authen>ca>on § Schema Evolu>on
CAPACITY BUY-‐BACK
INSTANT ACCESS NO FINES
SAVE YOU MONEY
Fits with Your Enterprise
24
EDW’S
Deployment PlaWorms
Scale-‐out NAS HDFS
Cluster / DAS
Cloud
Worm
Teradata -‐ Analy>cal Archive Solu>on
25
QUERY/ ANALYZE
SQL BI Tools; Hive, MapReduce
SCALE -‐ Any PlaWorm
COMPRESS LOAD/ VALIDATE
Billions Records/Day
10-‐40X (90%+)
AVAILABILITY ReplicaGon
TERADATA
FastConnect™ RETAIN /DISPOSE
Rules Based
GOVERN
SECURE -‐ Enterprise-‐grade
FastForward™
SEC 17a-‐4(f) Compliance Archive Requirements
26
Records stored in non-‐eraseable media (WORM)
Recording process must be verifiable
Fully Accessible to AuthoriGes & Backed-‐up
Records should be Recognizable & IdenGfiable
Downloadable to any acceptable medium
27
Global Financial Services Lower Compliant Data Reten>on Costs by a Decimal Point! Challenges § Cost: Data volumes in disparate trading
applica>ons growing at 70-‐100% / Year -‐ Storage costs rising @ 60% / Year
§ Compliance: Must provide performant EBS and other queries for SEC
SoluGon § A RainStor Archive for storing and repor>ng
against historical trade data § 13 years of history loaded from Sybase IQ § Daily feed from trading applica>on to RainStor § Runs on low-‐cost NAS Tier 3 storage and VMs § RainStor completely replaced Sybase IQ
ü 90% cost savings -‐ $5M ROI ü 6 Projects live -‐ 13 more in
progress.
90% Storage Cost Reduc>on
“ It’s like shrink-wrapping your data…forever!” – VP, Technology
Benefits ü 30X Data Compression ü 3X Faster Query Compared to Sybase
28
Retain Cri>cal Analy>cs Data at Lowest Cost
§ Ini>ally 60TB Offload Business & Compliance Queries
§ Run Na>vely on Hadoop SQL + MapReduce
40X Compression
RAINSTOR SOLUTION: Offload Historical Data from Teradata to RainStor
Meets SLAs for Business Query Savings on TD Licenses
Capacity Buy-‐Back -‐ $Millions Saved on Sopware & Hardware
Enterprise DW
FastConnect™ Dell Servers R720s
Cloudera Hadoop
400TB
ü ü ü
§ Gone through the pain so you don't have to. – Crea>ng an archive is not easy! – RainStor Makes it simple, cost effec>ve, compliant-‐ready & fast to deploy
§ Solving archiving problems for world leaders -‐ 10 years of proven experience. – Enabled customers to deploy cost efficiently without compromise – Support and service rated as world class by our customers
§ Technology soluGons that create business value. – Transforms archiving to be a strategic asset.
Why RainStor®
Thank You
30
Archive is a No Brainer