Upload
agcristi
View
384
Download
3
Tags:
Embed Size (px)
Citation preview
Informed Decision MakingShailesh MungikarSr. Staff Engineer, Business Intelligence Group, Sybase, Inc.
Sybase Confidential Proprietary.
Sybase Confidential 2
Informed Decision MakingFrom Fairy Tale to Nightmare
I absolutely need to
understand how my
company behaves
OK guys,Let’s see how we can satisfy
our users
IT will analyze the problem using its own vision…
We will need an ETL to
store the data in our
RDBMS.
We will need a query tool to retrieve the
data from our RDBMS.
…And will use the company’s standard RDBMS
Well, IT built something that
works, but…
…what is the exact cost of this ?The infrastructure is very expensive.We have a very few users and they
complain …
•The data are not frequently refreshed.•The performance is low.•Users cannot query what they need
Sybase Confidential 3
Information Evolution in a Data Warehouse
Sybase Confidential 4
Decisional
Strategic Reports(High marginal cost per user)Pre-Planned queries Management Dashboard
OperationalData Reconciliation
Risk Position
Fraud Detection Basel II & Regulation Compliancy
Trading
Cross-Selling
Marketing Campaign Analysis
Ad-Hoc Queries
Business Performance Monitoring
Operational Datawarehouse(Low marginal cost per user)
Shifting from Decisional to Operational
Sybase Confidential 5
What does the shift mean for data warehousing technology
Business Intelligence today is mission critical. It is used to drive strategic, tactical and operational decisions.
Increased query demand – predefined to ad-hoc Many more users out there – 100s to 1000s Reduced latency windows – overnight to intra-day Increasing data volumes – data explosion to terabytes Maintenance costs increasing – data volumes & administration
The technology supporting BI today must provide speed, scalability, flexibility and availability at a low operating cost.
Sybase Confidential 6
The issue is about using something to do what it was designed for…..
Rather than starting with something that was not and creating a monster!
What does it mean for IT
Sybase Confidential 7
Informed Decision Making
DataIntegration
AnalyticsServer
Reporting
Analytics
Ad-hoc
Custom
OperationalSystems
Infrastructure forInformed Decision Making
Applications to assistInformed Decision Making
Sybase Confidential 8
Data Integration Using Multiple Techniques in Tandem
COSMOS
Smart Stream
ESA
Others
Staging Area
Data Warehouse
Desktop Handheld
DW
Staging
Tables
ReportingTools
DataMiningTools
Dashboards/Portals
M-Business Mobile Server
WiFi GPRS
Sources
Star Schema
Data Storage Presentation PresentationData Acquisition
Data Cleanse/
Transform
Replication
ETL
Replication
ETL
ASIQ Bulk Load
Sybase Confidential 9
Data Integration Suite
Comprehensive technique coverage
Integrate any kind of heterogeneous data source
Easy to develop, deploy and maintain
Data Integration SuiteFor Heterogeneous Environments
Search
ETLReal-Time
Events
DataFederation
EIIReplication
Fede
ratio
n
Consolidation
Distribution
Sybase Value Proposition
Integrated Administration
Integrated Modeling, Metadata and Development
Available Today
Available as DI Suite Q4’07
Sybase Confidential 10
Typical Customer Configuration For Analysis
InformationManagementEnvironment
Internal Feeds External Feeds
DataSourcesMurex Midanz CICS-MM DLD TPS Reuters Bloomberg
Users
End-UserAnalytics
Workstations Reports Laptops MobileComputing
Market Risk Credit Risk Treasury Sales
Modeling& AnalyticsEnvironmentAnalytics Engines Risk Engines Rates Engines
ETL ETL ETL
Multiple Datamarts –Duplicated• Deal Data• Market Data• Customer Data• Rates
Specialty analytics store capable of handling large volumes of data and servicing in real-time complex queries for risk management
Single Risk Datamart:• Deal Data• Market Data• Customer Data• Rates• Calculated Values
Information delivery to heterogeneous users and devices
InformationDelivery
Multiple users of datamart with different views all accessing same reference data
Extract / Transform / Load (ETL) Tool
Information Delivery
Sybase Confidential 11
What is Sybase IQ?
Sybase IQ is a highly optimized analytics server, designed specifically to deliver ultra-high-speed business intelligence & reporting on standard
hardware and operating systems
It delivers for today’s operational BI needs …
high speed data loads for analytics
exceptional query performance
ad hoc query performance up to 100x faster than a row based RDBMS
dramatically lower TCO by reducing performance overhead, storage costs & maintenance requirements
“Sybase IQ stores data very efficiently, produces results much faster and puts less pressure on our processors. It gives us great capacity to accommodate growth.” - BNP Paribas
Sybase Confidential 12
Hong Kong Housing Society
SOLUTION Sybase IQ, Sybase ECDA
RESULTS 93% reduction in data preparation time for BI reporting Up to 70% data storage saving Report generation is 16x faster
CHALLENGEExtraction and transformation of data from ERP system data takes takes more than 24hrsInstead of daily, batch reporting run limited to twice a week
Sybase Confidential 13
JDE SAN Mirror
BO Report
DW Database
Over 30 hoursProd DB 11GB
Within 2 hoursProd DB 3 GB
DW Database
Hong Kong Housing Society Architecture
16 x Faster
Sybase Confidential 14
Internal Revenue Service (USA)
CHALLENGE Needed a data management and analytics system to supply users across the country
with relevant, timely and accurate data, amassing up to 10 years of business and individual return raw data.
RESULTS Delivers standardised data in an integrated environment for decision making Reduces load and maintenance times Provides 70 percent compression rate Delivers three to five times faster query responses Easy to manage
SOLUTION Sybase IQ, Sybase ASE
Sybase Confidential 15
Compliance Data Warehouse Infrastructure
Database Server (Sybase IQ)
Application Server (SAS, SAS Enterprise Miner, Hyperion Intelligence)
Shared Storage (72 Terabytes)
IRS Network IRS Network
SPSS Access SQL Hyperion SAS
Sybase Confidential 16
US Securities and Exchange CommissionMission Critical Analytics
CHALLENGE Need a more efficient means to provide disclosure of important securities information
Needed a more efficient means to ensure securities laws
RESULTS New data warehouse built in less than 12 months 25% reduction in “off hour” data loads 35% improvements in query response time The ability to create and run more complex queries Disaster recovery capabilities with under 1 minute failover No unplanned down time Now incorporates documents and emails (unstructured data) into analysis with structured
data Accommodates future growth
SOLUTION Sybase IQ, Sybase ASE
Sybase Confidential 17
Sybase, Inc.
Creating an Information Edge — Today Open, cross-platform software solutions that
securely deliver information anytime, anywhere
Strongest portfolio of information management and enterprise mobility solutions in the market
The world’s most critical data in commerce, communications, finance, government and healthcare runs on Sybase
~4,000 employees in 60 countries
Profitable and growing
Sybase is the largest global enterprise software company exclusively focused on managing and mobilizing information, from the data center to the point of action.