View
222
Download
1
Category
Preview:
Citation preview
Acquiring Big Data
Xavier Verhaeghe | Vice-President Emerging Technologies & Security Solutions Leader |
| Oracle Europe, Middle-East & Africa |
MOVING OPPORTUNITY FOR IT
MOVING FROM BEING TOO LATE RESPONDING TO REQUESTED URGENT BUSINESS NEEDS
TO BEING PROACTIVE IN DRIVING NEW
OPPORTUNITIES
DATA EXPLOSION: REAL USERS & INTERNET OF THINGS
TRADITIONAL DATA SOURCES
Billing
engines
Custom
developed
NEW DATA SOURCES
Billing
engines
Custom
developed
What Makes it Big Data: The 4 Vs Principle
6
VOLUME VELOCITY VARIETY VALUE
SOCIAL
BLOG
SMART
METER
1011001010010
0100110101010
1011100101010
100100101
• NETWORK USAGE
• CALL DATA RECORDS
• SMS DATA
• SURFING BEHAVIOR
• BANDWIDTH USAGE
• COMMUNICATION FAULTS
• USER PROFILES
• SENSORS (EG CARS)
• PORTALS
• CRM DATA
• BILLING DATA
• ORDER MANAGEMENT
• DIGITAL TV DATA
• WIFI-HOTSPOTS
• DEVICE PROFILING
• MOBILE PAYMENTS
• AUGMENTED REALITY SOURCES
• LOCATION BASED DATA
• GPS DRIVING DATA
• HEALTHCARE DATA
• CONTRACTS
• BLOGS
• SUPPORT LOGS
• INTERNAL SOCIAL MEDIA
• EXTERNAL SOCIAL MEDIA
• QR CODE DATA
• CALL CENTER LOGS ...
ALL DATA SOURCES AND
THE BLEND OF ALL THIS DATA
Make Better Decisions Using Big Data
Big Data In Action
ANALYZE
DECIDE ACQUIRE
ORGANIZE
Acquire all available data
Big Data In Action
ANALYZE
DECIDE
ORGANIZE
ACQUIRE
Two Sets of Characteristics
Batch-Oriented Real-Time
Process data to use Deliver a service
Bulk storage Fast access to specific record
Write once, read all Read, write, delete update
Best Choices
Hadoop Distributed File
System (HDFS)
Oracle NoSQL Database
File System Database
Parallel scanning Indexed storage
No inherent structure Simple data structure
High volume writes High volume random reads
and writes
Hadoop Architecture
Management/Monitoring
HADOOP DISTRIBUTED FILE SYSTEM (HDFS)
MapReduce
Distributed file system Map/Reduce programming paradigm Highly scalable data processing
HDFS Overview
Distributes Data on Cluster Multiple Copies Add Nodes to Scale
HDFS Use Cases
• Click stream storage and analysis
– Number of web sessions lasting more than X minutes
– Most/Least frequently browsed pages
– Group session times by hour of day and source location
• Sentiment analysis
– How many comments contain the word(s) or phrase(s)
• Relationship discovery
– What items appear to be related in time or proximity
– How many times does X and Y happen in proximity
Oracle NoSQL Database
Nodes East
Nodes West
Nodes Central
NoSQL Driver
Application
NoSQL Driver
Application R
ea
d
Dele
te
Rea
d
Upd
ate
Distributed key-value database
Simple programming model
Scalable throughput
Commercial software and support
Easy management
Oracle NoSQL Database
• Replicated Application Servers
• Driver linked into each Application
• Data Nodes kept current
• Storage Nodes across Data Centers
• Automatic Storage Node failure handling
– Graceful degradation
– Automatic recovery
• No Single point of failure
Enterprise Topology
Oracle NoSQL Database Use Cases
• Data capture
– Sensor data capture (i.e. IA, SmartGrid, Earth Sc., BioMedical Sc.)
– Statistics & network capture (QOS Network Mgmt)
– Web applications (click-through capture)
– Backup services for mobile devices
• Data services
– NoSQL data sharing (Earth Sci, BioMedical)
– Scalable authentication
– Real-time communication (MMS, SMS, routing)
– Social Networks, Personalization
Oracle NoSQL Database Differentiation
• Seamless integration with Oracle stack
• Commercial grade
• Scalable
• Simple programming model
• Easy management
BIG DATA APPLIANCE
•Oracle Linux 5.6
•Java Hotspot VM
•Cloudera Hadoop Distribution
•R Distribution
•Oracle NoSQL Database Community Edition
•Oracle Big Data Connectors
Oracle Big Data Appliance Software
RELIABILITY PERFORMANCE
MANAGEABILITY
SECURITY
SUPPORT
Oracle NoSQL
Database
HDFS
Enterprise
Applications Oracle Data Integrator
Oracle Big Data Connectors
Hadoop (MapReduce)
Oracle Integrated Solution Stack for Big Data
ACQUIRE ORGANIZE DECIDE
Analytic
Applications
ANALYZE
In-D
ata
base
An
aly
tics
Data
Warehouse
Exadata Exalytics
Usage Model
ACQUIRE ORGANIZE DECIDE ANALYZE
Big Data
Appliance
Acquiring Big Data
• Right place for your data
– HDFS
– NoSQL
– Relational
• Uncover value with analysis
TELCO DIFFERENT POTENTIAL USE
CASES
B2C MARKET OPPORTUNITIES
BETTER MARKET KNOWLEDGE
• USER PROFILING
• BETTER AND REAL TIME CHURN ANALYSIS
• CUSTOMER EXTENDED NETWORK VALUE
• SENTIMENT ANALYSIS
BETTER USER EXPERIENCE
• BETTER TARGETED CUSTOMER SERVICE
• SUPER FAST INFO ACCESS
• BETTER INTEGRATED SERVICES WHERE, WHEN, WHY
• RELEVANT REAL TIME COMMERCIAL OFFERS
MORE SECURITY
• NETWORK FRAUD ANALYSIS
• USER SECURITY SERVICES
• CONTENT, CONTEXT AND DEVICE AWARE ALERTS
B2B MARKET OPPORTUNITIES
DATA VALORISATION SERVICES
• SELLING USER PROFILE DATA
• CUSTOMER EXTENDED NETWORK VALUE
• SENTIMENT ANALYSIS
• BLENDED LOCATION BASED & PROFILE DATA
• GPS ENHANCEMENT SERVICES
• MARKETING AND STORE LOCATION BASED ADVISORY
• MARKET & TREND ANALYSIS
• DEVICE USABILITY ANALYSIS
IT & BUSINESS SERVICES
• BIG DATA INFRASTRUCTURE HOSTER
• BIG DATA SYSTEM INTEGRATOR
• BIG DATA MANAGED SERVICES (EG FOR HEALTHCARE)
• METERING SERVICES
SECURITY
EQUIPMENT
MANUFACTURER
FRAUD ANALYSIS
HEALTH
INSURER
INCREASED SERVICE
-
FRAUD ANALYSIS
UTILITIES SMART METERING ANALYSIS
-
TRADING SUPPORT
MEDIA COMPANY
REAL TIME EXPERIENCE
-
SOCIAL NETWORK TRENDING
-
AD VIEWING ANALYSIS
MEDIA COMPANY
FINANCIAL
SERVICES
REAL TIME EXPERIENCE
-
FRAUD DETECTION
MANUFACTURING PRODUCT FAILURE DETECTION
-
PATENTS RESEARCH
OIL & GAS ANALYSIS OF RIG SENSOR DATA,
SEISMIC & GEOLOGICAL DATA,
MANAGING COMPRESSOR DATA
TELCO
•Customer buys a new smartphone -> this goes
into regular systems
•Same customer starts playing with his new
smartphone, downloads an app. This info does
not end up in traditional systems.
•Consolidate this type of info in a NoSQL DB to
have a complete customer view (eg for call
centres)
(ONLINE)
RETAILERS
NEXT PURCHASE
RECOMMENDATIONS
-
STORE TRENDING
Recommended