View
624
Download
0
Embed Size (px)
Citation preview
THE LONG DOG LEASH Information Management Challengesin the Digital Enterprise
Agenda
Key Concepts
The Long Dog Leash
The Enterprise Data Hub
Case: Innovate
Case: Renovate the core
Conclusions, takeaways
BS Bingo!
A look in the mirror?
Operational Systems
MDM
Data Governance
Innovation
Decision Support
BIODS Analytics
Everyone is BI?
Apply traditional IT mentality to next-generation applications and services
Failing to adopt new technologies
75% of enterprises
admit to havingthis need
50%
willfail
Organization
Application Architecture
Information Architecture
IM Challenges
Organization
Application Architecture
Information Architecture
IM Challenges
ALREADY EXISTS: LEGACY IT
ENVIRONMENT, LED BY CIO
OFTEN SILOS BUT UNDER CONTROL.
KNOWN TECHNOLOGIES AND ROBUS
MOSTLY RDBMS TECHNOLOGIES, HIGH
AVAILABILITY IN OPS,SEPERATE DWH
MASTER DATA MANAGEMENT, DATA
GOVERNANCE, DATA QUALITY
LED BY CDO – CHIEF DIGITAL OFFICER.
SOMETIMES CALLED SHADOW-IT, SPIN-
OFFS, INNOVATION LABS, EXTERNAL
EXPERIMENTAL NEW TECHNOLOGIES,
POOR KNOWLEDGE, POOR SUPPORT
MOSTLY NEW TECHNOLOGIES (NOSQL,
HADOOP, APPLIANCES, CLOUD CLUSTERS..
BIG AND LOTS OF DATA, QUICK
PROCESSING, EXTERNAL DATA
Easy? Then why does it fail?
THE LONG DOG LEASH
InnovationTraditional
Process
Application
Information
Does this work for information management?
InnovationTraditional
Process
Application
InformationInformation
InnovationTraditional
Process
Application
Information
Agenda
Key Concepts
The Long Dog Leash
The Enterprise Data Hub
Case: Innovate
Case: Renovate the core
Conclusions, takeaways
Definitions
An enterprise data hub, also referred to as a data lake, is a new big data management model for big data that utilizes Hadoop as the central data repository.-- Whatis.com --
Enterprise data hubs are designed to address the challenge of data that is ballooning in volume, variety and velocity (3Vs). This term is largely associated with Cloudera and MapR.
-- Whatis.com --
Vendor Enterprise Data Hub (EDH)
The Essence
Enterprise
Data
HUB
YOUR ENTIRE ORGANIZATION. NOT JUST A PART OF IT.
ONES AND ZEROES.
THE CENTRAL PART OF A WHEEL. WHERE SPOKES ARE INSERTED.
THE CENTRAL PART OR AXLE END FROM WHICH BLADES RADIATE
A CENTER AROUND WHICH OTHER THINGS REVOLVE.
A DEVICE FOR CONNECTING COMPUTERS IN A NETWORK.
True EDH Architecture
0
Data Governance
Data Quality
Master Data Management
Data Security
API
0
...Innovation DMZOpen DataCommodity AnalyticsOperational
API
Operational Systems
Big Data Cluster BI Platform Cloud StorageNew Repositories
(Column, Graph, )
Data Integration Layer
Agenda
Key Concepts
The Long Dog Leash
The Enterprise Data Hub
Case: Innovate
Case: Renovate the core
Conclusions, takeaways
CASE 1: INNOVATIE – PROJECT BACON
Goals
Count the number of commuters at stops or on buses
Gather statistics on usage and duration
Track actual user routes
Deliverables
Tracker SDK for Android
Out of the box beacon detection and communication to backend
Integrates with existing applications.
Demo application
Uses Tracker SDK
Commuter functionality: check for vacant seats on a line… and perhapswait for the next bus
Technical Implementation
Technical Implementation
Results
ResultsCommuter/Device identifier
Ping: I just saw a beacon with major 1 (type stop) and minor 5 (stop identifier)
Results
Route Optimization
Transfer Descend
Route Optimization
Commuterperspective
Adherenceto schedule
Agenda
Key Concepts
The Long Dog Leash
The Enterprise Data Hub
Case: Innovate
Case: Renovate the core
Conclusions, takeaways
CASE 2: RENOVATE
Renovation and Innovation
Renovate Innovate
BUDGET
B2B B2C
Data Migration
Data Migration
Confidential
Data Migration Approach
Example Business Entity and High Level Requirements
Example Business Entity and High Level Requirements
Example Business Entity and High Level Requirements
Data profiling
Realistic goals
Alternatives
Decision log
Automation of quality standards
CRUCIAL IN OBJECTIVE MEASUREMENT OF
ITERATIVE MIGRATION
ESSENTIAL TO INCORPORATE IN DATA GOVERNANCE
AFTER PROJECT
Insights and Added Value
Formal method for establishing data quality requirements
Formal embedding in Data Governance of the organization
Automated periodical reports for management
Direct alerting (treshold bases or individually blocking)
Business ownership for data determined (MDM)
• Who are the correct stakeholders to include in projects
Baseline for quality
Estimated efforts for all kinds of scenarios (also ones that weren’t used)
Agenda
Key Concepts
The Long Dog Leash
The Enterprise Data Hub
Case: Innovate
Case: Renovate the core
Conclusions, takeaways
THE LONG DOG LEASH
InnovationTraditional
Process
Application
Information
Pitfalls
Pitfalls
Pitfalls
Innovation MaturityGateway
Innovation MaturityGateway
Innovation MaturityGateway
Innovation MaturityGateway
Pitfalls
Innovation MaturityGateway
Innovation MaturityGateway
Innovation MaturityGateway
Innovation MaturityGateway
Pitfalls
Pitfalls
Innovation MaturityGateway
Innovation MaturityGateway
Innovation MaturityGateway
Innovation MaturityGateway
Pitfalls
DQMDM
TAKEAWAYS
The Long Dog Leash
Gateways and Maturity Cycle
It’s more than technologies
Dont build a Frankenstein monster
Play bullshit bingo, but don’t get hustled
The earth is not the center of our solar system
Recycle and Share Best Practices and Insights
… and tomorrow?Does renovation improve innovation?
Does innovation challenge yourtraditional IT?
INSIGHTS ON A STRATEGIC LEVEL THAT
COULD/SHOULD BE SHARED?
WON’T ISSUES IN THE TRADITIONAL
ENVIRONMENT HAVE A SIMILAR EFFECT ON
YOUR INNOVATION?
Think two steps further down the line.
NEW REQUIREMENTS FOR YOUR ESTABLISHED
DATA? IS LACKING MATURITY IN ESTABLISHED
SYSTEMS AN IMPEDIMENT FOR INNOVATION.
HOW WILL EXISTING ISSUES IMPACT
INNOVATION (FURTHER DOWN THE ROAD?)
MAKE INFORMED DECISIONS ABOUT THE
INNOVATIVE PROJECTS EVER REACHING THE
RIGHT LEVEL OF MATURITY (PASS THE
APPROPRIATE GATEWAYS)
Thank you!