Embed Size (px)
Citation preview
SQLDay 2017
SQLDay 2017
Build Your Data Warehouse in the Cloud
Hubert K. Kobierzewski
Codec Systems
• BI Consultant in Codec-dss (nearly 10 years)
• Specialized in: Data Warehousing, ETL processes and Business Intelligence
• Ex-Developer
• MS SQL Server certified (MCDBA, MCTS, MCITP, MCSE –BI, ex-MCT)
• Member of Azure Advisors (internal MS group)
• Leader of Warsaw PLSSUG Chapter
• Azure Data Factory
• Toolset for ADF
• ADF Demo
• Azure AS Demo
• PBI Demo
• Summary
Cortana Intelligence combines the services you already know
Transform data into intelligent action
Intelligence
Dashboards &
Visualizations
Information
Management
Big Data Stores Machine Learning
and Analytics
CortanaEvent HubsHDInsight
(Hadoop and
Spark)
Stream
Analytics
Data Intelligence Action
People
Automated Systems
Apps
Web
Mobile
Bots
Bot
FrameworkSQL Data
WarehouseData Catalog
Data Lake
Analytics
Data Factory Machine
LearningData Lake Store
Cognitive
Services
Power BI
Data
Sources
Apps
Sensors
and
devices
Data
Information Management
Data
Sources
Apps
Sensors
and devices
Data
Information
Management
Event Hubs
Data Catalog
Data Factory
Compose and orchestrate data services at scale
INGEST
SQL
<>
SQL
DATA SOURCES
{ }
SQL
• Create, schedule, orchestrate, and manage data pipelines
• Visualize data lineage
• Connect to on-premises and cloud data sources
• Monitor data pipeline health
• Automate cloud resource management
• Move relational data for Hadoop processing
• Transform with Hive, Pig, or custom code
Information
Management
Event Hubs
Data Catalog
Data Factory
Creates, orchestrates & automates
the movement, transformation
through the cloud
and/or analysis data
Example of Cortana Intelligence Suite in action
Data Sources Ingest Prepare Analyze Publish Consume
Sensors
and devices
Stream
Analytics Machine
LearningCortana
Business
apps
SQL Data
Warehouse
Diagnostic
Streaming
Power BI
Enterprise
data sources
Azure Blob storage
Data Factory: Move data, orchestrate, schedule and monitor
Data Catalog: Register, annotate, understand, discover data sets
HDInsight
Event
Hubs
HDInsight
Machine
Learning
Stream
Analytics
SQLDay 2017
