41
SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

Embed Size (px)

Citation preview

Page 1: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

SQL Server 2014 – Features Drilldown

Tara Shankar JanaSenior Premier Field Engineer (Microsoft)

Page 2: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

Web Avatar Find my blogs at:

http://blogs.msdn.com/b/sql-bi-sap-cloud-crm_all_in_one_place/

My Website: http://sqlmasters.jimdo.com/

Twitter: @TJMicrosoft

Linkedin: http://

au.linkedin.com/pub/tara-shankar-jana/21/1a3/329

Page 3: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

The Evolution of Microsoft Data Platform

SQL Server2000

SQL Server2005

SQL Server2008

SQL Server2008 R2

SQL Server2012

XML ● KPIs

Management Studio ● Mirroring

Compression ● Policy-Based Mgmt ● Programmability

PowerPivot ● SharePoint Integration ● Master Data Services

AlwaysOn ● ColumnStore Index ● Data Quality Services ● Power View ● Cloud Connectivity

Mission Critical & Cloud Performance

Cloud-Ready Self-Service BI

SQL Server2014

In-Memory Across Workloads ● Performance & Scale ● Hybrid Cloud Optimized ● HDInsight ● Cloud BI

Performance & Productivity

Mission Critical

Modern DB platform

Page 4: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

SQL Server 2014 and the Data Platform

Mission Critical Performance

Platform for Hybrid Cloud

Page 5: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

Mission Critical Performance

In-Memory Built-InAverage 10x faster for new and existing SQL Server apps

Secure & ScalableMost secure with enterprise scale using Windows Server

High AvailabilityThe 9’s you need, with AlwaysOn

Mission Critical SupportLive support designed for mission critical solutions

Page 6: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

In-Memory Built-In

New In-Memory OLTP

Enhanced In-Memory ColumnStore for DW

In-Memory BI with PowerPivot

Buffer Pool Extension to SSDs & Enhanced Query Processing

15,000 250,000

OLTP

Select only highly utilized tables to be in-memory

Optimize in-memory to fit existing hardware

In-memory performance across OLTP, DW and BI

All in a single SKU

On average 10x faster, without having rewrite entire app

Leverage full SQL Server capabilities

Page 7: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

Microsoft In-Memory Technologies

Analytics OLTPStreaming Data• In-Memory Analytics in

PowerPivot for Excel• In-Memory Analytics in

SQL Server Analysis Services

• In-Memory Columnstore Index in SQL Server 2012, Fast Track Data Warehouse, and Parallel Data Warehouse

• StreamInsight • In-Memory OLTP• In-Memory Columnstore

Index (in SQL Server 2014)

2014

2012

2014

2012

2014

Page 8: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

9

Why Hekaton (XTP)?

Page 9: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

SQL Server Integration

• Same manageability, administration & development experience

• Integrated queries & transactions

• Integrated HA and backup/restore

Main-Memory Optimized

• Optimized for in-memory data

• Indexes (hash and range) exist only in memory

• No buffer pool, B-trees

• Stream-based storage

T-SQL Compiled to Machine Code

• T-SQL compiled to machine code via C code generator and VC

• Invoking a procedure is just a DLL entry-point

• Aggressive optimizations @ compile-time

Steadily declining memory price,

NVRAM

Many-core processors

Stalling CPU clock rate

TCO

Hardware trends Business

In-Memory OLTP – Architectural Pillars

Hybrid engine and integrated

experience

High performance

data operations

Efficient business-logic

processingCu

sto

me

r B

en

efi

tsA

rch

itectu

ral P

illa

rsD

rivers

High Concurrency

• Multi-version optimistic concurrency control with full ACID support

• Core engine uses lock-free algorithms

• No lock manager, latches or spinlocks

Frictionless scale-up

Page 10: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

Memory Optimized Data Filegroup Data Filegroup

SQL Server.exe

Memory Optimized Tables & Indexes

TDS Handler and Session Management

In-Memory OLTP Integration and Application Migration

Natively Compiled SPs and Schema

Buffer Pool for Tables & Indexes

Client App

Transaction Log

Query Interop

T1

T3

T2

T1

T3

T2

Tables

Indexes

T-SQL Query Execution

T1

T3

T2

Parser, Catalog, Optimize

r

Native Compiler In-mem

OLTP Componen

t

KeyExisting

SQL Compone

nt

Generated .dll

Non-durable

table

Page 11: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

demo

HEKATON- XTP (How to Create Memory-Optimized Tables)

Page 12: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

demo

HEKATON- XTP (Detailed Demos)

Page 13: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

demo

HEKATON- XTP (Durable Table)

Page 14: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

demo

HEKATON- XTP (Non-Durable tables)

Page 15: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

demo

HEKATON- XTP (AMR Tool)

Page 16: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

demo

HEKATON- XTP (Memory Optimizer Wizard)

Page 17: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

• Fast execution for data warehouse queries• Speedups of 10x and more

• No need for separate base table• Saves space

• Data can be inserted, updated, or deleted• Simpler management

• Eliminate need for other indexes• Saves space and simpler management

• More data types supported• Removes many limitations from non-clustered columnstores in SQL Server 2012

Columnstores: clustered and updatable (The next generation)

Page 18: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

Comparing space savings (101-million row table and index space)

0.0

5.0

10.0

15.0

20.019.7 GB

10.9 GB

5.0 GB4.0 GB

6.9 GB

1.8 GB

Page 19: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

demo

Clustered Columstore Index

Page 20: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

2006 2007 2008 2009 2010 2011 2012 20130

20

40

60

80

0 211 8

0 1 4 0

69

53 53 55

34 2922 18

5

28 25 2921

612

0

16 169 8 6

43

20

43

SQL Server Oracle MySQL DB2

Database Vulnerabilities

Secure

*National Institute of Standards and Technology Comprehensive Vulnerability Database 4/17/2013, Market share from IDC 2013

Page 21: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

Separation of Duties Enhancements

• What’s being delivered• Three new permissions (CONNECT ANY DATABASE, IMPERSONATE

ANY LOGIN, and SELECT ALL USER SECURABLES)• Main benefit

• Greater role separation• Ability to create new roles for database administrators who are

not sysadmin (super user)• Ability to create new roles for users or apps with specific

purposes

Page 22: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

demo

Security Enhancements- Demo

Page 23: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

SQL Server 2014 Resource Governance

Up 640 logical processors

64 vCPUs/VM

1 TB memory/VM

64 nodes/cluster

Network virtualization provides flexibility and isolation

Assign minimum and maximum bandwidth

Storage virtualization

Enterprise-class network storage on standard hardware

Storage tiering for higher performance

Scalable

SQL Server 2014• Resource Governor

adds IO governance

• SysPrep at cluster level

Windows Server 2012 R2• Hyper-V

• Storage Spaces

• NIC Teaming

• Online VHDX Resize

• Network & Storage QoS

CPU20%

Memory10%

IO30%

Pool 1

Pool 2

CPU50%

Memory40%

IO40%

Pool 3

App 1

App 6

App 4

App 5

Page 24: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

demo

Resource Governor- Demo

Page 25: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

SSD Buffer Pool Extension and scale up

• What’s being delivered• Use of non-volatile drives (SSD) to extend buffer pool• NUMA-Aware large page and BUF array allocation

• Main benefits• BP extension for SSDs

• Improve OLTP query performance with no application changes• No risk of data loss (using clean pages only)• Easy configuration optimized for OLTP workloads on commodity

servers (32 GB RAM)

Page 26: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

Buffer Pool Manager

DataFiles

Relational Engine

ProtocolLayer

Storage Engine Buffer Pool

Optimizer

CmdParse

r

QueryExecut

orSNI

Transaction

Manager

AccessMethods

BufferManage

r

Transaction Log

Plan Cache

Data Cache

TDS

Query Plan Result Sets

Resu

ltsData

GetPage D

TDS

ReadI/OWrite

I/O

CommandQuery Tree

Cached Pages

Page 27: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

How it works?

SSD

Buffer Pool

DB

Clean Page

Dirty Page

ɸ

EvictClean Page

bpage == NULLIS_ON (BUF_L2BPOOL)IS_OFF (BUF_L2DIRTY)

bpage != NULLIS_ON (BUF_DIRTY)IS_ON (BUF_L2BPOOL)IS_ON (BUF_L2DIRTY)

Page 28: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

Lower and Upper Thresholds

Pages Array

……

……

LeastRecentlyUsed

Upper Threshold

Lower Threshold

Hot Pagesin DRAM

Warm Pagesto Extension

Cold PagesEvicted

Page 29: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

Online Operations Enhancements

• What’s being delivered• Single partition online index rebuild• Managing Lock Priority for table SWITCH and online index

rebuild• Built-in diagnostics

• Main benefits• Increased concurrency and application availability• New partition-level granularity for online index rebuild

enables lower resource (CPU/memory) usage for customers who need uninterrupted access

• Provide customers with greater control over impacting running transactions if using switch partition or online index rebuild commands

Page 30: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

Faster Insights from Any Data

Easy access to data, big & smallSearch, access, and shape internal and external data, and combine with unstructured data

Powerful insights with familiar toolsSpeed up analysis and time to insight with the familiarity of Excel in Office and Office 365 and access via mobile devices

Complete BI platformScale your BI models and enrich and secure your data with a complete platform spanning cloud and on-premises

Page 31: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

Microsoft Power BI for Office 365

Collaborate in Office 365

Insights in Excel

Analyze

Visualize

Share

Find

Q&A

Mobile

Discover Search, access, and transform public and internal data sources with Power Query

Share data views and workbooks refreshable from on-premises and cloud based data sources, with Power BI Sites

Easy data modeling and lightning fast in-memory analytics with Power Pivot

Bold new interactive data visualizations with Power View and Power Map

Ask questions and get immediate answers with natural language query

Scalable | Manageable | Trusted

Mobile access through HTML5 and touch optimized apps for Windows 8, RT and iOS tablets

Page 32: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

Platform for Hybrid Cloud

Hybrid Cloud SolutionsEnable new hybrid scenarios like cloud backup and cloud DR to reduce costs and improve on-premises DR

Easy On-Ramp to CloudEasily migrate and run SQL Server in the cloud to gain benefits of cloud computing

Complete & ConsistentDeploy a complete and consistent data platform from on-premises to cloud

Page 33: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

Hybrid Cloud Solutions

Manual or Automatic

At an instance level with point in time restore

Measures DB usage patterns to set backup frequency

Fast disaster recovery (low RTO)

Easy to deploy & manage

Cloud bursting

Greater global reach

Better isolation of internal assets

On-Premise Network

Azure Storage

Domain Controller

Periodic Snapshot (automatic/manu

al)

SQL Server

Windows Azure Restore to VM

Geo Replication

Page 34: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

Easy On-Ramp to Cloud

Easily migrate on-prem SQL Server to a Windows Azure VM

Designed for users unfamiliar with Windows Azure

Ideal for existing apps & dev/test new apps

Full SQL Server functionality

Full VM control

Ideal for new variable-demand apps

Dynamic scale-out of database

No patching of OS or DB

HA built-in with 99.9% SLA

DB

Page 35: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

demo

Database migration from On-premises to cloud or Azure VM

Page 36: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

demo

Smart and Managed backups- Demo

Page 37: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

Off-PremisesOn-Premises Data Center

SQL Server in a Windows Azure VM

SQL Database service

HDInsightTablesBlobs

SQL Server on Windows Server

PDW Appliance

SQL Server in a Windows

Server VM

Power BI features in O365

SQL Server in a Windows

Server VM

HD Insight Server

Complete & Consistent Data Platform

Page 38: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

Call to action

Download SQL Server 2014 CTP2www.microsoft.com/sqlserver

Register for Power BI Previewwww.powerbi.com

Get on Windows Azurewww.windowsazure.com

Page 39: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

Track Resources

• Download the CTP for SQL Server 2014 and accelerate your queries using In-Memory OLTP - http://technet.microsoft.com/en-us/evalcenter/dn205290.aspx

• Get into the cloud with an Azure account - use SQL database in Windows Azure or take your workload into Azure VM - www.windowsazure.com

• Get big with big data – HDInsight on Azure and grab the latest Power BI featureshttp://www.windowsazure.com/en-us/documentation/services/hdinsight/?fb=en-us

• Power BI - www.powerbi.com

Page 40: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

41

Questions?

Page 41: SQL Server 2014 – Features Drilldown Tara Shankar Jana Senior Premier Field Engineer (Microsoft)

© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.