20
Azure Data Overview Microsoft Azure

Data in Azure

Embed Size (px)

DESCRIPTION

Introduction to Data in Microsoft Azure for DevTeach Oceanwide

Citation preview

Page 1: Data in Azure

Azure Data Overview

Microsoft Azure

Page 2: Data in Azure

Guy Barrette

MVP Windows AzureFreelance Solutions Architect

Co-animateur duVisual Studio Talk Show

[email protected]

@guybarrette

Page 3: Data in Azure

Agenda

SQL Databas

e

SQL on IaaS NoSQL

Blobs Files

Page 4: Data in Azure

SQL Database

Page 5: Data in Azure

IaaS SaaSPhysical Virtual

A Continuous Offering From Private To

Public Cloud

PaaS

Page 6: Data in Azure

A Server Is Not A Machine

SQL Server

A Machine

SQL Database

Server

A TDS Endpoint

Page 7: Data in Azure

The Basics

SQL DatabaseSQL Server database technology as a service Fully ManagedEnterprise-ready with automatic support for HADesigned to scale out elastically with demandIdeal for simple and complex applications

Page 8: Data in Azure

Server ProvisioningServer DefinedService head that contains databases

Connect via automatically generated FQDN (xxx.database.windows.net)

Initially contains only a master database

Provision Servers InteractivelyLog on to Microsoft Azure Management Portal

Create a SQL Database server

Specify admin login credentials

Add firewall rules and enable service access

Automate Server ProvisioningUse Microsoft Azure Platform PowerShell cmdlets (or use REST API directly)

wappowershell.codeplex.com

Page 9: Data in Azure

Selecting the right EditionService Tier

Performance Level

Common App Pattern

Performance Business Continuity

Max DB Size

Trans. Perf. Objective

DTUs PITR DR / GEO-Rep

Basic Basic Small DB, SQL opp

2 GB Reliability / Hr.

5 Past 7 Days

DB Copy + Manual Export

Standard

S1 / S2 Wrkgp/cloud app, multiple concurrent operations

250 GB

Reliability / Min.

15/ 50

Past 14 Days

DB Copy + Manual Export

Premium

P1 / P2 / P3 Mission Critical, High volume, Many concurrent Users

500 GB

Reliability / sec.

100/200/800

Past 35 Days

Active Geo-replication

Page 10: Data in Azure

Blob Storage

Page 11: Data in Azure

Blob Storage Concepts

BlobContainerAccount

http://<account>.blob.core.windows.net/<container>/<blobname>

Pages/ Blocks

contoso

PIC01.JPG

Block/Page

Block/Page

PIC02.JPG

images

VID1.AVIvideos

Page 12: Data in Azure

Two Types of Blobs Under the Hood

Block BlobTargeted at streaming workloads

Each blob consists of a sequence of blocks

Each block is identified by a Block ID

Size limit 200GB per blob

Optimistic Concurrency via Etags

Page BlobTargeted at random read/write workloads

Each blob consists of an array of pages

Each page is identified by its offset from the start of the blob

Size limit 1TB per blob

Optimistic or Pessimistic (locking) concurrency via leases

Page 13: Data in Azure

Queues

Page 14: Data in Azure

Queue ConsiderationsMessages are not orderedMessage

Will be processed at least onceMaybe returned more than once

Failover In case of failure, the message will be reprocessed by

another nodeMessage size<= 64KBStored up to 7 days

Page 15: Data in Azure

Why use Queue?The queue length directly reflects how well the backend processing nodes are catching up with the overall workload.

Decouples different parts of the application.

Allows the flexibility of efficient resource usage within an application

Buffering to absorb traffic bursts and reduce the impact of individual component failures.

Page 16: Data in Azure

Tables18

Page 17: Data in Azure

Table Storage Concepts

EntityTableAccount

contoso

Name =…Email = …

Name =…EMailAdd=

customers

Photo ID =…Date =…

photos

Photo ID =…Date =…

Page 18: Data in Azure

Table Details

InsertUpdate Merge – Partial update

Replace – Update entire entity

UpsertDeleteQueryEntity Group TransactionsMultiple CUD Operations in a single atomic transaction

Create, Query, DeleteTables can have metadata

Not an RDBMS! Table

Entities

Page 19: Data in Azure

No Fixed Schema

FIRST LAST BIRTHDATE

Wade Wegner 2/2/1981

Nathan Totten 3/15/1965

Nick Harris May 1, 1976

FAV SPORT

Canoeing

Page 20: Data in Azure

Questions?