64
Life’s Too Short… ... for Cloud without Analytics Monitoring the Dynamic Nature of Cloud Computing Lee Atchison, Principal Cloud Architect and Advocate at New Relic, Inc. Confidential ©2008-16 New Relic, Inc. All rights reserved. @leeatchison leeatchison

Cloud Expo (Keynote) - Static vs Dynamic

Embed Size (px)

Citation preview

Page 1: Cloud Expo (Keynote) - Static vs Dynamic

Life’s Too Short…... for Cloud without Analytics Monitoring the Dynamic Nature of Cloud Computing

Lee Atchison, Principal Cloud Architect and Advocate at New Relic, Inc.

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

@leeatchison leeatchison

Page 2: Cloud Expo (Keynote) - Static vs Dynamic

2

SafeHarbor

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

This document and the information herein (including any information that may be incorporated by reference) is provided for informationalpurposes only and should not be construed as an offer, commitment, promiseor obligation on behalf of New Relic, Inc. (“New Relic”) to sellsecurities or deliver any product, material, code, functionality, or other feature. Any information provided hereby is proprietary to New Relicand may not be replicated or disclosed without New Relic’s expresswritten permission.

Such information may contain forward-looking statementswithin themeaning of federal securities laws. Any statement that is not a historicalfact or refers to expectations, projections, futureplans, objectives, estimates, goals, or other characterizations of future events is a forward-looking statement. These forward-looking statements can often be identified as such because the context of the statement will includewordssuch as “believes,” “anticipates,”, “expects” or words of similar import.

Actual results may differ materially from those expressed in these forward-looking statements, which speak only as of the date hereof, andare subject to change at any time without notice. Existing and prospective investors, customers and other third parties transacting businesswith New Relic are cautioned not to place undue reliance on this forward-looking information. The achievement or success of the matterscovered by such forward-looking statements are based on New Relic’s current assumptions, expectations, and beliefs and are subject tosubstantial risks, uncertainties, assumptions, and changes in circumstances that may cause the actual results, performance, or achievementsto differ materially from those expressed or implied in any forward-looking statement. Further information on factors that could affect suchforward-looking statements is included in the filingswemake with theSEC from time to time. Copies of thesedocumentsmay be obtained byvisiting New Relic’s Investor Relationswebsite at http://ir.newrelic.comor theSEC’swebsite at www.sec.gov.

New Relic assumes no obligation and does not intend to update these forward-looking statements, except as required by law. New Relicmakes no warranties, expressed or implied, in this documentor otherwise, with respect to the information provided.

Page 3: Cloud Expo (Keynote) - Static vs Dynamic

3

WhoamI?

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

Specializein:

Cloudcomputing

Services&Microservices

Scalability,Availability

28yearsinindustry7inAmazonRetail&AWS(BuiltSW/VGAppStore,AWSElasticBeanstalk)

4inNewRelic(ArchitectureLead,Cloud,ServiceMigration)

@leeatchison leeatchison

Page 4: Cloud Expo (Keynote) - Static vs Dynamic

4

Wewantbetterappsfaster

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

DynamicEnvironment

BetterDataCenter

Howdoweusethecloudtoaccomplishthis?

Page 5: Cloud Expo (Keynote) - Static vs Dynamic

CloudasaBetterDataCenter

Page 6: Cloud Expo (Keynote) - Static vs Dynamic

6

Cloudasa“Better DataCenter”

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

Resourcesareallocatedtouses,justlikeinadatacenter

Page 7: Cloud Expo (Keynote) - Static vs Dynamic

7

Cloudasa“Better DataCenter”

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

Resourcesareallocatedtouses,justlikeinadatacenter

Provisioning processisfaster

Page 8: Cloud Expo (Keynote) - Static vs Dynamic

8

Cloudasa“Better DataCenter”

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

Resourcesareallocatedtouses,justlikeinadatacenter

Lifetimeofcomponents isrelativelylong

Provisioning processisfaster

Page 9: Cloud Expo (Keynote) - Static vs Dynamic

9

Cloudasa“Better DataCenter”

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

Resourcesareallocatedtouses,justlikeinadatacenter

Lifetimeofcomponents isrelativelylong

Provisioning processisfaster

Capacityplanning isstillimportantand

stillapplies

Page 10: Cloud Expo (Keynote) - Static vs Dynamic

10

Whyusea“Better DataCenter”?

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

Page 11: Cloud Expo (Keynote) - Static vs Dynamic

11

Whyusea“Better DataCenter”?

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

AddnewCapacity(faster)

Page 12: Cloud Expo (Keynote) - Static vs Dynamic

12

Whyusea“Better DataCenter”?

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

ImproveApplicationAvailability(redundancy)

AddnewCapacity(faster)

Page 13: Cloud Expo (Keynote) - Static vs Dynamic

13

Whyusea“Better DataCenter”?

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

ComplianceImproveApplicationAvailability(redundancy)

AddnewCapacity(faster)

Page 14: Cloud Expo (Keynote) - Static vs Dynamic

14

Whoisimpacted?

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

BetterDataCenter

Operations Development

Page 15: Cloud Expo (Keynote) - Static vs Dynamic

15

Whoisimpacted?

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

BetterDataCenter

CanIscalemyserverfleet?Canappsrunanywhere?Howdotheyperforminthecloud?

Operations Development

Page 16: Cloud Expo (Keynote) - Static vs Dynamic

16

Whoisimpacted?

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

BetterDataCenter

CanIscalemyserverfleet?Canappsrunanywhere?Howdotheyperforminthecloud?

Operations

Datacenterisadatacenter…

Development

Page 17: Cloud Expo (Keynote) - Static vs Dynamic

17

Whoisimpacted?

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

BetterDataCenter FasterApplicationLaunch/Deploy=

BetterDataCenter

CanIscalemyserverfleet?Canappsrunanywhere?Howdotheyperforminthecloud?

Operations

Datacenterisadatacenter…

Development

Page 18: Cloud Expo (Keynote) - Static vs Dynamic

18

HowdoImonitorit?

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

Similartomonitoringanyotherdatacenter…

Page 19: Cloud Expo (Keynote) - Static vs Dynamic

19

Monitoringanapplication

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

Typical Server / EC2 Instance

• Application & Application Microservices

• Server OS• Hardware (virtual)

EC2Instance

Application&ApplicationMicroservices

ServerOS

Server(Virtual)Hardware

Page 20: Cloud Expo (Keynote) - Static vs Dynamic

20

AWSMonitoring

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

CloudWatch

• Monitors:– EC2 instance– Virtualization– Hardware– [CPU / Disk / Networking]

• Doesn’t know about:– Server OS– Memory / Filesystem– Processes– Application

• Latency• Error rates• Internal insights

EC2Instance

Application&ApplicationMicroservices

ServerOS

Server(Virtual)Hardware

CloudWatch

AWSCONSOLE

Page 21: Cloud Expo (Keynote) - Static vs Dynamic

21

NewRelicMonitoring

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

New Relic

• Monitors (Server):– How O.S. is performing– Processes– Hardware

• Monitors (Application):– App health– App performance– Microservices

• Doesn’t know– Virtualization

EC2Instance

Application&ApplicationMicroservices

NewRelicApplicationMonitoring

ServerOS

Server(Virtual)Hardware

NewRelicServer

Monitoring

CloudWatch

DASHBOARDS

AWSCONSOLE

Page 22: Cloud Expo (Keynote) - Static vs Dynamic

22

AWSçèNewRelicworktogether

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

AWS / CloudWatch

• Visibility into virtualization• CPU / Disk / Networking

New Relic

• CPU / Disk / Networking• Memory / Filesystem• Processes• Infrastructure components• Application / Microservices:– Latency– Error rates– App insights

EC2Instance

Application&ApplicationMicroservices

NewRelicApplicationMonitoring

ServerOS

Server(Virtual)Hardware

NewRelicServer

Monitoring

CloudWatch

DASHBOARDS

CloudWatchmonitors

NewRelicmonitors

AWSCONSOLE

Page 23: Cloud Expo (Keynote) - Static vs Dynamic

CloudasaDynamicTool

Page 24: Cloud Expo (Keynote) - Static vs Dynamic

24

Cloudasa“DynamicToolforDynamicApps”

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

Useonlytheresourcesyouneed

Page 25: Cloud Expo (Keynote) - Static vs Dynamic

25

Cloudasa“DynamicToolforDynamicApps”

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

Useonlytheresourcesyouneed

Allocate/de-allocateresourceson

thefly

Page 26: Cloud Expo (Keynote) - Static vs Dynamic

26

Cloudasa“DynamicToolforDynamicApps”

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

Useonlytheresourcesyouneed

Resourceallocationisanintegralpartofyourapplicationarchitecture

Allocate/de-allocateresourceson

thefly

Page 27: Cloud Expo (Keynote) - Static vs Dynamic

27

DynamicCloud

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

Resourcesare:

Application isawareofandiscontrolling traditionalOPs

resources

De-allocatedConsumedAllocated

AutoScale

Page 28: Cloud Expo (Keynote) - Static vs Dynamic

28

DynamicCloud

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

Dockercontainers:

• Quicker/cheaperstartup/shutdownthanEC2instances

• EasytoconsumeDockercontainersmuchlikeyoudo“processes”

• Perform jobs:– Inascript– Offofsomequeueofjobrequests

Page 29: Cloud Expo (Keynote) - Static vs Dynamic

29

DynamicCloud

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

100

10K

1M

3.7M

83days 333days

DockerContainerAge(Countvs.Hours)

Page 30: Cloud Expo (Keynote) - Static vs Dynamic

30

DynamicCloud

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

950,00011%underoneminute

DockerContainerAge(byMinuteUnderandHour)

Page 31: Cloud Expo (Keynote) - Static vs Dynamic

EC2AutoScaling

31

DynamicCloudTechnologies

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

Mobile/IoTDynamicrouting

Loadbalancing

Datatransport

Queuesandnotifications

Docker

DynamicCloudisaboutscaling

Page 32: Cloud Expo (Keynote) - Static vs Dynamic

32

HowdoImonitortheDynamicCloud?

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

DynamicCloudhasuniquemonitoringrequirements…

Page 33: Cloud Expo (Keynote) - Static vs Dynamic

33

Responsibility (DynamicCloud)

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

ServerOS

Server(Virtual)Hardware

Application&ApplicationMicroservices

Application&ApplicationMicroservices

Application&ApplicationMicroservices

Provisioning

Responsible for the parts you care about

• Application & Application Microservices

Let cloud manage rest

• Infrastructure• Allocation/Provisioning• Scaling

Page 34: Cloud Expo (Keynote) - Static vs Dynamic

34

AWSInfrastructureçèNewRelicworktogether

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

ServerOS

Server(Virtual)Hardware

CloudWatch

DASHBOARDS

Application&ApplicationMicroservices

Application&ApplicationMicroservices

Application&ApplicationMicroservices

ProvisioningAWS

CONSOLE

Page 35: Cloud Expo (Keynote) - Static vs Dynamic

35

AWSInfrastructureçèNewRelicworktogether

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

ServerOS

Server(Virtual)Hardware

CloudWatch

DASHBOARDS

Application&ApplicationMicroservices

Application&ApplicationMicroservices

Application&ApplicationMicroservices

ProvisioningAWS

CONSOLE

Page 36: Cloud Expo (Keynote) - Static vs Dynamic

36

AWSInfrastructureçèNewRelicworktogether

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

ServerOS

Server(Virtual)Hardware

CloudWatch

DASHBOARDS

Application&ApplicationMicroservices

Application&ApplicationMicroservices

Application&ApplicationMicroservices

Provisioning

CloudWatch&AWSmonitoring

NewRelicmonitors

AWSCONSOLE

Page 37: Cloud Expo (Keynote) - Static vs Dynamic

37

Howdoyoumonitorthis?

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

ServerOS

Server(Virtual)Hardware

Application&ApplicationMicroservices

Application&ApplicationMicroservices

Application&ApplicationMicroservices

Provisioning

?Howdoyoumonitorthis?

Page 38: Cloud Expo (Keynote) - Static vs Dynamic

38

Wherediditgo?Itwasjusthere!!!

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

? Thethingyoumonitored10minutesago…...doesn’texistanymore!

Page 39: Cloud Expo (Keynote) - Static vs Dynamic

39

DynamicCloud

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

950,00011%underoneminute

DockerContainerAge(byMinuteUnderandHour)

Page 40: Cloud Expo (Keynote) - Static vs Dynamic

40

Monitoring theDynamicCloud

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

VerydifferentthanmonitoringtraditionalDataCentercomponents

Monitor theCloudComponents

themselves

Monitor thelifecycleofthe

CloudComponents

Page 41: Cloud Expo (Keynote) - Static vs Dynamic

41

WhoisimpactedbyDynamicCloud?

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

BetterDataCenter

CanIscalemyserverfleet?Canappsrunanywhere?Howdotheyperforminthecloud?

Operations

Datacenterisadatacenter…

Development

DynamicCloud

Page 42: Cloud Expo (Keynote) - Static vs Dynamic

42

WhoisimpactedbyDynamicCloud?

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

BetterDataCenter

CanIscalemyserverfleet?Canappsrunanywhere?Howdotheyperforminthecloud?

Operations

Datacenterisadatacenter…

Development

DynamicCloud

What isacontainer?WhydoIcare??Itwas justhere,wherediditgo???

Page 43: Cloud Expo (Keynote) - Static vs Dynamic

43

WhoisimpactedbyDynamicCloud?

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

BetterDataCenter

CanIscalemyserverfleet?Canappsrunanywhere?Howdotheyperforminthecloud?

Operations

Datacenterisadatacenter…

Development

DynamicCloud

What isacontainer?WhydoIcare??Itwas justhere,wherediditgo???

CloudarchitectureisintegraltotheapplicationarchitectureDevelopersdeeplyinvolvedincloudactivities

Page 44: Cloud Expo (Keynote) - Static vs Dynamic

44

Changeisspeedingup

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

TraditionalDataCenter

CloudDataCenter

DynamicCloud

DynamicCloudenablesbetterapplicationsfaster.

Good Better Best

Thewayyou’vedonethingsinthepastwon’tworkinthefuture.

Page 45: Cloud Expo (Keynote) - Static vs Dynamic

45

DynamicCloud

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

EC2

Serverrunningapplication/processes

Dockercontainer

Processrunningacommand

Thisishard

Thingshappenfasterbecauseof…

Page 46: Cloud Expo (Keynote) - Static vs Dynamic

46

DynamicCloud

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

EC2

Serverrunningapplication/processes

Dockercontainer

Processrunningacommand

Lambda

Function performingataskoroperation

Page 47: Cloud Expo (Keynote) - Static vs Dynamic

TheFuturewithLambda

Page 48: Cloud Expo (Keynote) - Static vs Dynamic

48

Microcomputing &AWSLambda

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

• Newestentrancetothe“dynamiccloud”

• Provideseventdrivencomputecapabilities

Page 49: Cloud Expo (Keynote) - Static vs Dynamic

49

Microcomputing &AWSLambda

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

• Noinfrastructure toprovision

• Massivelysharedinfrastructure

Page 50: Cloud Expo (Keynote) - Static vs Dynamic

50

WhyuseLambda?

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

Lambdascripts

Runinresponsetoastatechangeoractioninthecloud

Stateless,“filters”Performquickactions

Virtuallynostartup/shutdown

cost

Page 51: Cloud Expo (Keynote) - Static vs Dynamic

51

AWSLambda

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

S3Bucket

DynamoDB

APIGateway

SQS

RESOURCESSOME

• TakesaneventfromanAWSresource(ATrigger)

Page 52: Cloud Expo (Keynote) - Static vs Dynamic

52

AWSLambda

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

S3Bucket

DynamoDB

APIGateway

SQS

RESOURCESSOME

LambdaScript

• TakesaneventfromanAWSresource(ATrigger)

• Createsaninstancetoexecute

LambdaInstance

Page 53: Cloud Expo (Keynote) - Static vs Dynamic

53

AWSLambda

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

S3Bucket

DynamoDB

APIGateway

SQS

RESOURCESSOME

S3Bucket

APIGateway SQS

RESOURCESSOMELambdaScript

• TakesaneventfromanAWSresource(ATrigger)

• Createsaninstancetoexecute

• CanimpactoriginalordifferentAWSResource

LambdaInstance

Page 54: Cloud Expo (Keynote) - Static vs Dynamic

54

AWSLambda

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

S3Bucket

DynamoDB

APIGateway

SQS

RESOURCESSOME

S3Bucket

APIGateway SQS

RESOURCESSOMELambdaScript

LambdaInstance

LambdaInstance

LambdaInstance

LambdaInstance

LambdaInstance

LambdaInstance

LambdaInstance

LambdaInstance

LambdaInstance

• TakesaneventfromanAWSresource(ATrigger)

• Createsaninstancetoexecute

• CanimpactoriginalordifferentAWSResource

• Anynumberofinstancescanrunatatime

Page 55: Cloud Expo (Keynote) - Static vs Dynamic

55

MonitoringLambdaScripts

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

Lesslikeservermonitoring /Morelikewebapplicationmonitoring

WeCareAbout

WeDon’tCareAbout

• Runtime(average,extremes–TP90/TP99)

• Statisticalmetrics

• Errorratesandotherdeviations fromnorm

• “Drilldown”intoindividual “runs”

• Detailsaboutall”runs”

• Server/infrastructuremetrics

Page 56: Cloud Expo (Keynote) - Static vs Dynamic

56

MonitoringLambda

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

Morelikeapplicationperformancemonitoringthaninfrastructuremonitoring

Page 57: Cloud Expo (Keynote) - Static vs Dynamic

57

MonitoringLambda

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

Morelikeapplicationperformancemonitoringthaninfrastructuremonitoring

Page 58: Cloud Expo (Keynote) - Static vs Dynamic

58

Changeisspeedingup

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

TraditionalDataCenter

CloudDataCenter

DynamicCloud

DynamicCloudenablesbetterapplicationsfaster.Therateofchangeisincreasing…

Good Better Best

Thewayyou’vedonethingsinthepastwon’tworkinthefuture.

Page 59: Cloud Expo (Keynote) - Static vs Dynamic

59

Monitoring justtheserver

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

EC2Instance

Application&ApplicationMicroservices

ServerOS

Server(Virtual)Hardware

CloudWatch

Worked when rate of change was low…

AWSCONSOLE

Page 60: Cloud Expo (Keynote) - Static vs Dynamic

Monitoringjusttheserver

ServerOS

Server(Virtual)Hardware

Application&ApplicationMicroservices

Application&ApplicationMicroservices

Application&ApplicationMicroservices

Provisioning

Insufficient in the cloud:

• Rate of change is faster• Problems come up quicker• “Server” isn’t a server anymore• “Provisioning” isn’t provisioning anymore

Youneedtoptobottommonitoring…

Youneedfullstackaccountability...

Page 61: Cloud Expo (Keynote) - Static vs Dynamic

61

NewRelicenablesaccountability betweenyourcode&AWS

Confidential ©2008-16NewRelic, Inc. Allrights reserved.

Customers

Mobile/Apps/Browser

On-Premises

OnPremisesRelationalData

EC2

AWSContainerService

AWSRDSSyntheticCustomers

S3

NoSQL

AWSStorageServices

YourResponsibilities

§ Applicationcode&3rd partyservices

§ Apparchitecture

§ Customerexperience

§ On-Premisescomponents

NoSQLAWSResponsibility:

§ ServiceAvailability &Performance

§ Provisioning&operationofDC

§ Isolation&securityofresources

§ Servicemaintenance&innovation

Page 62: Cloud Expo (Keynote) - Static vs Dynamic

ArchitectingforScaleBy:LeeAtchisonPublishedby:O’ReillyMedia,Available:June2016www.architectingforscale.com

WanttoLearnMore?

Page 63: Cloud Expo (Keynote) - Static vs Dynamic

“FlyTwoMistakesHigh”AGuidetoNotCrashing

5:40pmtoday–HotTrack1|Cloud(Room1A04)

KeepingHighAvailability

Page 64: Cloud Expo (Keynote) - Static vs Dynamic

©2008-15NewRelic,Inc.Allrightsreserved.

Thank you.

LeeAtchisonPrincipal Cloud Architect andAdvocate atNewRelic, Inc.

Architecting forScalePublishedby:O’Reilly Media,Available: June2016www.architectingforscale.com

@leeatchison leeatchison