Cloud Expo (Keynote) - Static vs Dynamic

Life’s Too Short…... for Cloud without Analytics Monitoring the Dynamic Nature of Cloud Computing

Lee Atchison, Principal Cloud Architect and Advocate at New Relic, Inc.

@leeatchison leeatchison

SafeHarbor

This document and the information herein (including any information that may be incorporated by reference) is provided for informationalpurposes only and should not be construed as an offer, commitment, promiseor obligation on behalf of New Relic, Inc. (“New Relic”) to sellsecurities or deliver any product, material, code, functionality, or other feature. Any information provided hereby is proprietary to New Relicand may not be replicated or disclosed without New Relic’s expresswritten permission.

Such information may contain forward-looking statementswithin themeaning of federal securities laws. Any statement that is not a historicalfact or refers to expectations, projections, futureplans, objectives, estimates, goals, or other characterizations of future events is a forward-looking statement. These forward-looking statements can often be identified as such because the context of the statement will includewordssuch as “believes,” “anticipates,”, “expects” or words of similar import.

Actual results may differ materially from those expressed in these forward-looking statements, which speak only as of the date hereof, andare subject to change at any time without notice. Existing and prospective investors, customers and other third parties transacting businesswith New Relic are cautioned not to place undue reliance on this forward-looking information. The achievement or success of the matterscovered by such forward-looking statements are based on New Relic’s current assumptions, expectations, and beliefs and are subject tosubstantial risks, uncertainties, assumptions, and changes in circumstances that may cause the actual results, performance, or achievementsto differ materially from those expressed or implied in any forward-looking statement. Further information on factors that could affect suchforward-looking statements is included in the filingswemake with theSEC from time to time. Copies of thesedocumentsmay be obtained byvisiting New Relic’s Investor Relationswebsite at http://ir.newrelic.comor theSEC’swebsite at www.sec.gov.

New Relic assumes no obligation and does not intend to update these forward-looking statements, except as required by law. New Relicmakes no warranties, expressed or implied, in this documentor otherwise, with respect to the information provided.

WhoamI?

Specializein:

Cloudcomputing

Services&Microservices

Scalability,Availability

28yearsinindustry7inAmazonRetail&AWS(BuiltSW/VGAppStore,AWSElasticBeanstalk)

4inNewRelic(ArchitectureLead,Cloud,ServiceMigration)

Wewantbetterappsfaster

DynamicEnvironment

BetterDataCenter

Howdoweusethecloudtoaccomplishthis?

CloudasaBetterDataCenter

Cloudasa“Better DataCenter”

Resourcesareallocatedtouses,justlikeinadatacenter

Provisioning processisfaster

Lifetimeofcomponents isrelativelylong

Capacityplanning isstillimportantand

stillapplies

Whyusea“Better DataCenter”?

AddnewCapacity(faster)

ImproveApplicationAvailability(redundancy)

ComplianceImproveApplicationAvailability(redundancy)

Whoisimpacted?

BetterDataCenter

Operations Development

Whoisimpacted?

BetterDataCenter

CanIscalemyserverfleet?Canappsrunanywhere?Howdotheyperforminthecloud?

Operations Development

Whoisimpacted?

BetterDataCenter

Operations

Datacenterisadatacenter…

Development

Whoisimpacted?

BetterDataCenter FasterApplicationLaunch/Deploy=

BetterDataCenter

Operations

Development

HowdoImonitorit?

Similartomonitoringanyotherdatacenter…

Monitoringanapplication

Typical Server / EC2 Instance

• Application & Application Microservices

• Server OS• Hardware (virtual)

EC2Instance

Application&ApplicationMicroservices

ServerOS

Server(Virtual)Hardware

AWSMonitoring

CloudWatch

• Monitors:– EC2 instance– Virtualization– Hardware– [CPU / Disk / Networking]

• Doesn’t know about:– Server OS– Memory / Filesystem– Processes– Application

• Latency• Error rates• Internal insights

EC2Instance

ServerOS

CloudWatch

AWSCONSOLE

NewRelicMonitoring

New Relic

• Monitors (Server):– How O.S. is performing– Processes– Hardware

• Monitors (Application):– App health– App performance– Microservices

• Doesn’t know– Virtualization

EC2Instance

NewRelicApplicationMonitoring

ServerOS

NewRelicServer

Monitoring

CloudWatch

DASHBOARDS

AWSCONSOLE

AWSçèNewRelicworktogether

AWS / CloudWatch

• Visibility into virtualization• CPU / Disk / Networking

New Relic

• CPU / Disk / Networking• Memory / Filesystem• Processes• Infrastructure components• Application / Microservices:– Latency– Error rates– App insights

EC2Instance

NewRelicApplicationMonitoring

ServerOS

NewRelicServer

Monitoring

CloudWatch

DASHBOARDS

CloudWatchmonitors

NewRelicmonitors

AWSCONSOLE

CloudasaDynamicTool

Cloudasa“DynamicToolforDynamicApps”

Useonlytheresourcesyouneed

Allocate/de-allocateresourceson

thefly

Resourceallocationisanintegralpartofyourapplicationarchitecture

Allocate/de-allocateresourceson

thefly

DynamicCloud

Resourcesare:

Application isawareofandiscontrolling traditionalOPs

resources

De-allocatedConsumedAllocated

AutoScale

DynamicCloud

Dockercontainers:

• Quicker/cheaperstartup/shutdownthanEC2instances

• EasytoconsumeDockercontainersmuchlikeyoudo“processes”

• Perform jobs:– Inascript– Offofsomequeueofjobrequests

DynamicCloud

83days 333days

DockerContainerAge(Countvs.Hours)

DynamicCloud

950,00011%underoneminute

DockerContainerAge(byMinuteUnderandHour)

EC2AutoScaling

DynamicCloudTechnologies

Mobile/IoTDynamicrouting

Loadbalancing

Datatransport

Queuesandnotifications

Docker

DynamicCloudisaboutscaling

HowdoImonitortheDynamicCloud?

DynamicCloudhasuniquemonitoringrequirements…

Responsibility (DynamicCloud)

ServerOS

Provisioning

Responsible for the parts you care about

• Application & Application Microservices

Let cloud manage rest

• Infrastructure• Allocation/Provisioning• Scaling

AWSInfrastructureçèNewRelicworktogether

ServerOS

CloudWatch

DASHBOARDS

ProvisioningAWS

CONSOLE

ServerOS

CloudWatch

DASHBOARDS

ProvisioningAWS

CONSOLE

ServerOS

CloudWatch

DASHBOARDS

Provisioning

CloudWatch&AWSmonitoring

NewRelicmonitors

AWSCONSOLE

Howdoyoumonitorthis?

ServerOS

Provisioning

?Howdoyoumonitorthis?

Wherediditgo?Itwasjusthere!!!

? Thethingyoumonitored10minutesago…...doesn’texistanymore!

DynamicCloud

950,00011%underoneminute

DockerContainerAge(byMinuteUnderandHour)

Monitoring theDynamicCloud

VerydifferentthanmonitoringtraditionalDataCentercomponents

Monitor theCloudComponents

themselves

Monitor thelifecycleofthe

CloudComponents

WhoisimpactedbyDynamicCloud?

BetterDataCenter

Operations

Development

DynamicCloud

BetterDataCenter

Operations

Development

DynamicCloud

What isacontainer?WhydoIcare??Itwas justhere,wherediditgo???

BetterDataCenter

Operations

Development

DynamicCloud

What isacontainer?WhydoIcare??Itwas justhere,wherediditgo???

CloudarchitectureisintegraltotheapplicationarchitectureDevelopersdeeplyinvolvedincloudactivities

Changeisspeedingup

TraditionalDataCenter

CloudDataCenter

DynamicCloud

DynamicCloudenablesbetterapplicationsfaster.

Good Better Best

Thewayyou’vedonethingsinthepastwon’tworkinthefuture.

DynamicCloud

Serverrunningapplication/processes

Dockercontainer

Processrunningacommand

Thisishard

Thingshappenfasterbecauseof…

DynamicCloud

Serverrunningapplication/processes

Dockercontainer

Processrunningacommand

Lambda

Function performingataskoroperation

TheFuturewithLambda

Microcomputing &AWSLambda

• Newestentrancetothe“dynamiccloud”

• Provideseventdrivencomputecapabilities

Microcomputing &AWSLambda

• Noinfrastructure toprovision

• Massivelysharedinfrastructure

WhyuseLambda?

Lambdascripts

Runinresponsetoastatechangeoractioninthecloud

Stateless,“filters”Performquickactions

Virtuallynostartup/shutdown

AWSLambda

S3Bucket

DynamoDB

APIGateway

RESOURCESSOME

• TakesaneventfromanAWSresource(ATrigger)

AWSLambda

S3Bucket

DynamoDB

APIGateway

RESOURCESSOME

LambdaScript

• Createsaninstancetoexecute

LambdaInstance

AWSLambda

S3Bucket

DynamoDB

APIGateway

RESOURCESSOME

S3Bucket

APIGateway SQS

RESOURCESSOMELambdaScript

• CanimpactoriginalordifferentAWSResource

LambdaInstance

AWSLambda

S3Bucket

DynamoDB

APIGateway

RESOURCESSOME

S3Bucket

APIGateway SQS

RESOURCESSOMELambdaScript

LambdaInstance

• CanimpactoriginalordifferentAWSResource

• Anynumberofinstancescanrunatatime

MonitoringLambdaScripts

Lesslikeservermonitoring /Morelikewebapplicationmonitoring

WeCareAbout

WeDon’tCareAbout

• Runtime(average,extremes–TP90/TP99)

• Statisticalmetrics

• Errorratesandotherdeviations fromnorm

• “Drilldown”intoindividual “runs”

• Detailsaboutall”runs”

• Server/infrastructuremetrics

MonitoringLambda

Morelikeapplicationperformancemonitoringthaninfrastructuremonitoring

MonitoringLambda

Morelikeapplicationperformancemonitoringthaninfrastructuremonitoring

Changeisspeedingup

TraditionalDataCenter

CloudDataCenter

DynamicCloud

DynamicCloudenablesbetterapplicationsfaster.Therateofchangeisincreasing…

Good Better Best

Thewayyou’vedonethingsinthepastwon’tworkinthefuture.

Monitoring justtheserver

EC2Instance

ServerOS

CloudWatch

Worked when rate of change was low…

AWSCONSOLE

Monitoringjusttheserver

ServerOS

Provisioning

Insufficient in the cloud:

• Rate of change is faster• Problems come up quicker• “Server” isn’t a server anymore• “Provisioning” isn’t provisioning anymore

Youneedtoptobottommonitoring…

Youneedfullstackaccountability...

NewRelicenablesaccountability betweenyourcode&AWS

Customers

Mobile/Apps/Browser

On-Premises

OnPremisesRelationalData

AWSContainerService

AWSRDSSyntheticCustomers

AWSStorageServices

YourResponsibilities

§ Applicationcode&3rd partyservices

§ Apparchitecture

§ Customerexperience

§ On-Premisescomponents

NoSQLAWSResponsibility:

§ ServiceAvailability &Performance

§ Provisioning&operationofDC

§ Isolation&securityofresources

§ Servicemaintenance&innovation

ArchitectingforScaleBy:LeeAtchisonPublishedby:O’ReillyMedia,Available:June2016www.architectingforscale.com

WanttoLearnMore?

“FlyTwoMistakesHigh”AGuidetoNotCrashing

5:40pmtoday–HotTrack1|Cloud(Room1A04)

KeepingHighAvailability

Thank you.

LeeAtchisonPrincipal Cloud Architect andAdvocate atNewRelic, Inc.

Architecting forScalePublishedby:O’Reilly Media,Available: June2016www.architectingforscale.com

Cloud Expo (Keynote) - Static vs Dynamic

Technology

ASME Turbo Expo 2017 Keynote

SPORT CARD EXPO › ve › wp-content › uploads › SCME-VE… · expo schedule friday june 19 • 2020 times location event 11:00 am main stage official expo opening remarks keynote

Register Today for ASME Turbo Expo 2011 Keynote …files.asme.org/MEMagazine/Articles/2011/February/27353.pdf · KEYNOTE SPEAKERS ANNOUNCED ... awareness of the environmental impact

Senior Expo Flyer 2016 final final 8 px...Senior Expo 2015 is a co unity serv c of the Senior Expo Com ittee and Assumption Cul ural Center – (586)779-6111-Ext.4 Senior Expo Keynote

1. Expo Keynote 2015. Il concetto Social è penetrato in profondità nelle texture aziendali

UC Expo Keynote Presentation - Flying cars and cool uniforms v2

World quality report 2014 15 test expo keynote rik marselis

Keynote Keynote Keynote Keynote

Web rtc expo v keynote final3

NEXT 2020 · • Opening Keynote • Breakout Sessions • Solutions Expo • .NEXT Test Drive Live Wednesday, September 9 • Morning Keynote • Breakout Sessions • Solutions

Cms Expo Keynote

EU at Expo Milano 2015 – Europe Day – Saturday 9 May 2015 › italy › resource › static › files › ... · EU at Expo Milano 2015 – Europe Day – Saturday 9 May 2015

21st Century Mobile Engagement keynote B2B Marketing Expo 2016

Do Static Weights Really Matter? Bowl Expo Monday, June 27, 2011

2. Expo Keynote 2015. Focus: Sharing Economy

Innovation Expo Keynote

Foundations of Excellence Keynote TCI Expo

VITRINA INTEGRAL EXPO - Exkalsa · estÁtica / static / statique ventilada / ventilated / ventile estÁtica / static / statique ventilada / ventilated / ventile vitrina expo 2 3 4

Keynote Eshop expo te Brussel Belgie Social Local Mobile 5C succesmodel

2014 SEMA Product Development Expo Keynote