ArcGIS in the Cloud -...

Preview:

Citation preview

ArcGIS in the CloudAndrew Sakowicz & Alec Walker

Key Takeaways

• How to Identify Organizational Strategy & Priorities

• Esri’s Cloud Offerings – A Broad Spectrum

• Successfully Executing Your Strategy

IT’s Fasted Growing Segment

The Cloud

73% of Enterprise Workloads Will be in the Cloud by 2020The public cloud will be half of the cloud market

https://www.forbes.com/sites/louiscolumbus/2018/01/07/83-of-enterprise-workloads-will-be-in-the-cloud-by-2020/

Growth will come across cloud typesMore organizations will be adopting IaaS & leveraging PaaS

https://www.forbes.com/sites/louiscolumbus/2017/04/29/roundup-of-cloud-computing-forecasts-2017/

Cloud adoption is still in progress1/3 of the market considers itself “cloud-focused”

http://assets.rightscale.com/uploads/pdfs/RightScale-2017-State-of-the-Cloud-Report.pdf

The picture changes when the organization’s size is consideredEnterprise customers are adopting more slowly

http://assets.rightscale.com/uploads/pdfs/RightScale-2017-State-of-the-Cloud-Report.pdf

Cloud Vendor Adoption Y^YAzure making big gains

http://assets.rightscale.com/uploads/pdfs/RightScale-2017-State-of-the-Cloud-Report.pdf

What about you?A look at your peers

No Plans 0

Cloud Watcher (Planning) 16

Cloud Beginner (First Project) 20

Cloud Explorer (Apps Running) 16

Cloud-Focused (Heavy Use) 4

Cloud Maturity

Amazon Web Services 22

Microsoft Azure 30

IBM 1

Oracle 1

Other (SAP, Google, etc.) 5 (all Google)

Cloud Vendor

Responses aggregated from attendees

Priorities & Considerations

Identifying Your Cloud Strategy

Consider the Scope & AlignmentEnterprise or Initiative-driven

• Multiple business units affected by move

• Stakeholders typically include executive leadership

• Funding from multiple groups or central fund

• Individual business unit affected by move

• Stakeholders do not typically include executive leadership

• Funding from single budget

A Business Strategy B Location Strategy C IT Strategy

InitiativeEnterprise

A B C B C

Business

Financial

Focus

Flexibility/Agility

In-source vs. Out-source

Technology

Performance

Flexibility

Infrastructure

Organizational

Skills

Efficiency

Staffing

Cloud Mandate Transactional costs/friction

Systems integration

Strategy Factors for Consideration

DecisionSupport

Gain situational awareness, & enable information-driven decision making

Analytics

Discover, quantify, & predict trends &

patterns to improve outcomes

DataManagement

Collect, organize, & maintain accurate

locations & details about assets & resources

Field Mobility

Manage & enable a mobile workforce to

collect & access information in the field

ConstituentEngagement

Communicate & collaborate with citizens & external communities

of interest

Sharing & Collaboration

Empower everyone to easily discover, use,

make, & share geographic information

Mapping & Visualization

Understand locations & relationships with maps & visual representations

Monitoring

Track, manage, & monitor assets &

resources in real-time

Design & Planning

Evaluate alternative solutions & create optimal designs

ArcGISCommon Patterns of Use

Full spectrum of options

Esri Deployment Options

EnterpriseDeployment Patterns

ArcGIS Online

On-premises Public Cloud SaaS

ArcGIS Enterprise ArcGIS Enterprise

Hybrid deployments most common

Self Managed or Esri Managed

ArcGIS in the CloudA full-spectrum of options

SaaS Do-it-yourself

ArcGIS OnlineEsri-Managed Environment

Customer-Managed Environment

CloudFormation & Cloud Builder Templates

ArcGIS OnlineEsri’s SaaS Offering

What is it?

Esri’s SaaS offering. An online collaborative web GIS that allows customers to use, create, & share maps, apps, layers, analytics & data.

Who uses it?

ArcGIS Online is a multi-tenanted solution. Customers manage their users, content, & apps through ArcGIS Online Identity & organizations.

Where is it available?

Available for use worldwide. ArcGIS online is installed across multiple cloud providers & US regions.

Who is the customer’s relationship with?

The customer’s relationship is with Esri. The customer uses the system & billed based on consumption.

Esri-Managed EnvironmentsAn Esri Managed Cloud Service

What is it?

Esri experts managing GIS content, apps, & systems on market-leading cloud platforms on behalf of customers.

Who uses it?

Single-tenant environments. Customers manage their users & access to content & apps through Portal or SAML.

Where is it available?

In the US. Can be installed across multiple cloud providers & regions (domestic & international).

Who is the customer’s relationship with?

The customer’s relationship is with Esri. Esri maintains a relationship with the cloud provider.

Customer-Managed EnvironmentDevelopment & Prototyping in the Cloud

What is it?

GIS-ready infrastructure procured, provisioned, installed with Esri software, & backed-up by Esri Managed Cloud Services

Who uses it?

Single-tenant environments. Customers manage their users & access to content & apps through identity.

Where is it available?

In the US. Can be installed across multiple cloud providers & regions (domestic & international).

Who is the customer’s relationship with?

The customer’s relationship is with Esri. Esri maintains a relationship with the cloud provider.

CloudFormation & Cloud Builder TemplatesDIY Cloud

What is it?

Esri-maintained ArcGIS Enterprise images available through Microsoft Azure & Amazon Web Services marketplaces. Customers procure, provision, & install all cloud infrastructure & licensing.

Who uses it?

Single-tenant environments.

Where is it available?

Worldwide. Installed across multiple cloud providers & regions worldwide.

Who is the customer’s relationship with?

The customer has a relationship the cloud provider for infrastructure. Customer also maintains a relationship with Esri for licensing.

Common Usages

ArcGIS Workloads in the Cloud

From simple to complex systems

Content HOSTING & PUBLICATION OF GIS CONTENT

HOSTING & MANAGEMENT OF WEB APPLICATIONS & CONTENTApplication(s)

HOSTING & MANAGEMENT OF AN ORGANIZATION’S GIS SYSTEMS INCLUDING CONTENT, APPLICATIONS, & PORTALSystem of Engagement

HOSTING & MANAGEMENT OF AN ORGANIZATION’S GIS SYSTEMS INCLUDING CONTENT, APPLICATIONS, PORTAL, & DESKTOP

System of Record

Common Patterns of Cloud Usage

Decreasing cost of hosting imagery

Expert guidance for cloud options

Cloud management & expertise

Optimizing imagery services

Application Hosting for public usage

Public-facing GIS rich information outside the firewall

Highly available, scalable systems

Supports day-to-day usage & major events

Frequent, automated data updates

GIS & cloud expertise

100% cloud-based GIS practice

Anywhere, anytime on any device

Outsourced GIS Operations

GIS Platform managed in the cloud

Virtual Desktops ArcGISEnterprise Extensions

ArcGIS DesktopsArcGIS Enterprise

Data Services

3rd Party Systems

BasemapsOn-Premises

Desktop Web Device

Esri ArcGIS OnlineEsri Managed Cloud Services

Technical Considerations

Design process is similar for cloud or on premises

• Business Architecture

- GIS Domain

- Business Processes

- Requirements

• Application Architecture

- Application Technology

- User Workflows

• Data Architecture

- Data Management

- Data Storage

• Technology Architecture

- Infrastructure

- IT Constraints

The Open Group Architecture Framework (TOGAF)

Design process is similar for cloud or on premisesEsri services and tools

Approach to Solutions

• Configure first

• Customize second

- Extend where possible

Deviations from “core” increase risk!

Environment Isolation

• Production: operational, real-time compute environment

• Staging: a separate, mirrored, pre-production environment

• Development: a limited scale and scope environment sufficient for the development of primary code and data modeling.

Visualization Analysis &

Data Management

Imagery

LBLBLB

ArcGIS Server ArcGIS Server ArcGIS Server

Visualization &

Imagery

LB

ArcGIS Server

Initial Deployment Complete GIS

Workload Separation

Workload Separation

• Separate technology deployments by solution pattern

• Benefits include:

- Reduced risk

- Improved service delivery

- Reduced system resource contention

- Optimized resource utilization

Typically SLAs determine which server deployments need to be separated

Analysis Constituent

Engagement

portal

portal

portal

portal

One Portal Many Portals?

One or multiple portals?

Keep data and ArcGIS Server in the same locationCentralized

Single data center = lower cost

Performance depends on network: good bandwidth and low latency

Keep data and ArcGIS Server in the same location

• Can data leave country boundary?

• Challenges of frequent refreshes of large data sets

Distributed

Good performance-local application and data

Might require complex replication and synchronization process

Multiple datacenters = higher costs

WellsWells

Active Wells

Proposed Wells

Wells by Status

Portal GeoServices Geodata

Publication StrategiesThe Role of Portal & Web Layers

Hosting server

• Scalable solution - can publish thousands of services

Leverage Identity

• Integrate with your existing IDM system

• Configure in the portal

- Users

- Roles

- Privileges

• Incorporate in your apps

Identity matters!

Strategies for minimizing downtime and data loss

Backup and Restore High Availability Geographic Redundancy Geographic Redundancy

with High Availability

Increasing complexity and required resources

Availability

• Availability is usually expressed as a percentage of uptime in a given time span, e.g. month, year:

• Availability (%)=(Total time – Downtime) / Total Time *100%

Availability % Downtime per year Downtime per monthDowntime per

weekDowntime per day

90% ("one nine") 36.5 days 72 hours 16.8 hours 2.4 hours

95% ("one and a half nines") 18.25 days 36 hours 8.4 hours 1.2 hours

99% ("two nines") 3.65 days 7.20 hours 1.68 hours 14.4 minutes

99.5% ("two and a half nines") 1.83 days 3.60 hours 50.4 minutes 7.2 minutes

99.9% ("three nines") 8.76 hours 43.8 minutes 10.1 minutes 1.44 minutes

99.95% ("three and a half nines") 4.38 hours 21.56 minutes 5.04 minutes 43.2 seconds

99.99% ("four nines") 52.56 minutes 4.38 minutes 1.01 minutes 8.64 seconds

How to measure availability?

• Downtime defined only by downtime of critical components

41

Monitor: Optimize Your Enterprise GIS Deployments

• Monitor the health, usage, SLA

• Improve performance

• Reduce administration costs

• Quickly diagnose:

- Unstable infrastructure

- Overloaded system

- Bottlenecks

ArcGIS Monitor: Scalable and non-intrusive: Used by Esri Managed Cloud Services to Monitor 500+ GIS Servers

Example: Esri platform architecture

Example: Dev ops script sequencee.g. Cloud templates, Terraform, Chef, PowerShell, ArcPY

RACI Chart

• Deployment and- Infrastructure

- Software

- Application

- Data

• Operations- Change Management

- Service Desk

- Incident Management

- Data Management

- Application Management

- Patches

Responsible, Accountable, Consulted, Informed

Success depends on you

Successfully Implementing Your Cloud Strategy

Four-step ProcessSuccess for all scopes

Go in with the Right MindsetAdvocate across Enterprise

Location StrategyThe guiding principles of success

• What is the organizational mission?

• What is the bold vision?

• What are your top business drivers & considerations?

• What does success look like?

Assess & PlanHonestly reflecting on what’s working & what’s not

• Establish baselines

• Cloud Readiness Assessment

- Inventory data, workflows, applications, & users

- Evaluate responsibilities

- Measure capacity of IT

- Establish skills of individuals

Build CapabilitySmall steps towards success

• Focus on highest priority

• Demonstrate value

• Show rapid results – prototype before production

• Configure first

• Share results to generate excitement

Operate & MeasureMonitor & move on

• Monitor system performance

• Collect & measure feedback from users & stakeholders

• Select additional priority from location strategy & begin again

A Success Story

The Journey to a Successful Implementation

Location Strategy

Assess & Plan

Build Capability

2

1

3

4Operate & Measure

0 A Solid Foundation

• Driven by Executive Sponsor• Clear project leader• Alignment with Business & IT

Strategy

• Bold vision – All GIS in a central, shared location information w/o duplication

• Location information a central, critical system

• Clearly documented what successes look like

• Clear measurements of baseline performance & usage

• Planning committee established priorities

• Completed thorough assessment in 2016

• Honest in what they could, should, & wanted to do

• Agreed to crawl, walk, run approach

• Develop a prototype then move to Production

• Quick, small wins

• Regular steering committee meetings

• Review priorities & performance

Review Key Takeaways

• How to Identify Organizational Strategy & Priorities

• Esri’s Cloud Offerings – There’s more than ArcGIS Online

• Successfully Executing Your Strategy

Questions?

Download the Esri Events

app & find your eventSelect the session

you attended

Scroll down to find the

feedback section

Complete answers

& select “Submit”

Please Take Our Survey in the Esri Events App

Thank You to Our Sponsors

GOLD

SPONSORS

SILVER

SPONSORS

Thank You

Recommended