41
Introduction to the Google Cloud Platform Mandy Waite, Google Developer Relations @tekgrrl

Mandy Waite, Warszawa marzec 2013

Embed Size (px)

Citation preview

Page 1: Mandy Waite, Warszawa marzec 2013

Introduction to the Google Cloud Platform

Mandy Waite, Google Developer Relations@tekgrrl

Page 2: Mandy Waite, Warszawa marzec 2013

Google App Engine Google BigQuery

Scalable application development and

execution environment

NoSQL DatastoreAuto-scaling FrontendsLong-lived Backends

Task Queues

Google Compute Engine

Virtual machines

Run arbitrary workloads at scale(e.g. Hadoop, scientific computing)

Google Cloud Platform

Google Cloud Storage

Google Cloud SQL

Interactive analysis of massive datasets at speed

Performant and scalable service for storing and accessing data

MySQL-based, fully managed service

Page 3: Mandy Waite, Warszawa marzec 2013

Google App Engine

Page 4: Mandy Waite, Warszawa marzec 2013

Easy to buildEasy to scaleEasy to maintain

Opinionated web framework and deployment platform

Page 5: Mandy Waite, Warszawa marzec 2013

Get up and running quickly - NO Servers

SDKPython, Java, Go runtimesLocal development server, Eclipse

Google InfrastructureAuto-scales

Admin ConsoleEasy managementLogs

Page 6: Mandy Waite, Warszawa marzec 2013

Python Runtime Java Runtime Task Queues High Replication Datastore

Google Storage

Announce

BigQueryAnnounce

Backends, Pull Queues

Out of Preview

SLASupport

Google Storage GA

Cloud SQLAnnounce

2012

Cloud SQLGA

BigQuery GA

And growing: by the numbers

Google App Engine passed 7.5B+ daily hits

Page 7: Mandy Waite, Warszawa marzec 2013

1,000,000 active applications2 Trillion datastore operations

half of active world IP addresses touch GAE

A month in the life of Google App Engine:

Page 8: Mandy Waite, Warszawa marzec 2013

Google App Engine Highlights

Fully managed SQL & NoSQL services

Rich APIs and Services:Task Queues, Memcache, Search, Users, Cloud Endpoints, Socket, Image, Files...

Flexible pricing: free to get started, SLA from $9/moRange of support packages: https://cloud.google.com/support/packages

Page 9: Mandy Waite, Warszawa marzec 2013

Application Hosting in EU

Data replicated within EU

Google App Engine European Data CentersCompliance and Locality

Page 10: Mandy Waite, Warszawa marzec 2013

“ With Google App Engine, we don't need a system administrator or anyone dedicated to deploying our app, so 99% of our time is working on our application.. ”

Ben Kamens, Lead Engineer Kahn Academy

Page 11: Mandy Waite, Warszawa marzec 2013
Page 12: Mandy Waite, Warszawa marzec 2013
Page 13: Mandy Waite, Warszawa marzec 2013

Google Cloud Endpoints

Business Logic

APIs for Mobile and Web Backends Made Easy(Experimental)

Storage(Datastore, SQL, Drive, etc)

Web APIs

End

poin

ts

Page 14: Mandy Waite, Warszawa marzec 2013

Search API(Experimental)

Add Google-like full-text search to your application

● Custom scoring and snippeting

● GeoSearch

Page 15: Mandy Waite, Warszawa marzec 2013

Development Stack

Page 16: Mandy Waite, Warszawa marzec 2013

Google Compute Engine

Page 17: Mandy Waite, Warszawa marzec 2013

Introducing Google Compute Engine

Compute FasterVitrtual machines running on Google environmentally friendly Infrastructure. Ideal for:

● large scale data analysis● Batch processing● Variable size workloads.

Scale EfficientlyRapidly scale to tens of thousands of cores on infrastructure designed for large-scale computing

Save MoreBenefit from low total cost of ownership. Save more with Google Compute Engine.

Page 18: Mandy Waite, Warszawa marzec 2013

Introducing Google Compute Engine

Adding Virtual Machines to the Google Cloud Platform

Compute

Launch Linux Virtual Machines on demand

Network

Connect your VMs together to form powerful clusters

Storage

Store on persistent disk, local disk or Cloud Storage

Tooling

Control your VMs via REST API or command line

Page 19: Mandy Waite, Warszawa marzec 2013

Architecture

Page 20: Mandy Waite, Warszawa marzec 2013

What's in a VM

Linux VMs

● Root access

● Debian-based Linux or

CentOS

● Many hardware configurations

○ 1, 2, 4, or 8 CPUs

○ Up to 52GB of RAM

Page 21: Mandy Waite, Warszawa marzec 2013

API Basics

● JSON over HTTP

● Main Resources (Nouns)

○ Projects

○ Instances

○ Networks and Firewalls

○ Disks and Snapshots

○ Zones

○ Actions (Verbs):

● GET, POST (create) and DELETE

○ Custom ‘verbs’ for updates

○ Auth via OAuth2

Page 22: Mandy Waite, Warszawa marzec 2013

Clients and Libraries

● gcutil: command line utility

● Web UI: Built on GAE

● Libraries

● Partners and ecosystem

Page 23: Mandy Waite, Warszawa marzec 2013

Flexible Storage Options

Persistent DiskFast, consistent performanceNetwork Connected, ReplicatedSnapshots for backup and restoreShareableEncrypted at Rest

Google Cloud StorageSeamless AuthenticationSecure AccessEU datacenter option

Ephemeral DiskUsed to boot VMLives and dies with VMEncrypted at Rest

Page 24: Mandy Waite, Warszawa marzec 2013

Right now:

● Limited preview

● Focused on compute intensive and batch

workloads

● SLA and support available to commercial

customers

● Apply: http://cloud.google.com

● Talk to us! We're happy to discuss your

use case

CC Image courtesy of London looks

i can haz Compute Engine?

Page 25: Mandy Waite, Warszawa marzec 2013

Storing Data

Page 26: Mandy Waite, Warszawa marzec 2013

Storage Systems at Google

Page 27: Mandy Waite, Warszawa marzec 2013

Structured Data: NoSQL + SQL

Schemaless

Queries, Atomic Transactions

Best for Internet Scale, denormalizable DataSets

Think Differently ... No Joins

Familiar MySQL

Fully Managed

Best for Bounded Scale, highly structured DataSets

Experimental

Page 28: Mandy Waite, Warszawa marzec 2013

Unstructured: Google Cloud Storage

Page 29: Mandy Waite, Warszawa marzec 2013

Google BigQuery

Page 30: Mandy Waite, Warszawa marzec 2013

Big Data at Google

72 hours100 million gigabytes425 million users

Page 31: Mandy Waite, Warszawa marzec 2013

BigQuery gives you this power

Store data with reliability, redundancy and consistency

Go from data to meaning

Quickly!

At scale ...

Page 32: Mandy Waite, Warszawa marzec 2013

How are developers using it?

Game and social media analytics

Advertising campaign optimization

Sensor data analysis

Infrastructure monitoring

Page 33: Mandy Waite, Warszawa marzec 2013

Regular expressions on 15.7 billion rows...

Page 34: Mandy Waite, Warszawa marzec 2013

Google Cloud Storage

Upload your Data

BigQuery

Page 35: Mandy Waite, Warszawa marzec 2013

Google Spreadsheets via Apps Script

Page 36: Mandy Waite, Warszawa marzec 2013

Google Spreadsheets via Apps Script

Page 37: Mandy Waite, Warszawa marzec 2013

● Java● Python● .NET● PHP● JavaScript● Apps Script● ... more ...

Libraries

Page 38: Mandy Waite, Warszawa marzec 2013

It's a RESTful API

Page 39: Mandy Waite, Warszawa marzec 2013

Wrap Up

Page 40: Mandy Waite, Warszawa marzec 2013

Questions?

cloud.google.com

Page 41: Mandy Waite, Warszawa marzec 2013

Thank you!

http://developers.google.com/cloud