Bogdan botea, dmitry nefedkin no fiddle, efficient development on the google cloud

No fiddle, efficient development on the Google Cloud Platform

Dmitry NefedkinGoogle Cloud Platform Solutions Engineer, Google

Bogdan BoteaLead Developer, Appsbroker Consulting

● Founded 7 Years ago, UK based● Google Reseller, Consultancy, Managed Services & Products● Google EMEA Partner of the year 2012● Worked on some of Google’s most prestigious projects● UK Premier Apps Reseller, Cloud Platform Service Provider,

We are also a Premier Search Reseller● GEO, GSA, Platform & Apps Certified

Who are Appsbroker?

Please note that some of the slides have been removed.

Please come to our next event to get updated on the latest information about Google for Work and Appsbroker.

Agenda■ Google awesome infrastructure - Dmitry■ Before the clouds■ Appsflow on App Engine■ Live coding■ Q&A

Google confidential | Do not distribute

Enrich your work environment.

Enable your information workers.

Drive innovation.

Live in a modern workplace.

Why Cloud Computing?

Google confidential | Do not distribute

Enterprise Cloud Platform market will exceed $22B globally by 2015.2013

IT Trends

The decreasing cost of storage enables virtually limitless storage in the cloud. $600 can buy enough storage for the world’s music.

(Source: McKinsey Global Institute May 2011)

Computing as a utility is now available for easy purchase, provided from massively efficient data centers.

(Source: Nicholas Carr, The Big Switch, 2008)

The internet allows for a model of real-time access to new innovation, information and applications from a wide range of devices.

AffordableCapacity

On-demandcomputing

Instantaccess

For the past 16 years, Google has been building out the world’s fastest, most powerful, highest quality cloud infrastructure on the planet.

Cloud Platform is built on the same infrastructure that powers Google.

Google's Network Spans the Globe

Google's Global OpenFlow Network

2002 2004 2006 2008 2010 2012

Google Innovations in Software

ColossusDremelMapReduce

SpannerGFS Big Table

Images by Connie Zhou

Wired, 'Google Throws Open Doors To Its Top Secret Data Center', October 2012

Google's Platform"[Google's] ability to build, organize, and operate a huge network of servers and fiber-optic cables with an efficiency and speed that rocks physics on its heels.

This is what makes Google Google: its physical network, its thousands of fiber miles, and those many thousands of servers that, in aggregate, add up to the mother of all clouds."

- Wired

IaaS PaaS SaaSInfrastructure-as-a-Service Platform-as-a-Service Software-as-a-Service

Google Cloud Platform

Cloud Computing

IaaS PaaS SaaSInfrastructure-as-a-Service Platform-as-a-Service Software-as-a-Service

Google

ApplicationsDataRuntimeMiddlewareO/SVirtualizationServersStorageNetworking

ApplicationsDataRuntimeMiddlewareO/SVirtualizationServersStorageNetworking

ApplicationsDataRuntimeMiddlewareO/SVirtualizationServersStorageNetworking

PackagedSoftware

ApplicationsDataRuntimeMiddlewareO/SVirtualizationServersStorageNetworking

Cloud ComputingYou Manage Vendor Managed

Storage App ServicesCompute

Cloud Storage

Cloud SQL

Cloud Datastore

Compute Engine

App Engine

BigQuery

Cloud Endpoints

Google Cloud Platform

Mobile Gaming

Big Data

Storage

High Performance Computing Digital Marketing

4 Million active applications in our cloud

And your applicationcan be the next!

Dmitry NefedkinGoogle Cloud Solutions Engineernda@google.com

No fiddle, efficient development on the Google Cloud Platform

Bogdan BoteaLead Developer, Appsbroker Consulting

Vasile IrimiaGoogle Cloud Platform Developer, Appsbroker Consulting

Appsbroker team

Agenda■ Google awesome infrastructure - Dmitry■ Before the clouds■ Appsflow on App Engine■ Live coding ■ Q&A

Today’s developers

Flip the focus

Copyright 2014 Google Inc

GAE Architecture And Optmization

Use Case - Real Time Earthquake Monitor

NIED

App Engine

Metrics collected at

NIED

NIED pushes the image file to GAE every second

Clients pulls the image every two seconds

● GAE Web App By NIED Japan + Googleo National research Institute for

Earth science and Disaster prev.o The blinking dots represents real

time Peak Ground Acceleration ● YouTube video How it worked at the

March 11, 2011 earthquake● 20,000 concurrent users

10,000 reqs/sec at peak

Web Application challenges● Scalability

● Reliability

● Cost efficiency

Designing for Scale and Reliability

How do I design a web service that is scalable and reliable like this?

Copyright 2014 Google Inc

GAE Architecture And Optmization

To Build in Traditional Way...

➢ Hardware Failures

➢ Traffic Spike

➢ Growing Big Data

➢ Complex Design

➢ Complex Dev.

➢ Complex Admin

➢ Cost

What About

Copyright 2014 Google Inc

GAE Architecture And Optmization

To Build with Google App Engine

✓ Hardware Failures

✓ Traffic Spike

✓ Growing Big Data

✓ Simpler Design

✓ Simpler Dev

✓ No Admin

✓ No Initial Funding

How About

Agenda (to redesign)■ Google awesome infrastructure - Dmitry■ Before the clouds■ Appsflow on App Engine■ Live code ■ Q&A

Appsflow

Appsflow - Data model

● HRD Datastore

● Sharding

● Denormalization

Appsflow - HRD DatastoreDatastore RDBMS

Query language flexibility

SQL-like query language● Limited to simple filter and sort

Full support of SQL● Table JOIN● Flexible filtering● Subquery

Reliability and Scalability

Highly scalable and reliable Hard to scale

Appsflow - Service layer

● Business logic & transaction management

● DI

● Task Queue API

● Cron jobs

Appsflow - Task QueueUse Task Queue API to execute background work

Queue queue = QueueFactory.getQueue("workflow-queue");

queue.add(TaskOptions.Builder.withUrl("/backend/taskqueue").

param("nodeId", node.getKeyAsString()));

Appsflow - Cron jobsUse Cron jobs to execute periodic tasks

<?xml version="1.0" encoding="UTF-8"?>

<cronentries>

<cron>

<url>/checkworkflows</url>

<description>Periodically check for blocked workflows</description>

<schedule>every day 00:00</schedule>

</cron>

</cronentries>

Appsflow - Cloud Endpoints

● Expose standards based REST interfaces with built in Authorization

● Use auto-generated, strongly typed, mobile optimized client

libraries for Android, iOS and web.

Appsflow - Memcache

MemchacheService cache = MemcacheServiceFactory.getMemcacheService();

…

User user = cache.get(“accessToken”) ;

if (user != null) {

return user;

} else {

// retrieve user details and update the datastore

cache.put(“accessToken”, user, Expiration.byDeltaSeconds(DURATION_IN_SECONDS));

return user;

}

Snapchat

Delivers 400 million photos a day

Agenda■ Google awesome infrastructure - Dmitry■ Before the clouds■ Appsflow on App Engine■ Live coding■ Q&A

$500 in Cloud Platform credit to launch your idea!

Build. Store. Analyze.On the same infrastructure

that powers GoogleA voucher will be sent to your email

Click ‘Apply Now’ and complete the application with

promo code: codecamp-con

1

2

3

Go to cloud.google.com/starterpack

Start using Cloud Platform now!

4 Create a new Project in Cloud Console,

activate the billing and apply voucher -

http://console.developers.google.

com/billing/redeem

Q&A

Bogdan Boteabogdan.botea@appsbroker.com