Programming Languages For The Cloud

Programming Languages for the Cloud

S304101

Ted LeungPrincipal Engineer, Sun Microsystems

2009 CommunityOne Conference: WEST | developers.sun.com/events/communityone

I have questions...

More questions than answers

A kind of “Cambrian Explosion” of languages

Is there any intersection?

2009 CommunityOne Conference: WEST | developers.sun.com/events/communityone 3

Agenda

Cloud TaxonomyWhere languages intersect the cloudSecurityConcurrencyPerformanceDistributionOperational ConsiderationsDomain Specific Languages

Cloud Taxonomy

Next Gen Web

Cloud Taxonomy

Infrastructure aaS

Next Gen Web

Cloud Taxonomy

Infrastructure aaS

Next Gen Web

Stack aaS

Cloud Taxonomy

Infrastructure aaS

Next Gen Web

Stack aaS

Platform aaS

Cloud Taxonomy

Infrastructure aaS

Next Gen Web

Stack aaS

Platform aaS

Software aaS

Cloud Taxonomy

Infrastructure aaS

Next Gen Web

Stack aaS

Platform aaS

Software aaS

Storage

Cloud Taxonomy

Infrastructure aaS

Next Gen Web

Stack aaS

Platform aaS

Software aaS

Storage Compute

Cloud Taxonomy

Infrastructure aaS

Next Gen Web

Stack aaS

Platform aaS

Software aaS

Storage Compute

Virtual Machine Images

Cloud Taxonomy

Infrastructure aaS

Next Gen Web

Stack aaS

Platform aaS

Software aaS

Storage Compute

AppEngine

Cloud Taxonomy

Infrastructure aaS

Next Gen Web

Stack aaS

Platform aaS

Software aaS

Storage Compute

AppEngine Heroku

Cloud Taxonomy

Infrastructure aaS

Next Gen Web

Stack aaS

Platform aaS

Software aaS

Storage Compute

AppEngine Heroku Zembly

Cloud Taxonomy

Infrastructure aaS

Next Gen Web

Stack aaS

Platform aaS

Software aaS

Storage Compute

AppEngine Heroku

Salesforce

Zembly

IaaS Issues

No predefined software stack

You have to do everything

Languages cannot help much

Stack aaS Issues

You get whatever language is in the stack

Depends on the quality of the stack integration

Languages can help; part of the stack integration

Services are not explicitly part of the stack

PaaS in Depth

Non Relational DB

PaaS in Depth

Non Relational DB

BigTable

PaaS in Depth

Non Relational DB

BigTable Key/Value Stores

PaaS in Depth

Non Relational DB

CouchDB

PaaS in Depth

Non Relational DB

CouchDB

Identity

PaaS in Depth

Non Relational DB

CouchDB

MapReduceIdentity

PaaS in Depth

Non Relational DB

CouchDB

Asynchronous Messaging

MapReduceIdentity

PaaS in Depth

Non Relational DB

CouchDB

XMPPMapReduce

Identity

PaaS in Depth

Non Relational DB

CouchDB

QueuingXMPPMapReduce

Identity

PaaS in Depth

Non Relational DB

CouchDB

QueuingXMPPMapReduce

Identity

Payments

PaaS Issues

You get whatever language is in the platform

Platform includes network services beyond language runtime

Leads to a service oriented system

Part of the difference is the quality of the integration

SaaS Issues

SaaS applications may or may not be programmable

The SaaS may have its own language

Learning curve ahead

Very good integration

Characteristics of Cloud Environments

Multitenant

Heterogeneous

Scalability is a goal

Elastic / Provisioned by machine

Monitored/Audited

Service Oriented

Agenda

Cloud TaxonomyWhere langauges intersect the cloudSecurityPerformanceConcurrencyDistributionOperational ConsiderationsDomain Specific Languages

Areas where languages intersect the Cloud

Security / Resource Control

Performance

Concurrency

Distribution

Operational Considerations

Domain Specific Languages

Agenda

Cloud TaxonomyWhere languages intersect the cloudSecurityPerformanceConcurrencyDistributionOperational ConsiderationsDomain Specific Languages

Requirements

Multitenancy

Auditability

Resource Control

Service security

Language Models

Sandboxing• Java• PyPy• Google AppEngine

Capabilities• Caja• Joe-E• E

Agenda

Data center sizes• Google in 100,000’s• Facebook Hadoop in the 100’s (600 last count)

Performance = reduction in the number of servers• Unladen Swallow

Web site response times• interactive / rich applications• real time quotas• pushed back into the server tiers

Yeah, and multicore

Agenda

Transactional Memory

Treat main memory as a database

An MVCC database

Transactional Memory Pros

People understand transactions

Transactions compose

Transactional Memory Cons

Inefficient

Non abortable operations• I/O• Launch missile

Still have to find critical sections / txn boundaries

!"#$%&'(%)*"+",-./*

Actors

Futures

A=Future(function, arg1, arg2 ...)

MapReduce

Persistent Data Structures

Tuple Spaces

Projects

Transactional Memory• Haskell• Clojure

Actors• Erlang• Scala• Axum/F#• Libraries galore

Futures• Libraries (Java, Python, Ruby, etc)

MapReduce• Libraries (Hadoop, Disco)

Persistent Data Structures• Clojure

Projects

Tuple spaces• Jini / Javaspaces• Gigaspaces• Blitz• Tspaces• Libraries galore

Agenda

Runtime dynamic scalability• Lots of configuration needed = bad

Erlang• distribution via message sending built in• error handling by crash and restart• OTP = rich framework for distributed applications

Agenda

Cloud TaxonomyWhere languages intersect the cloudSecurityPerformanceConcurrencyDistributionOperational ConsiderationDomain Specific Languages

Monitoring

Mainly a job for the language runtimes

DTrace or other tracing

libc.so.1`_write+0x15 libc.so.1`_fflush_u+0x36 libc.so.1`fflush+0x43 libpython2.4.so.1.0`file_flush+0x2a libpython2.4.so.1.0`call_function+0x32a libpython2.4.so.1.0`PyEval_EvalFrame+0xbdf [ build/proto/lib/python/mercurial/transaction.py:49 (add) ] libpython2.4.so.1.0`PyEval_EvalCodeEx+0x732 libpython2.4.so.1.0`fast_function+0x112 libpython2.4.so.1.0`call_function+0xda libpython2.4.so.1.0`PyEval_EvalFrame+0xbdf [ build/proto/lib/python/mercurial/revlog.py:1137 (addgroup) ] libpython2.4.so.1.0`PyEval_EvalCodeEx+0x732 libpython2.4.so.1.0`fast_function+0x112 libpython2.4.so.1.0`call_function+0xda libpython2.4.so.1.0`PyEval_EvalFrame+0xbdf [ build/proto/lib/python/mercurial/localrepo.py:1849 (addchangegroup) ] libpython2.4.so.1.0`PyEval_EvalCodeEx+0x732 libpython2.4.so.1.0`fast_function+0x112 libpython2.4.so.1.0`call_function+0xda libpython2.4.so.1.0`PyEval_EvalFrame+0xbdf [ build/proto/lib/python/mercurial/localrepo.py:1345 (pull) ] libpython2.4.so.1.0`PyEval_EvalCodeEx+0x732 libpython2.4.so.1.0`fast_function+0x112

Agenda

Salesforce.com Apex

Multi-tenant code and data

Higher level• the business logic level

Statically typed

Java like control structures

Persistent object type (SObject)

Embedded Salesforce query languages (2 of them)• comprehension like

Transaction Control / Locking

Triggers as a construct• before/after insert/update/delete/undelete

Testing built in and coverage required by the platform

SOA WSDL Generation

Apex Security

Classes declared as with sharing or without sharing to enforce (or not) the current user’s sharing rules

Sharing rules specified by organizations cloud admin

Resource limiting (governing)• resources are limited in the runtime• can call a method to find out the values• different for different contexts

Apex: Concurrency

No threads

Futures

APEX: Tools

Eclipse Plugin

TextBox in Salesforce UI

Summary

Many different cloud models

Depending on the model, languages can help the cloud

Primary contribution areas• Security• Performance• Concurrency• Distribution• Operational Considerations• Domain specific languages

For More Information

Sun Cloud Home• http://sun.com/cloud

My blog• http://www.sauria.com/blog

My Twitter• @twleung

Ted Leungted.leung@sun.com @twleung

Programming Languages for the Cloud

S304101

Programming Languages For The Cloud

Technology

Justification of Programming Languages – an Introduction · Justification of Programming Languages – an Introduction ... Justification of Programming Languages – an Introduction

CSE 452: Programming Languages Logical Programming Languages Part 1

Chapter 2 Programming Languages - FTMS · Programming Languages Generations of Programming Language • The fourth generation languages, or 4GL, are languages that consist of statements

CS 363 Comparative Programming Languages Logic Programming Languages

ProgrammingLanguages Programming Languages Parallel Programming languages

Programming languages and compilers - STUDIUM … · Programming languages and compilers Programming languages ... 1968 ALGOL 68 Widely used ... procedure faktorial is

Term 2, 2011 Week 1. CONTENTS Problem-solving methodology Programming and scripting languages – Programming languages Programming languages – Scripting

Kay - Programming and Programming Languages

Programming Languages and Design Lecture 3 Semantic Specifications of Programming Languages

Programming, Programming Languages and Programming Methods

03-60-440: Principles of Programming Languages Classification of programming languages

Programming Languages

CS 363 Comparative Programming Languages Evolution of Programming Languages

Chapter 3 Programming Languages Unit 1 The Development of Programming Languages

Programming languages

Programming Languages Chapter OneModern Programming Languages, 2nd ed.1

CSE 452: Programming Languages Logical Programming Languages Part 2