Programming Languages For The Cloud

Programming Languages for the Cloud

S304101

Ted LeungPrincipal Engineer, Sun Microsystems

2009 CommunityOne Conference: WEST | developers.sun.com/events/communityone

I have questions...

More questions than answers

A kind of “Cambrian Explosion” of languages

Is there any intersection?

2

2009 CommunityOne Conference: WEST | developers.sun.com/events/communityone 3

Agenda

Cloud TaxonomyWhere languages intersect the cloudSecurityConcurrencyPerformanceDistributionOperational ConsiderationsDomain Specific Languages


Cloud Taxonomy

4


Cloud Taxonomy

4

Util

ity/E

ffici

ency


Cloud Taxonomy

4

Next Gen Web

Util

ity/E

ffici

ency


Cloud Taxonomy

4

Infrastructure aaS

Next Gen Web

Util

ity/E

ffici

ency


Cloud Taxonomy

4

Infrastructure aaS

Next Gen Web

Util

ity/E

ffici

ency

Stack aaS


Cloud Taxonomy

4

Infrastructure aaS

Next Gen Web

Util

ity/E

ffici

ency

Stack aaS

Platform aaS


Cloud Taxonomy

4

Infrastructure aaS

Next Gen Web

Util

ity/E

ffici

ency

Stack aaS

Platform aaS

Software aaS


Cloud Taxonomy

4

Infrastructure aaS

Next Gen Web

Util

ity/E

ffici

ency

Stack aaS

Platform aaS

Software aaS

Storage


Cloud Taxonomy

4

Infrastructure aaS

Next Gen Web

Util

ity/E

ffici

ency

Stack aaS

Platform aaS

Software aaS

Storage Compute


Cloud Taxonomy

4

Infrastructure aaS

Next Gen Web

Util

ity/E

ffici

ency

Stack aaS

Platform aaS

Software aaS

Storage Compute

Virtual Machine Images


Cloud Taxonomy

4

Infrastructure aaS

Next Gen Web

Util

ity/E

ffici

ency

Stack aaS

Platform aaS

Software aaS

Storage Compute


AppEngine


Cloud Taxonomy

4

Infrastructure aaS

Next Gen Web

Util

ity/E

ffici

ency

Stack aaS

Platform aaS

Software aaS

Storage Compute


AppEngine Heroku


Cloud Taxonomy

4

Infrastructure aaS

Next Gen Web

Util

ity/E

ffici

ency

Stack aaS

Platform aaS

Software aaS

Storage Compute


AppEngine Heroku Zembly


Cloud Taxonomy

4

Infrastructure aaS

Next Gen Web

Util

ity/E

ffici

ency

Stack aaS

Platform aaS

Software aaS

Storage Compute


AppEngine Heroku

Salesforce

Zembly


IaaS Issues

No predefined software stack

You have to do everything

Languages cannot help much

5


Stack aaS Issues

You get whatever language is in the stack

Depends on the quality of the stack integration

Languages can help; part of the stack integration

Services are not explicitly part of the stack

6


PaaS in Depth

7


PaaS in Depth

7

Non Relational DB


PaaS in Depth

7

Non Relational DB

BigTable


PaaS in Depth

7

Non Relational DB

BigTable Key/Value Stores


PaaS in Depth

7

Non Relational DB


CouchDB


PaaS in Depth

7

Non Relational DB


CouchDB

Identity


PaaS in Depth

7

Non Relational DB


CouchDB

MapReduceIdentity


PaaS in Depth

7

Non Relational DB


CouchDB

Asynchronous Messaging

MapReduceIdentity


PaaS in Depth

7

Non Relational DB


CouchDB


XMPPMapReduce

Identity


PaaS in Depth

7

Non Relational DB


CouchDB


QueuingXMPPMapReduce

Identity


PaaS in Depth

7

Non Relational DB


CouchDB


QueuingXMPPMapReduce

Identity

Payments


PaaS Issues

You get whatever language is in the platform

Platform includes network services beyond language runtime

Leads to a service oriented system

Part of the difference is the quality of the integration

8


SaaS Issues

SaaS applications may or may not be programmable

The SaaS may have its own language

Learning curve ahead

Very good integration

9


Characteristics of Cloud Environments

Multitenant

Heterogeneous

Scalability is a goal

Elastic / Provisioned by machine

Monitored/Audited

Service Oriented

10


Agenda

Cloud TaxonomyWhere langauges intersect the cloudSecurityPerformanceConcurrencyDistributionOperational ConsiderationsDomain Specific Languages


Areas where languages intersect the Cloud

Security / Resource Control

Performance

Concurrency

Distribution

Operational Considerations

Domain Specific Languages

12


Agenda

Cloud TaxonomyWhere languages intersect the cloudSecurityPerformanceConcurrencyDistributionOperational ConsiderationsDomain Specific Languages


Requirements

Multitenancy

Auditability

Resource Control

Service security

14


Language Models

Sandboxing• Java• PyPy• Google AppEngine

Capabilities• Caja• Joe-E• E

15


Agenda



Data center sizes• Google in 100,000’s• Facebook Hadoop in the 100’s (600 last count)

Performance = reduction in the number of servers• Unladen Swallow

Web site response times• interactive / rich applications• real time quotas• pushed back into the server tiers

Yeah, and multicore

17


Agenda



Transactional Memory

Treat main memory as a database

An MVCC database

19


Transactional Memory Pros

People understand transactions

Transactions compose

20


Transactional Memory Cons

Inefficient

Non abortable operations• I/O• Launch missile

Still have to find critical sections / txn boundaries

21


!

!"#$%&'(%)*"+",-./*


Actors

23




Futures

A=Future(function, arg1, arg2 ...)

26


MapReduce

27



Persistent Data Structures

29


Tuple Spaces

30



Projects

Transactional Memory• Haskell• Clojure

Actors• Erlang• Scala• Axum/F#• Libraries galore

Futures• Libraries (Java, Python, Ruby, etc)

MapReduce• Libraries (Hadoop, Disco)

Persistent Data Structures• Clojure

32


Projects

Tuple spaces• Jini / Javaspaces• Gigaspaces• Blitz• Tspaces• Libraries galore

33


Agenda



Runtime dynamic scalability• Lots of configuration needed = bad

Erlang• distribution via message sending built in• error handling by crash and restart• OTP = rich framework for distributed applications

35


Agenda

Cloud TaxonomyWhere languages intersect the cloudSecurityPerformanceConcurrencyDistributionOperational ConsiderationDomain Specific Languages


Monitoring

Mainly a job for the language runtimes

DTrace or other tracing

37


libc.so.1`_write+0x15 libc.so.1`_fflush_u+0x36 libc.so.1`fflush+0x43 libpython2.4.so.1.0`file_flush+0x2a libpython2.4.so.1.0`call_function+0x32a libpython2.4.so.1.0`PyEval_EvalFrame+0xbdf [ build/proto/lib/python/mercurial/transaction.py:49 (add) ] libpython2.4.so.1.0`PyEval_EvalCodeEx+0x732 libpython2.4.so.1.0`fast_function+0x112 libpython2.4.so.1.0`call_function+0xda libpython2.4.so.1.0`PyEval_EvalFrame+0xbdf [ build/proto/lib/python/mercurial/revlog.py:1137 (addgroup) ] libpython2.4.so.1.0`PyEval_EvalCodeEx+0x732 libpython2.4.so.1.0`fast_function+0x112 libpython2.4.so.1.0`call_function+0xda libpython2.4.so.1.0`PyEval_EvalFrame+0xbdf [ build/proto/lib/python/mercurial/localrepo.py:1849 (addchangegroup) ] libpython2.4.so.1.0`PyEval_EvalCodeEx+0x732 libpython2.4.so.1.0`fast_function+0x112 libpython2.4.so.1.0`call_function+0xda libpython2.4.so.1.0`PyEval_EvalFrame+0xbdf [ build/proto/lib/python/mercurial/localrepo.py:1345 (pull) ] libpython2.4.so.1.0`PyEval_EvalCodeEx+0x732 libpython2.4.so.1.0`fast_function+0x112


Agenda



Salesforce.com Apex

Multi-tenant code and data

Higher level• the business logic level

Statically typed

Java like control structures

40


Apex

Persistent object type (SObject)

Embedded Salesforce query languages (2 of them)• comprehension like

Transaction Control / Locking

Triggers as a construct• before/after insert/update/delete/undelete

41


Apex

Testing built in and coverage required by the platform

SOA WSDL Generation

42


Apex Security

Classes declared as with sharing or without sharing to enforce (or not) the current user’s sharing rules

Sharing rules specified by organizations cloud admin

Resource limiting (governing)• resources are limited in the runtime• can call a method to find out the values• different for different contexts

43


Apex: Concurrency

No threads

Futures

44


APEX: Tools

Eclipse Plugin

TextBox in Salesforce UI

45


Summary

Many different cloud models

Depending on the model, languages can help the cloud

Primary contribution areas• Security• Performance• Concurrency• Distribution• Operational Considerations• Domain specific languages


For More Information

Sun Cloud Home• http://sun.com/cloud

My blog• http://www.sauria.com/blog

My Twitter• @twleung

http://sun.com/cloud

http://sun.com/cloud

http://www.sauria.com/blog

http://www.sauria.com/blog

http://twitter.com/twleung

http://twitter.com/twleung

Ted [email protected] @twleung

Programming Languages for the Cloud

S304101

mailto:[email protected]

mailto:[email protected]

Technology

Programming Languages For The Cloud