[特別企画] Serverless Machine Learning
Workshop
clda.co/serverless-‐workshop10/04/2016 東京
@alex_casalboni
clda.co/serverless-‐workshop Workshop | 東京
Web Developer (6+ years)
Sr. SoBware Engineer @ Cloud Academy
Master in Computer Science
About me
What is Machine Learning?
Back to 1959 (Arthur Samuel)
How computers learn from Data
clda.co/serverless-‐workshop Workshop | 東京
How to solve decision problems
Machine Learning pipeline
Training Predic6on
batch real-‐Ame
Feature extrac6on
batch
data informaPon
features ML models
clda.co/serverless-‐workshop Workshop | 東京
?
Machine Learning taxonomy
Supervised Learning
Unsupervised Learning
clda.co/serverless-‐workshop Workshop | 東京
?Machine Learning taxonomy
classifica8on
regression 170cm
Supervised Learning
Unsupervised Learning
clda.co/serverless-‐workshop Workshop | 東京
Machine Learning taxonomy
Supervised Learning
Unsupervised Learning
clda.co/serverless-‐workshop Workshop | 東京
Machine Learning taxonomy
clustering
rule extrac8on
group A group B
A, B C
Supervised Learning
Unsupervised Learning
clda.co/serverless-‐workshop Workshop | 東京
What problems can ML solve for you?
Supervised Learning
Unsupervised Learning
classifica'on
regression
clustering
rule extrac'on
?
170cm
gro gro
A, B C
clda.co/serverless-‐workshop Workshop | 東京
What problems can ML solve for you?
Supervised Learning
Unsupervised Learning
classifica'on
regression
clustering
rule extrac'on
?fraud detecPon
170cm
gro gro
A, B C
price of a stock over Pme
purchase likelihood
user segmentaPon
clda.co/serverless-‐workshop Workshop | 東京
LearningDataMachine
Cloud
Big
Science
Information
Internet
Statistics
Technology
Python Future
Mining Social
Deep
IOT
AlgorithmsManagement
Storage Petabytes
Parallel
Network
Privacy
MillionNoSQL
PaaS
SQL
Database
Exabytes
Billion
Dataset
Hadoop
R
clda.co/serverless-‐workshop Workshop | 東京
Generated data started growing ~10 years ago…
“90% of the data in the world today has been created in the last two years alone” -‐ IBM
“300+ hours worth of video content is being uploaded to the site every minute” -‐ Youtube
clda.co/serverless-‐workshop Workshop | 東京
… and it keeps geKng bigger!
clda.co/serverless-‐workshop Workshop | 東京
Big data challenges
Manual exploraPon is not an opPon
Data-‐driven decisions are a must
Distributed/parallel compuPng
The curse of dimensionality
clda.co/serverless-‐workshop Workshop | 東京
clda.co/serverless-‐workshop Workshop | 東京
clda.co/serverless-‐workshop Workshop | 東京
Why is deploying ML models a challenge?
clda.co/serverless-‐workshop Workshop | 東京
Why is deploying ML models a challenge?
1. Prototyping != ProducPon-‐ready
2. We need ElasPcity
4. MulP-‐model architectures
3. Too many nice-‐to-‐have features
clda.co/serverless-‐workshop Workshop | 東京
5. Avoid lack of ownership
Machine Learning as a Service (MLaaS)
AmazonMachine Learning
AzureMachine Learning
GooglePredicAon API
IMBWatson AnalyAcs
BigML
Workshop | 東京clda.co/serverless-‐workshop
Amazon Machine Learning
AmazonML
One of the first MLaaS soluPons (1 year old)
Great service for classificaPon and regression
Only linear models (linear & logisPc regression + SGD)
No support for advanced scenarios yet
Workshop | 東京clda.co/serverless-‐workshop
AmazonML @ Cloud Academy
Workshop | 東京clda.co/serverless-‐workshop
clda.co/7-‐day-‐free(no credit card required!)
Serverless compuAng to the rescue!
Transparent scalability, elasPcity and availability
Developer-‐friendly maintenance (versioning + aliases)
AWS Lambda
Event-‐driven approach & never pay for idle
1 funcPon = 1 model
A/B tesPng via composiPon
clda.co/serverless-‐workshop Workshop | 東京
clda.co/serverless-‐workshop Workshop | 東京
Quick Example
clda.co/ML-‐Lambda
clda.co/serverless-‐workshop Workshop | 東京