Upload
jiang-jun
View
84
Download
2
Embed Size (px)
Citation preview
@
Jeff Dean
source: http://blog.jobbole.com/51607/
Jeff Dean
Jeff Dean Jeff Dean
2000 Jeff Dean 40 USB 2.0
Jeff Dean
He hasco-designed/implemented five generations of Google's
crawling
indexing
query serving systems
and co-designed/implemented major pieces of Googles
initial advertising
AdSense for Content systems
Google's distributed computing infrastructure, including
MapReduce, BigTable, Spanner systems
protocol buffers, LevelDB, systems infrastructure for statistical machine translation
a variety of internal and external libraries and developer tools
He is currently working on large-scale distributed systems for machine learning.
Leads the Google Brain team, Google's deep learning research team
Im a developer, not a data scientist.
Focus on playing TensorFlow in cloud.
@
Keynote Video(Jeff Dean - part)
TensorFlow
DistBelief > GPU
paper model 1.7 billion parameters, utilizing 81 machines, delivering a 12x speedup.
model mobile
https://research.google.com/pubs/pub40565.html
Training Data Validation Data Test Data
Model Serving requesttrain (cpu/gpu)
What is machine learning?
Loss
Weight
Gradient Descent
Bias Activation Function
Hidden Layer
Learning Rate
activation functionwT x + b yx
neural
Loss function
loss
Optimizer weight bias Gradient Descent
loss = (y y )2
Deep Learning
Python
Golang
Java
Graph (DAG)
C++ Corecompile run
How does TensorFlow work
TensorFlow High-Level APIs & Keras & ML ToolkitFrancois CholletMartin Wicke Ashish Agarwal
Low-Level APIs
High-Level APIs
Keras
Keras
Video Input
Question Input
Output
Generate the model, a graph
Wide & Deep LearningHeng-Tze Cheng
https://www.tensorflow.org/tutorials/wide_and_deep/research paper
https://www.tensorflow.org/tutorials/wide_and_deep/http://arxiv.org/abs/1606.07792
Distributed TensorFlow TensorFlow Ecosystem: Integrating TensorFlow with
Your Infrastructure
Derek Murray Jonathan Hseu
Distributed Training Demo
Hands-on TensorBoardDandelion Mane
TensorBoard Demo
Serving Models in Production with
TensorFlow ServingNoah Fiedel
https://github.com/tensorflow/serving
TensroFlow Serving Demo
XLA (Accelerated Linear Algebra)Chris Leary and Todd Wang
https://www.tensorflow.org/versions/master/experimental/xla/
Other Topics Applications
TensorFlow at DeepMindDaniel Visentin
Brett KuprelSkin Cancer Image Classification
Mobile and Embedded TensorFlowPete Warden
TensorFlow in Medicine Retinal Imaging
Doug EckMagenta: Music and Art Generation
Eugene BrevdoSequence Models and the RNN API
Lily Peng
Google Translation App Demo
http://weibo.com/jiangjun1990
https://github.com/ohmystack
http://ohmystack.com/
Im / ohmystack @
Udacity Deep Learning Nanodegree
http://weibo.com/jiangjun1990https://github.com/ohmystackhttp://ohmystack.com/https://www.udacity.com/course/deep-learning-nanodegree-foundation--nd101