61
江骏 @ 饿么

GDG-Shanghai 2017 TensorFlow Summit Recap

Embed Size (px)

Citation preview

  • @

  • Jeff Dean

    source: http://blog.jobbole.com/51607/

    Jeff Dean

    Jeff Dean Jeff Dean

    2000 Jeff Dean 40 USB 2.0

  • Jeff Dean

    He hasco-designed/implemented five generations of Google's

    crawling

    indexing

    query serving systems

    and co-designed/implemented major pieces of Googles

    initial advertising

    AdSense for Content systems

    Google's distributed computing infrastructure, including

    MapReduce, BigTable, Spanner systems

    protocol buffers, LevelDB, systems infrastructure for statistical machine translation

    a variety of internal and external libraries and developer tools

    He is currently working on large-scale distributed systems for machine learning.

    Leads the Google Brain team, Google's deep learning research team

  • Im a developer, not a data scientist.

    Focus on playing TensorFlow in cloud.

    @

  • Keynote Video(Jeff Dean - part)

  • TensorFlow

    DistBelief > GPU

    paper model 1.7 billion parameters, utilizing 81 machines, delivering a 12x speedup.

    model mobile

    https://research.google.com/pubs/pub40565.html

  • Training Data Validation Data Test Data

    Model Serving requesttrain (cpu/gpu)

  • What is machine learning?

    Loss

    Weight

    Gradient Descent

    Bias Activation Function

    Hidden Layer

    Learning Rate

  • activation functionwT x + b yx

    neural

    Loss function

    loss

    Optimizer weight bias Gradient Descent

    loss = (y y )2

  • Deep Learning

  • Python

    Golang

    Java

    Graph (DAG)

    C++ Corecompile run

    How does TensorFlow work

  • TensorFlow High-Level APIs & Keras & ML ToolkitFrancois CholletMartin Wicke Ashish Agarwal

  • Low-Level APIs

  • High-Level APIs

  • Keras

  • Keras

  • Video Input

  • Question Input

  • Output

  • Generate the model, a graph

  • Wide & Deep LearningHeng-Tze Cheng

    https://www.tensorflow.org/tutorials/wide_and_deep/research paper

    https://www.tensorflow.org/tutorials/wide_and_deep/http://arxiv.org/abs/1606.07792

  • Distributed TensorFlow TensorFlow Ecosystem: Integrating TensorFlow with

    Your Infrastructure

    Derek Murray Jonathan Hseu

  • Distributed Training Demo

  • Hands-on TensorBoardDandelion Mane

  • TensorBoard Demo

  • Serving Models in Production with

    TensorFlow ServingNoah Fiedel

    https://github.com/tensorflow/serving

  • TensroFlow Serving Demo

  • XLA (Accelerated Linear Algebra)Chris Leary and Todd Wang

    https://www.tensorflow.org/versions/master/experimental/xla/

  • Other Topics Applications

  • TensorFlow at DeepMindDaniel Visentin

    Brett KuprelSkin Cancer Image Classification

    Mobile and Embedded TensorFlowPete Warden

    TensorFlow in Medicine Retinal Imaging

    Doug EckMagenta: Music and Art Generation

    Eugene BrevdoSequence Models and the RNN API

    Lily Peng

  • Google Translation App Demo

  • http://weibo.com/jiangjun1990

    https://github.com/ohmystack

    http://ohmystack.com/

    Im / ohmystack @

    Udacity Deep Learning Nanodegree

    http://weibo.com/jiangjun1990https://github.com/ohmystackhttp://ohmystack.com/https://www.udacity.com/course/deep-learning-nanodegree-foundation--nd101