gdg-shanghai 2017 tensorflow summit recap
TRANSCRIPT
-
@
-
Jeff Dean
source: http://blog.jobbole.com/51607/
Jeff Dean
Jeff Dean Jeff Dean
2000 Jeff Dean 40 USB 2.0
-
Jeff Dean
He hasco-designed/implemented five generations of Google's
crawling
indexing
query serving systems
and co-designed/implemented major pieces of Googles
initial advertising
AdSense for Content systems
Google's distributed computing infrastructure, including
MapReduce, BigTable, Spanner systems
protocol buffers, LevelDB, systems infrastructure for statistical machine translation
a variety of internal and external libraries and developer tools
He is currently working on large-scale distributed systems for machine learning.
Leads the Google Brain team, Google's deep learning research team
-
Im a developer, not a data scientist.
Focus on playing TensorFlow in cloud.
@
-
Keynote Video(Jeff Dean - part)
-
TensorFlow
DistBelief > GPU
paper model 1.7 billion parameters, utilizing 81 machines, delivering a 12x speedup.
model mobile
https://research.google.com/pubs/pub40565.html
-
Training Data Validation Data Test Data
Model Serving requesttrain (cpu/gpu)
-
What is machine learning?
Loss
Weight
Gradient Descent
Bias Activation Function
Hidden Layer
Learning Rate
-
activation functionwT x + b yx
neural
Loss function
loss
Optimizer weight bias Gradient Descent
loss = (y y )2
-
Deep Learning
-
Python
Golang
Java
Graph (DAG)
C++ Corecompile run
How does TensorFlow work
-
TensorFlow High-Level APIs & Keras & ML ToolkitFrancois CholletMartin Wicke Ashish Agarwal
-
Low-Level APIs
-
High-Level APIs
-
Keras
-
Keras
-
Video Input
-
Question Input
-
Output
-
Generate the model, a graph
-
Wide & Deep LearningHeng-Tze Cheng
https://www.tensorflow.org/tutorials/wide_and_deep/research paper
https://www.tensorflow.org/tutorials/wide_and_deep/http://arxiv.org/abs/1606.07792
-
Distributed TensorFlow TensorFlow Ecosystem: Integrating TensorFlow with
Your Infrastructure
Derek Murray Jonathan Hseu
-
Distributed Training Demo
-
Hands-on TensorBoardDandelion Mane
-
TensorBoard Demo
-
Serving Models in Production with
TensorFlow ServingNoah Fiedel
https://github.com/tensorflow/serving
-
TensroFlow Serving Demo
-
XLA (Accelerated Linear Algebra)Chris Leary and Todd Wang
https://www.tensorflow.org/versions/master/experimental/xla/
-
Other Topics Applications
-
TensorFlow at DeepMindDaniel Visentin
Brett KuprelSkin Cancer Image Classification
Mobile and Embedded TensorFlowPete Warden
TensorFlow in Medicine Retinal Imaging
Doug EckMagenta: Music and Art Generation
Eugene BrevdoSequence Models and the RNN API
Lily Peng
-
Google Translation App Demo
-
http://weibo.com/jiangjun1990
https://github.com/ohmystack
http://ohmystack.com/
Im / ohmystack @
Udacity Deep Learning Nanodegree
http://weibo.com/jiangjun1990https://github.com/ohmystackhttp://ohmystack.com/https://www.udacity.com/course/deep-learning-nanodegree-foundation--nd101