Embed Size (px)
Citation preview
Deep Learning and Artistic Style Transfer for Videos
Sam Putnam
6/6/2017
+ =
6/6/2017
Want to learn more? I am teaching the Deploying Data Science Masterclass at Data Science Conf®
Tickets are available now: www.DataScienceConf.com
Deep Learning
Deep Learning
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
6/6/2017
Artistic Style Transfer
Artistic Style Transfer
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
6/6/2017
https://arxiv.org/abs/1604.08610
Butterfly Demo
Butterfly Demo
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
6/6/2017
https://twitter.com/samdeeplearning/status/854332749695602720
Part 1 of 3
Deep Learning
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Deep Learning
6/6/2017
Deep Learning
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
6/6/2017
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Deep Learning
6/6/2017
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Deep Learning
6/6/2017
Part 2 of 3
Artistic Style Transfer
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Artistic Style Transfer
6/6/2017
Sam Putnam
Content and Style Loss Minimization
Deep Learning and Artistic Style Transfer for Videos
Artistic Style Transfer
6/6/2017
Sam Putnam
Total Loss
Deep Learning and Artistic Style Transfer for Videos
Artistic Style Transfer
6/6/2017
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Artistic Style Transfer
6/6/2017
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Artistic Style Transfer
6/6/2017
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Artistic Style Transfer
6/6/2017
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Artistic Style Transfer
6/6/2017
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Artistic Style Transfer
6/6/2017
Part 3 of 3
Butterfly Demo (Will Go Through This Fast)
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
6/6/2017
A - Picked NN (Try CUDNN for Speed)
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
6/6/2017
B - Picked GPU
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
6/6/2017
C - Use Original Resolution
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
6/6/2017
D - Successfully Loaded VGG Model
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
6/6/2017
E - Finishes 2 Hours Later; scp the stylized video onto your computer
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
6/6/2017
1 - Select Amazon Deep Learning AMI that has Torch and CUDA pre-installed
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
6/6/2017
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
2 - Select P2.xlarge GPU instance for Tesla K80
6/6/2017
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
3 - Allow Incoming Connections on Port 22
6/6/2017
4 - Create a Key Pair - I always use the same one that I named TheanoKeyPair
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
6/6/2017
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
5 - Launch Instance
6/6/2017
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
6 - Wait Until It’s Running
6/6/2017
7 - ssh -i TheanoKeyPair.pem [email protected].
com
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
6/6/2017
8 - Try Several Times Until It Connects
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
6/6/2017
9 - You’re In
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
6/6/2017
10 - cd torch; sudo apt-get install libprotobuf-dev protobuf-compiler
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
6/6/2017
11 - luarocks install loadcaffe
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
6/6/2017
12 - Re-install Torch Because It’s Fast
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
6/6/2017
13 - wget -c https://gist.githubusercontent.com/ksimonyan/3785162f95cd2d5fee77/raw/
bb2b4fe0a9bb0669211cf3d0bc949dfdda173e9e/VGG_ILSVRC_19_layers_deploy.prototxt
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
6/6/2017
14 - wget -c --no-check-certificate https://bethgelab.org/media/uploads/deeptextures/
vgg_normalised.caffemodel
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
6/6/2017
15 - wget -c http://www.robots.ox.ac.uk/~vgg/software/very_deep/caffe/
VGG_ILSVRC_19_layers.caffemodel
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
6/6/2017
16- wget -c http://pascal.inrialpes.fr/data2/deepmatching/files/DeepFlow_release2.0.tar.gz;
unzipand move ‘static’ file to src directory
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
6/6/2017
17 - wget -c http://lear.inrialpes.fr/src/deepmatching/code/deepmatching_1.0.2.zip; unzip
and move ‘static’ file to src directory
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
6/6/2017
18 - Upload Video & Image of Matching Resolution to Github; git clone repo on your instance
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
6/6/2017
19 - git clone https://github.com/manuelruder/artistic-videos
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
6/6/2017
20 - SSH in using Your KeyPair.pem and Ubuntu as the User
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
6/6/2017
21 - ./stylizeVideo.sh Butterfly.mov vanGogh596x336.png
Sam PutnamDeep Learning and Artistic Style Transfer for Videos
Butterfly Demo
6/6/2017
Thank you
Deep Learning and Artistic Style Transfer for Videos Sam Putnam
Thank you to Manuel Ruder et al. Slides are for today only.
Always looking for new members & new locations in Cambridge, US or NYC & new speakers to present on Deep Learning in Production topics
6/6/2017
https://www.slideshare.net/anirudhkoul/squeezing-deep-learning-into-mobile-phones/77
