Generative Adversarial Networks

Generative Adversarial NetworksSTEPHEN MCALEER

Outline

1. Discriminative vs. generative models

2. Deep generative models

3. Generative adversarial networks

4. Applications and further work

Discriminative vs. Generative Models

𝑥₂

Training set𝒙, 𝒚

Discriminative Model𝒑(𝒚|𝒙)

pickup truck

Generative Model𝒑(𝒙, 𝒚)

𝑧 ~ 𝑁(0,1)

Deep Learning

• Learn hierarchical model of data

• Higher-level features derived from lower-level features

• Has achieved much success in discriminative tasks

𝑥₂

Generating an Image

• Opposite of convolutional neural nets

• How to train it?

𝑥₂

Deep Generative Models

• Variational Autoencoders1

• Generative Adversarial Networks2

1. Kingma, Diederik P and Welling, Max. Auto-Encoding Variational Bayes. In The 2nd International Conference on Learning Representations (ICLR), 2013.

2. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. In NIPS, pages 2672–2680. 2014.

Generative Adversarial Networks1

• Two networks compete with one another

• The generator generates imitations of data

• The discriminator distinguishes generated data from real data

• Backwards-differentiable(!)

Generative Adversarial Networks1

Results

Alec Radford, Luke Metz, and Soumith Chintala. Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:1511.06434, 2015.

Results

Alec Radford, Luke Metz, and Soumith Chintala. Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:1511.06434, 2015.

Results

S. Reed, Z. Akata, X. Yan, L. Logeswaran, B. Schiele, and H. Lee. Generative adversarial text-to-image synthesis. In ICML, 2016b.

Further Research

• Disentangled representations

• Different architectures

• Combining GANs with other models

• Finding minima in non-convex games

Sources

• I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. In NIPS, pages 2672–2680. 2014.

• Kingma, Diederik P and Welling, Max. Auto-Encoding Variational Bayes. In The 2nd International Conference on Learning Representations (ICLR), 2013.

• Alec Radford, Luke Metz, and Soumith Chintala. Unsupervised representation learning with deep convolutional generative adversarial networks. arXivpreprint arXiv:1511.06434, 2015.

• S. Reed, Z. Akata, X. Yan, L. Logeswaran, B. Schiele, and H. Lee. Generative adversarial text-to-image synthesis. In ICML, 2016b.

• A. van den Oord, N. Kalchbrenner, and K. Kavukcuoglu. Pixel recurrent neural networks. arXiv preprint arXiv:1601.06759, 2016.

Generative Adversarial Networks - Yezhou Yang...Generative Adversarial Networks1 •Two networks...

Documents

Discriminator-Free Generative Adversarial Attack

Generative Adversarial Networks (GANs) - Sciencesconf.org · Generative Adversarial Networks (GANs) Anirban Mukhopadhyay TU Darmstadt, Germany. Introduction Generative vs. Discriminative

Generative Adversarial Imitation Learning

GENERATIVE ADVERSARIAL SELF-IMITATION LEARNING

Generative adversarial networks - University Of Illinoisslazebni.cs.illinois.edu/fall18/lec13_gan.pdfconvolutional generative adversarial networks, ICLR 2016 Four transposed convolution

A (conditional) Generative Adversarial Network

ESRGAN: Enhanced Super-Resolution Generative Adversarial ...openaccess.thecvf.com/content_ECCVW_2018/papers/11133/Wang_ESRGAN... · ESRGAN: EnhancedSuper-Resolution Generative Adversarial

Generative adversarial networks...Generative adversarial nets. NeurIPS. Longer version Goodfellow, (2016). NIPS 2016 Tutorial: Generative Adversarial Networks. Extra Radford et al,

Semi-Supervised Generative Adversarial Hashing for Image Retrievalopenaccess.thecvf.com › ...Wang_Semi-Supervised_Generative_Adver… · Semi-Supervised Generative Adversarial Hashing

Time-series Generative Adversarial Networks

Generative Adversarial Networks, and Applications Adversarial Networks, and Applications Outline: •Generative Models vs Discriminative Models (Background) •Generative Adversarial

Lecture 19: Generative Adversarial Networksrgrosse/courses/csc321_2018/readings/L19 GANs.pdfLecture 19: Generative Adversarial Networks Roger Grosse 1 Introduction Generative modeling

Generative Adversarial Nets: Applications and Extensionsice.dlut.edu.cn/valse2018/ppt/Generative... · Generative Adversarial Nets: Applications and Extensions Wangmeng Zuo Vision

3D Generative Adversarial Networks inference

Generative Adversarial Networks - HAW Hamburgubicomp/projekte/master... · Generative Adversarial Networks ... Outline 1. Basic idea 2. Generative Adversarial ... com/2017/01/generative-adversarial-networks-hot-topic-machine-learning

Generative Adversarial Nets - Semantic Scholargenerative adversarial text to image synthesis. Scott Reed, ZeynepAkata. ... Conditional Sequence Generative Adversarial Nets[J]. arXiv

GENERATIVE ADVERSARIAL NETWORKS - Deep Learningdeeplearning.cs.cmu.edu/F20/document/recitation/GANS-ppt.pdf · 2021. 3. 22. · Generative Adversarial Networks Generative Models We

Unsupervised Generative Adversarial Alignment

COMP9444 Neural Networks and Deep Learning 9b. Generative Adversarial … · 2020. 7. 25. · COMP9444 20T2 Generative Adversarial Networks 13 Generative Adversarial Networks GAN