2021

TryOnGAN: Body-Aware Try-On via Layered Interpolation

Lewis, Kathleen M, Varadharajan, Srivatsan, Kemelmacher-Shlizerman, Ira

Understand

Given a pair of images-target person and garment on another person-we automatically generate the target person in the given garment.

Previous methods mostly focused on texture transfer via paired data training, while overlooking body shape deformations, skin color, and seamless blending of garment with the person.
This work focuses on those three components, while also not requiring paired data training.
We designed a pose conditioned StyleGAN2 architecture with a clothing segmentation branch that is trained on images of people wearing garments.

Built on

Shape matching and object recognition using shape contexts
Serge Belongie, Jitendra Malik, and Jan Puzicha. 2002 · 2002
Earlier work this paper cites.
Generative adversarial nets
Ian Goodfellow et al · 2014
Earlier work this paper cites.
Conditional generative adversarial nets
Original
Mehdi Mirza and Simon Osindero. 2014 · 2014
Earlier work this paper cites.
Very deep convolutional networks for large-scale image recognition
Original
Karen Simonyan and Andrew Zisserman. 2014 · 2014
Earlier work this paper cites.
Where to Buy It:Matching Street Clothing Photos in Online Shops
M. Hadi Kiapour, Svetlana Lazebnik Xufeng Han, Alexander C. Berg, and Tamara L. Berg. 2015 · 2015
Earlier work this paper cites.
Tensorflow: A system for large-scale machine learning
Martin Abadi et al · 2016
Earlier work this paper cites.
A learned representation for artistic style
Vincent Dumoulin, Jonathon Shlens, and Manjunath Kudlur. 2016 · 2016
Earlier work this paper cites.
Exploring the structure of a real-time, arbitrary neural artistic stylization network
Golnaz Ghiasi et al · 2017
Earlier work this paper cites.
Gans trained by a two time-scale update rule converge to a local nash equilibrium
Martin Heusel et al · 2017
Earlier work this paper cites.
Arbitrary style transfer in real-time with adaptive instance normalization
Xun Huang and Serge Belongie. 2017 · 2017
Earlier work this paper cites.
Progressive growing of gans for improved quality, stability, and variation
Original
Tero Karras et al · 2017
Earlier work this paper cites.
Learning unified embedding for apparel recognition
Yang Song et al · 2017
Earlier work this paper cites.
Pivtons: Pose invariant virtual try-on shoe with conditional image completion
Chao-Te Chou et al · 2018
Earlier work this paper cites.
Feature-wise transformations
Vincent Dumoulin et al · 2018
Earlier work this paper cites.

Similar

Viton: An image-based virtual try-on network
Xintong Han et al · 2018
Cited alongside, same era.
Swapnet: Garment transfer in single view images
Amit Raj et al · 2018
Cited alongside, same era.
Toward characteristic-preserving image-based virtual try-on network
Bochao Wang et al · 2018
Cited alongside, same era.
High-resolution image synthesis and semantic manipulation with conditional gans
Ting-Chun Wang et al · 2018
Cited alongside, same era.
Human appearance transfer
Mihai Zanfir et al · 2018
Cited alongside, same era.
The unreasonable effectiveness of deep features as a perceptual metric
Richard Zhang et al · 2018
Cited alongside, same era.
Towards multi-pose guided virtual try-on network
Haoye Dong et al · 2019
Cited alongside, same era.
Graphonomy: Universal Human Parsing via Graph Transfer Learning
Ke Gong, Yiming Gao, Xiaodan Liang, Xiaohui Shen, Meng Wang, and Liang Lin. 2019 · 2019
Cited alongside, same era.
End-to-End Learning of Geometric Deformations of Feature Maps for Virtual Try-On
Original
Thibaut Issenhuth, Jérémie Mary, and Clément Calauzènes. 2019 · 2019
Cited alongside, same era.
A style-based generator architecture for generative adversarial network
Tero Karras et al · 2019
Cited alongside, same era.
M2e-try on net: Fashion from model to everyone
Zhonghua Wu et al · 2019
Cited alongside, same era.
Generating high-resolution fashion model images wearing custom outfits
Gokhan Yildirim et al · 2019
Cited alongside, same era.

Then

S2cGAN: Semi-Supervised Training of Conditional GANs with Fewer Labels
Arunava Chakraborty et al · 2020
Later among the works it cites.
Editing in Style: Uncovering the Local Semantics of GANs
Edo Collins et al · 2020
Later among the works it cites.
The GAN that warped: Semantic attribute editing with unpaired data
Garoe Dorta et al · 2020
Later among the works it cites.
Unsupervised Image-to-Image Translation via Pre-trained StyleGAN2 Network
Original
Jialu Huang, Jing Liao, and Sam Kwong. 2020 · 2020
Later among the works it cites.
SieveNet: A Unified Framework for Robust Image-Based Virtual Try-On
Surgan Jandial et al · 2020
Later among the works it cites.
Analyzing and improving the image quality of stylegan
Tero Karras et al · 2020
Later among the works it cites.
Liquid Warping GAN with Attention: A Unified Framework for Human Image Synthesis
Original
Wen Liu et al · 2020
Later among the works it cites.
Controllable person image synthesis with attribute-decomposed gan
Yifang Men et al · 2020
Later among the works it cites.
Image Based Virtual Try-on Network from Unpaired Data
Assaf Neuberger et al · 2020
Later among the works it cites.
Resolution Dependant GAN Interpolation for Controllable Image Synthesis Between Domains
Original
Justin NM Pinkney and Doron Adler. 2020 · 2020
Later among the works it cites.
GarmentGAN: Photo-realistic Adversarial Fashion Transfer
Original
Amir Raffiee and Michael Sollami. 2020 · 2020
Later among the works it cites.
Encoding in style: a stylegan encoder for image-to-image translation
Original
Elad Richardson et al · 2020
Later among the works it cites.
Towards Photo-Realistic Virtual Try-On by Adaptively Generating-Preserving Image Content
Han Yang et al · 2020
Later among the works it cites.
In-domain gan inversion for real image editing
Jiapeng Zhu et al · 2020
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…