2020

FoggySight: A Scheme for Facial Lookup Privacy

Evtimov, Ivan, Sturmfels, Pascal, Kohno, Tadayoshi

Understand

Advances in deep learning algorithms have enabled better-than-human performance on face recognition tasks.

In parallel, private companies have been scraping social media and other public websites that tie photos to identities and have built up large databases of labeled face images.
Searches in these databases are now being offered as a service to law enforcement and others and carry a multitude of privacy risks for social media users.
In this work, we tackle the problem of providing privacy from such face recognition systems.

Built on

Certified robustness for top-k predictions against adversarial perturbations via randomized smoothing
Original
Jinyuan Jia, Xiaoyu Cao, Binghui Wang, and Neil Zhenqiang Gong · 1912
Earlier work this paper cites.
Understanding face recognition
Vicki Bruce and Andy Young · 1986
Earlier work this paper cites.
Face recognition using eigenfaces
Matthew Turk and Alex Pentland · 1991
Earlier work this paper cites.
Face recognition using laplacianfaces
Xiaofei He, Shuicheng Yan, Yuxiao Hu, Partha Niyogi, and Hong-Jiang Zhang · 2005
Earlier work this paper cites.
Face description with local binary patterns: Application to face recognition
Timo Ahonen, Abdenour Hadid, and Matti Pietikainen · 2006
Earlier work this paper cites.
On the use of sift features for face authentication
Manuele Bicego, Andrea Lagorio, Enrico Grosso, and Massimo Tistarelli · 2006
Earlier work this paper cites.
Privacy-preserving face recognition
Zekeriya Erkin, Martin Franz, Jorge Guajardo, Stefan Katzenbeisser, Inald Lagendijk, and Tomas Toft · 2009
Earlier work this paper cites.
Efficient privacy-preserving face recognition
Ahmad-Reza Sadeghi, Thomas Schneider, and Immo Wehrenberg · 2009
Earlier work this paper cites.
Intriguing properties of neural networks
Original
Christian Szegedy, Wojciech Zaremba, Ilya Sutskever, Joan Bruna, Dumitru Erhan, Ian Goodfellow, and Rob Fergus · 2013
Earlier work this paper cites.
Discriminative deep metric learning for face verification in the wild
Junlin Hu, Jiwen Lu, and Yap-Peng Tan · 2014
Earlier work this paper cites.
Deep learning face representation by joint identification-verification
Yi Sun, Yuheng Chen, Xiaogang Wang, and Xiaoou Tang · 2014
Earlier work this paper cites.
Deepface: Closing the gap to human-level performance in face verification
Yaniv Taigman, Ming Yang, Marc’Aurelio Ranzato, and Lior Wolf · 2014
Earlier work this paper cites.
Learning face representation from scratch
Original
Dong Yi, Zhen Lei, Shengcai Liao, and Stan Z Li · 2014
Earlier work this paper cites.
TensorFlow: Large-scale machine learning on heterogeneous systems, 2015
Martín Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg S. Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Ian Goodfellow, Andrew Harp, Geoffrey Irving, Michael Isard, Yangqing Jia, Rafal Jozefowicz, Lukasz Kaiser, Manjunath Kudlur, Josh Levenberg, Dan Mané, Rajat Monga, Sherry Moore, Derek Murray, Chris Olah, Mike Schuster, Jonathon Shlens, Benoit Steiner, Ilya Sutskever, Kunal Talwar, Paul Tucker, Vincent Vanhoucke, Vijay Vasudevan, Fernanda Viégas, Oriol Vinyals, Pete Warden, Martin Wattenberg, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng · 2015
Earlier work this paper cites.
Model inversion attacks that exploit confidence information and basic countermeasures
Matt Fredrikson, Somesh Jha, and Thomas Ristenpart · 2015
Earlier work this paper cites.
Deep face recognition
Omkar M Parkhi, Andrea Vedaldi, and Andrew Zisserman · 2015
Earlier work this paper cites.
Facenet: A unified embedding for face recognition and clustering
Florian Schroff, Dmitry Kalenichenko, and James Philbin · 2015
Earlier work this paper cites.
Deeply learned face representations are sparse, selective, and robust
Yi Sun, Xiaogang Wang, and Xiaoou Tang · 2015
Earlier work this paper cites.
The megaface benchmark: 1 million faces for recognition at scale
Ira Kemelmacher-Shlizerman, Steven M Seitz, Daniel Miller, and Evan Brossard · 2016
Earlier work this paper cites.
Delving into transferable adversarial examples and black-box attacks
Original
Yanpei Liu, Xinyun Chen, Chang Liu, and Dawn Song · 2016
Earlier work this paper cites.

Similar

Accessorize to a crime: Real and stealthy attacks on state-of-the-art face recognition
Mahmood Sharif, Sruti Bhagavatula, Lujo Bauer, and Michael K Reiter · 2016
Cited alongside, same era.
Inception-v4, inception-resnet and the impact of residual connections on learning
Original
Christian Szegedy, Sergey Ioffe, Vincent Vanhoucke, and Alex Alemi · 2016
Cited alongside, same era.
A discriminative feature learning approach for deep face recognition
Yandong Wen, Kaipeng Zhang, Zhifeng Li, and Yu Qiao · 2016
Cited alongside, same era.
Privacy-preserving face recognition with outsourced computation
Can Xiang, Chunming Tang, Yunlu Cai, and Qiuxia Xu · 2016
Cited alongside, same era.
Synthesizing robust adversarial examples
Original
Anish Athalye, Logan Engstrom, Andrew Ilyas, and Kevin Kwok · 2017
Cited alongside, same era.
Towards evaluating the robustness of neural networks
Nicholas Carlini and David Wagner · 2017
Cited alongside, same era.
Targeted backdoor attacks on deep learning systems using data poisoning
Original
Xinyun Chen, Chang Liu, Bo Li, Kimberly Lu, and Dawn Song · 2017
Cited alongside, same era.
Badnets: Identifying vulnerabilities in the machine learning model supply chain
Original
Tianyu Gu, Brendan Dolan-Gavitt, and Siddharth Garg · 2017
Cited alongside, same era.
In defense of the triplet loss for person re-identification
Original
Alexander Hermans, Lucas Beyer, and Bastian Leibe · 2017
Cited alongside, same era.
Engineering privacy and protest: A case study of adnauseam
Daniel C Howe and Helen Nissenbaum · 2017
Cited alongside, same era.
Towards deep learning models resistant to adversarial attacks
Original
Aleksander Madry, Aleksandar Makelov, Ludwig Schmidt, Dimitris Tsipras, and Adrian Vladu · 2017
Cited alongside, same era.
Towards poisoning of deep learning algorithms with back-gradient optimization
Luis Muñoz-González, Battista Biggio, Ambra Demontis, Andrea Paudice, Vasin Wongrassamee, Emil C Lupu, and Fabio Roli · 2017
Cited alongside, same era.

Then

Poison frogs! targeted clean-label poisoning attacks on neural networks
Ali Shafahi, W Ronny Huang, Mahyar Najibi, Octavian Suciu, Christoph Studer, Tudor Dumitras, and Tom Goldstein · 2018
Later among the works it cites.
Cosface: Large margin cosine loss for deep face recognition
Hao Wang, Yitong Wang, Zheng Zhou, Xing Ji, Dihong Gong, Jingchao Zhou, Zhifeng Li, and Wei Liu · 2018
Later among the works it cites.
Facial recognition… coming to a supermarket near you
Tom Chivers · 2019
Later among the works it cites.
Arcface: Additive angular margin loss for deep face recognition
Jiankang Deng, Jia Guo, Niannan Xue, and Stefanos Zafeiriou · 2019
Later among the works it cites.
Efficient decision-based black-box adversarial attacks on face recognition
Yinpeng Dong, Hang Su, Baoyuan Wu, Zhifeng Li, Wei Liu, Tong Zhang, and Jun Zhu · 2019
Later among the works it cites.
Adversarial examples are not bugs, they are features
Andrew Ilyas, Shibani Santurkar, Dimitris Tsipras, Logan Engstrom, Brandon Tran, and Aleksander Madry · 2019
Later among the works it cites.
Memguard: Defending against black-box membership inference attacks via adversarial examples
Jinyuan Jia, Ahmed Salem, Michael Backes, Yang Zhang, and Neil Zhenqiang Gong · 2019
Later among the works it cites.
Advhat: Real-world adversarial attack on arcface face id system
Original
Stepan Komkov and Aleksandr Petiushko · 2019
Later among the works it cites.
Anonymousnet: Natural face de-identification with measurable privacy
Tao Li and Lei Lin · 2019
Later among the works it cites.
A general framework for adversarial examples with objectives
Mahmood Sharif, Sruti Bhagavatula, Lujo Bauer, and Michael K Reiter · 2019
Later among the works it cites.
Politics of adversarial machine learning
Kendra Albert, Jon Penney, Bruce Schneier, and Ram Shankar Siva Kumar · 2020
Closest in time.
Ethical adversaries: Towards mitigating unfairness with adversarial machine learning
Original
Pieter Delobelle, Paul Temple, Gilles Perrouin, Benoît Frénay, Patrick Heymans, and Bettina Berendt · 2020
Closest in time.
Face-off: Adversarial face obfuscation
Original
Chuhan Gao, Varun Chandrasekaran, Kassem Fawaz, and Somesh Jha · 2020
Closest in time.
The world’s scariest facial recognition company explained
Rebecca Heilweil · 2020
Closest in time.
The secretive company that might end privacy as we know it
Kashmir Hill, Jennifer Valentino-DeVries, Gabriel J.X. Dance, and Aaron Krolik · 2020
Closest in time.
White supremacists built a website to doxx interracial couples — and it’s going to be hard to take down
Tess Owen · 2020
Closest in time.
On adaptive attacks to adversarial example defenses
Original
Florian Tramer, Nicholas Carlini, Wieland Brendel, and Aleksander Madry · 2020
Closest in time.
How to trick ai: Users’ strategies for protecting themselves from automatic personality assessment
Sarah Theres Völkel, Renate Haeuslschmid, Anna Werner, Heinrich Hussmann, and Andreas Butz · 2020
Closest in time.
On the (im) practicality of adversarial perturbation for image privacy
Arezoo Rajabi, Rakesh B Bobba, Mike Rosulek, Charles V Wright, and Wu-chi Feng · 2021
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…