2020

Fast Differentiable Clipping-Aware Normalization and Rescaling

Rauber, Jonas, Bethge, Matthias

Understand

Rescaling a vector $\vec{\delta} \in \mathbb{R}^n$ to a desired length is a common operation in many areas such as data science and machine learning.

  • When the rescaled perturbation $\eta \vec{\delta}$ is added to a starting point $\vec{x} \in D$ (where $D$ is the data domain, e.g.
  • $D = [0, 1]^n$), the resulting vector $\vec{v} = \vec{x} + \eta \vec{\delta}$ will in general not be in $D$.
  • To enforce that the perturbed vector $v$ is in $D$, the values of $\vec{v}$ can be clipped to $D$.

Built on

Similar

  • Foolbox: A Python toolbox to benchmark the robustness of machine learning models

    Original

    Jonas Rauber, Wieland Brendel, and Matthias Bethge · 2017

    Cited alongside, same era.

  • JAX: composable transformations of Python+NumPy programs, 2018

    James Bradbury, Roy Frostig, Peter Hawkins, Matthew James Johnson, Chris Leary, Dougal Maclaurin, and Skye Wanderman-Milne · 2018

    Cited alongside, same era.

  • Foolbox Native: A Python toolbox to create adversarial examples that fool neural networks in PyTorch, TensorFlow, and JAX

    Jonas Rauber, Matthias Bethge, and Wieland Brendel

    Cited in the paper.

  • EagerPy: Writing code that works natively with PyTorch, TensorFlow, JAX and NumPy

    Jonas Rauber, Wieland Brendel, and Matthias Bethge

    Cited in the paper.

Then

  • Tensorflow eager: A multi-stage, python-embedded dsl for machine learning

    Akshay Agrawal, Akshay Naresh Modi, Alexandre Passos, Allen Lavoie, Ashish Agarwal, Asim Shankar, Igor Ganichev, Josh Levenberg, Mingsheng Hong, Rajat Monga, et al · 2019

    Later among the works it cites.

  • Pytorch: An imperative style, high-performance deep learning library

    Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al · 2019

    Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…