2019

Conditioning by adaptive sampling for robust design

Brookes, David H., Park, Hahnbeom, Listgarten, Jennifer

Understand

We present a new method for design problems wherein the goal is to maximize or specify the value of one or more properties of interest.

For example, in protein design, one may wish to find the protein sequence that maximizes fluorescence.
We assume access to one or more, potentially black box, stochastic "oracle" predictive functions, each of which maps from input (e.g., protein sequences) design space to a distribution over a property of interest (e.g.
protein fluorescence).

Built on

Statistical inference for probabilistic functions of finite state markov chains
Baum, L. E. and Petrie, T · 1966
Earlier work this paper cites.
Enzyme Engineering for Nonaqueous Solvents: Random Mutagenesis to Enhance Activity of Subtilisin E in Polar Organic Media
Chen, K. and Arnold, F. H · 1991
Earlier work this paper cites.
The rational design of amino acid sequences by artificial neural networks and simulated molecular evolution: de novo design of an idealized leader peptidase cleavage site
Schneider, G. and Wrede, P · 1994
Earlier work this paper cites.
Optimization of computer simulation models with rare events
Rubinstein, R. Y · 1997
Earlier work this paper cites.
Peptide design by artificial neural networks and computer-based evolutionary search
Schneider, G., Schrödl, W., Wallukat, G., Müller, J., Nissen, E., Rönspeck, W., Wrede, P., and Kunze, R · 1998
Earlier work this paper cites.
An introduction to variational methods for graphical models
Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., and Saul, L. K · 1999
Earlier work this paper cites.
The Cross-Entropy Method for Combinatorial and Continuous Optimization
Rubinstein, R · 1999
Earlier work this paper cites.
An introduction to variational methods for graphical models
Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., and Saul, L. K · 1999
Earlier work this paper cites.
Estimation of distribution algorithms: A new evolutionary computation approach for graph matching problems
Bengoetxea, E., Larrañaga, P., Bloch, I., and Perchant, A · 2001
Earlier work this paper cites.
Off-policy temporal difference learning with function approximation
Precup, D., Sutton, R. S., and Dasgupta, S · 2001
Earlier work this paper cites.
Off-policy temporal difference learning with function approximation
Precup, D., Sutton, R. S., and Dasgupta, S · 2001
Earlier work this paper cites.
Learning from scarce experience
Peshkin, L. and Shelton, C. R · 2002
Earlier work this paper cites.
Learning from scarce experience
Peshkin, L. and Shelton, C. R · 2002
Earlier work this paper cites.
The CMA evolution strategy: A tutorial
Hansen, N · 2006
Earlier work this paper cites.
Reinforcement learning by reward-weighted regression for operational space control
Peters, J. and Schaal, S · 2007
Earlier work this paper cites.

Similar

Relative entropy policy search
Peters, J., Mülling, K., and Altun, Y · 2010
Cited alongside, same era.
On a connection between importance sampling and the likelihood ratio policy gradient
Tang, J. and Abbeel, P · 2010
Cited alongside, same era.
On a connection between importance sampling and the likelihood ratio policy gradient
Tang, J. and Abbeel, P · 2010
Cited alongside, same era.
Practical bayesian optimization of machine learning algorithms
Snoek, J., Larochelle, H., and Adams, R. P · 2012
Cited alongside, same era.
Deep inside convolutional networks: Visualising image classification models and saliency maps
Simonyan, K., Vedaldi, A., and Zisserman, A · 2013
Cited alongside, same era.
Generative adversarial nets
Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y · 2014
Cited alongside, same era.
Auto-encoding variational bayes
Kingma, D. P. and Welling, M · 2014
Cited alongside, same era.
Stochastic backpropagation and approximate inference in deep generative models
Rezende, D. J., Mohamed, S., and Wierstra, D · 2014
Cited alongside, same era.
Introduction to the Peptide Binding Problem of Computational Immunology: New Results
Shen, W.-J., Wong, H.-S., Xiao, Q.-W., Guo, X., and Smale, S · 2014
Cited alongside, same era.
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., and Fergus, R · 2014
Cited alongside, same era.
Deep neural networks are easily fooled: High confidence predictions for unrecognizable images
Nguyen, A. M., Yosinski, J., and Clune, J · 2015
Cited alongside, same era.
Synthesizing the preferred inputs for neurons in neural networks via deep generator networks
Nguyen, A. M., Dosovitskiy, A., Yosinski, J., Brox, T., and Clune, J · 2016
Cited alongside, same era.

Then

Categorical reparameterization with Gumbel-softmax
Jang, E., Gu, S., and Poole, B · 2017
Later among the works it cites.
Generating and designing DNA with deep generative models
Killoran, N., Lee, L. J., Delong, A., Duvenaud, D., and Frey, B. J · 2017
Later among the works it cites.
Simple and scalable predictive uncertainty estimation using deep ensembles
Lakshminarayanan, B., Pritzel, A., and Blundell, C · 2017
Later among the works it cites.
Plug & play generative networks: Conditional iterative generation of images in latent space
Nguyen, A., Clune, J., Bengio, Y., Dosovitskiy, A., and Yosinski, J · 2017
Later among the works it cites.
Information-geometric optimization algorithms: A unifying picture via invariance principles
Ollivier, Y., Arnold, L., Auger, A., and Hansen, N · 2017
Later among the works it cites.
Attention is all you need
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L. u., and Polosukhin, I · 2017
Later among the works it cites.
Simple and scalable predictive uncertainty estimation using deep ensembles
Lakshminarayanan, B., Pritzel, A., and Blundell, C · 2017
Later among the works it cites.
Design by adaptive sampling
Original
Brookes, D. H. and Listgarten, J · 2018
Later among the works it cites.
Latent constraints: Learning to generate conditionally from unconditional generative models
Engel, J., Hoffman, M., and Roberts, A · 2018
Later among the works it cites.
Automatic Chemical Design Using a Data-Driven Continuous Representation of Molecules
Gómez-Bombarelli, R., Wei, J. N., Duvenaud, D., Hernández-Lobato, J. M., Sánchez-Lengeling, B., Sheberla, D., Aguilera-Iparraguirre, J., Hirzel, T. D., Adams, R. P., and Aspuru-Guzik, A · 2018
Later among the works it cites.
Machine learning in protein engineering
Yang, K. K., Wu, Z., and Arnold, F. H · 2018
Later among the works it cites.
Feedback GAN for DNA optimizes protein functions
Gupta, A. and Zou, J · 2019
Closest in time.
Do deep generative models know what they don’t know?
Nalisnick, E., Matsukawa, A., Teh, Y. W., Gorur, D., and Lakshminarayanan, B · 2019
Closest in time.
Biological structure and function emerge from scaling unsupervised learning to 250 million protein sequences
Rives, A., Goyal, S., Meier, J., Guo, D., Ott, M., Zitnick, C. L., Ma, J., and Fergus, R · 2019
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…