Fetching the paper…
Reading the bibliography…
We present an ideal mixed-integer programming (MIP) formulation for a rectified linear unit (ReLU) appearing in a trained neural network.
Balas, E.: Disjunctive programming and a hierarchy of relaxations for discrete optimization problems. SIAM Journal on Algorithmic Discrete Methods 6
1985
Earlier work this paper cites.
Balas, E.: Disjunctive programming: Properties of the convex hull of feasible points. Discrete Applied Mathematics 89
1998
Earlier work this paper cites.
LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. In: Proceedings of the IEEE. vol. 86, pp. 2278–2324 (November 1998)
1998
Earlier work this paper cites.
Bartolini, A., Lombardi, M., Milano, M., Benini, L.: Neuron constraints to model complex real-world problems. In: International Conference on the Principles and Practice of Constraint Programming. pp. 115–129. Springer, Berlin, Heidelberg (2011)
2011
Earlier work this paper cites.
Hooker, J.: Logic-Based Methods for Optimization: Combining Optimization and Constraint Satisfaction. John Wiley & Sons (2011)
2011
Earlier work this paper cites.
Vielma, J.P., Nemhauser, G.: Modeling disjunctive constraints with a logarithmic number of binary variables and constraints. Mathematical Programming 128
2011
Earlier work this paper cites.
Bartolini, A., Lombardi, M., Milano, M., Benini, L.: Optimization and controlled systems: A case study on thermal aware workload dispatching. In: Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence. pp. 427–433 (2012)
2012
Earlier work this paper cites.
Hijazi, H., Bonami, P., Cornuéjols, G., Ouorou, A.: Mixed-integer nonlinear programs featuring ”on/off” constraints. Computational Optimization and Applications 52
2012
Earlier work this paper cites.
Hijazi, H., Bonami, P., Ouorou, A.: A note on linear on/off constraints (2014), http://www.optimization-online.org/DB_FILE/2014/04/4309.pdf
2014
Earlier work this paper cites.
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., Fergus, R.: Intriguing properties of neural networks. In: International Conference on Learning Representations (2014)
2014
Earlier work this paper cites.
Bonami, P., Lodi, A., Tramontani, A., Wiese, S.: On mathematical programming with indicator constraints. Mathematical Programming 151
2015
Earlier work this paper cites.
2015
Earlier work this paper cites.
2015
Earlier work this paper cites.
LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521
2015
Earlier work this paper cites.
Mordvintsev, A., Olah, C., Tyka, M.: Inceptionism: Going deeper into neural networks (2015), https://ai.googleblog.com/2015/06/inceptionism-going-deeper-into-neural.html
2015
Earlier work this paper cites.
Vielma, J.P.: Mixed integer linear programming formulation techniques. SIAM Review 57
2015
Earlier work this paper cites.
Bastani, O., Ioannou, Y., Lampropoulos, L., Vytiniotis, D., Nori, A.V., Criminisi, A.: Measuring neural net robustness with constraints. In: Advances in Neural Information Processing Systems. pp. 2613–2621 (2016)
2016
Earlier work this paper cites.
Belotti, P., Bonami, P., Fischetti, M., Lodi, A., Monaci, M., Nogales-Gomez, A., Salvagnin, D.: On handling indicator constraints in mixed integer programming. Computational Optimization and Applications 65
2016
Earlier work this paper cites.
Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning, vol. 1. MIT Press Cambridge (2016)
2016
Earlier work this paper cites.
den Hertog, D., Postek, K.: Bridging the gap between predictive and prescriptive analytics – new optimization methodology needed (2016), http://www.optimization-online.org/DB_HTML/2016/12/5779.html
2016
Cited alongside, same era.
Lombardi, M., Gualandi, S.: A lagrangian propagator for artificial neural networks in constraint programming. Constraints 21
2016
Cited alongside, same era.
Papernot, N., McDaniel, P., Jha, S., Fredrikson, M., Celik, Z.B., Swami, A.: The limitations of deep learning in adversarial settings. In: IEEE European Symposium on Security and Privacy. pp. 372–387 (March 2016)
2016
Cited alongside, same era.
Amos, B., Xu, L., Kolter, J.Z.: Input convex neural networks. In: Precup, D., Teh, Y.W. (eds.) Proceedings of the 34th International Conference on Machine Learning. Proceedings of Machine Learning Research, vol. 70, pp. 146–155. PMLR, International Convention Centre, Sydney, Australia (06–11 Aug 2017)
2017
Cited alongside, same era.
Atamtürk, A., Gómez, A.: Strong formulations for quadratic optimization with M-matrices and indicator variables. Mathematical Programming (2018)
2018
Closest in time.
2018
Closest in time.
Bunel, R., Turkaslan, I., Torr, P.H., Kohli, P., Kumar, M.P.: A unified view of piecewise linear neural network verification. In: Advances in Neural Information Processing Systems (2018)
2018
Closest in time.
Deng, Y., Liu, J., Sen, S.: Coalescing data and decision sciences for analytics. In: Recent Advances in Optimization and Modeling of Contemporary Problems. INFORMS (2018)
2018
Closest in time.
Dutta, S., Jha, S., Sanakaranarayanan, S., Tiwari, A.: Output range analysis for deep feedforward neural networks. In: NASA Formal Methods Symposium (2018)
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Arulkumaran, K., Deisenroth, M.P., Brundage, M., Bharath, A.A.: Deep reinforcement learning: A brief survey. IEEE Signal Processing Magazine 34
2017
Cited alongside, same era.
Biggs, M., Hariss, R.: Optimizing objective functions determined from random forests (2017), https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2986630
2017
Cited alongside, same era.
Carlini, N., Wagner, D.: Towards evaluating the robustness of neural networks. In: 2017 IEEE Symposium on Security and Privacy (SP). pp. 39–57 (2017)
2017
Cited alongside, same era.
Cheng, C.H., Nührenberg, G., Ruess, N.: Maximum resilience of artifical neural networks. In: International Symposium on Automated Technology for Verification and Analysis. Springer, Cham (2017)
2017
Cited alongside, same era.
Donti, P., Amos, B., Kolter, J.Z.: Task-based end-to-end model learning in stochastic optimization. In: Guyon, I., Luxburg, U.V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., Garnett, R. (eds.) Advances in Neural Information Processing Systems 30, pp. 5484–5494. Curran Associates, Inc. (2017)
2017
Cited alongside, same era.
Ehlers, R.: Formal verification of piece-wise linear feed-forward neural networks. In: International Symposium on Automated Technology for Verification and Analysis. Springer, Cham (2017)
2017
Cited alongside, same era.
2017
Cited alongside, same era.
Katz, G., Barrett, C., Dill, D.L., Julian, K., Kochenderfer, M.J.: Reluplex: An efficient SMT solver for verifying deep neural networks. In: International Conference on Computer Aided Verification. pp. 97–117 (2017)
2017
Cited alongside, same era.
2018
Closest in time.
2018
Closest in time.
Dvijotham, K., Stanforth, R., Gowal, S., Mann, T., Kohli, P.: A dual approach to scalable verification of deep networks. In: Thirty-Fourth Conference Annual Conference on Uncertainty in Artificial Intelligence (2018)
2018
Closest in time.
Fischetti, M., Jo, J.: Deep neural networks and mixed integer linear optimization. Constraints (2018)
2018
Closest in time.
Huchette, J.: Advanced mixed-integer programming formulations: Methodology, computation, and application. Ph.D. thesis, Massachusetts Institute of Technology (June 2018)
2018
Closest in time.
Schweidtmann, A.M., Mitsos, A.: Global deterministic optimization with artificial neural networks embedded. Journal of Optimization Theory and Applications (2018)
2018
Closest in time.
2018
Closest in time.
Serra, T., Tjandraatmadja, C., Ramalingam, S.: Bounding and counting linear regions of deep neural networks. In: Thirty-fifth International Conference on Machine Learning (2018)
2018
Closest in time.
Vielma, J.P.: Small and strong formulations for unions of convex sets from the Cayley embedding. Mathematical Programming (2018)
2018
Closest in time.
Wong, E., Kolter, J.Z.: Provable defenses against adversarial examples via the convex outer adversarial polytope. In: International Conference on Machine Learning (2018)
2018
Closest in time.
Wong, E., Schmidt, F., Metzen, J.H., Kolter, J.Z.: Scaling provable adversarial defenses. In: 32nd Conference on Neural Information Processing Systems (2018)
2018
Closest in time.
Khalil, E.B., Gupta, A., Dilkina, B.: Combinatorial attacks on binarized neural networks. In: International Conference on Learning Representations (2019)
2019
Closest in time.
Tjeng, V., Xiao, K., Tedrake, R.: Verifying neural networks with mixed integer programming. In: International Conference on Learning Representations (2019)
2019
Closest in time.
Xiao, K.Y., Tjeng, V., Shafiullah, N.M., Madry, A.: Training for faster adversarial robustness verification via inducing ReLU stability. In: International Conference on Learning Representations (2019)
2019
Closest in time.