Fetching the paper…

Reading the bibliography…

2023

MiDi: Mixed Graph and 3D Denoising Diffusion for Molecule Generation

Vignac, Clement, Osman, Nagham, Toni, Laura et al.

Original
PDF
Post on X

Understand

This work introduces MiDi, a novel diffusion model for jointly generating molecular graphs and their corresponding 3D arrangement of atoms.

Unlike existing methods that rely on predefined rules to determine molecular bonds based on the 3D conformation, MiDi offers an end-to-end differentiable approach that streamlines the molecule generation process.
Our experimental results demonstrate the effectiveness of this approach.
On the challenging GEOM-DRUGS dataset, MiDi generates 92% of stable molecules, against 6% for the previous EDM model that uses interatomic distances for bond prediction, and 40% using EDM followed by an algorithm that directly optimize bond orders for validity.

MiDi: Mixed Graph and 3D Denoising Diffusion for Molecule Generation · Around

Built on

Hajduk, P.J., Greer, J.: A decade of fragment-based drug design: strategic advances and lessons learned. Nature reviews Drug discovery 6
2007
Earlier work this paper cites.
O’Boyle, N.M., Banck, M., James, C.A., Morley, C., Vandermeersch, T., Hutchison, G.R.: Open babel: An open chemical toolbox. Journal of cheminformatics 3
2011
Earlier work this paper cites.
Ioffe, S., Szegedy, C.: Batch normalization: Accelerating deep network training by reducing internal covariate shift. In: International conference on machine learning. pp. 448–456. PMLR (2015)
2015
Earlier work this paper cites.
Jaderberg, M., Simonyan, K., Zisserman, A., et al.: Spatial transformer networks. Advances in neural information processing systems 28
2015
Earlier work this paper cites.
Sohl-Dickstein, J., Weiss, E.A., Maheswaranathan, N., Ganguli, S.: Deep unsupervised learning using nonequilibrium thermodynamics. In: Bach, F.R., Blei, D.M. (eds.) Proceedings of the 32nd International Conference on Machine Learning, ICML (2015)
2015
Earlier work this paper cites.
Ba, J.L., Kiros, J.R., Hinton, G.E.: Layer normalization. arXiv preprint arXiv:1607.06450 (2016)
Original
2016
Earlier work this paper cites.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., Polosukhin, I.: Attention is all you need. Advances in neural information processing systems 30
2017
Earlier work this paper cites.
Liu, Q., Allamanis, M., Brockschmidt, M., Gaunt, A.: Constrained graph variational autoencoders for molecule design. Advances in neural information processing systems 31
2018
Earlier work this paper cites.
Thomas, N., Smidt, T., Kearnes, S.M., Yang, L., Li, L., Kohlhoff, K., Riley, P.: Tensor field networks: Rotation- and translation-equivariant neural networks for 3d point clouds. CoRR abs/1802.08219
Original
2018
Earlier work this paper cites.
Wu, Z., Ramsundar, B., Feinberg, E., Gomes, J., Geniesse, C., Pappu, A.S., Leswing, K., Pande, V.: Moleculenet: a benchmark for molecular machine learning. Chem. Sci. 9
2018
Earlier work this paper cites.
Gebauer, N.W., Gastegger, M., Schütt, K.T.: Symmetry-adapted generation of 3d point sets for the targeted discovery of molecules. arXiv preprint arXiv:1906.00957 (2019)
Original
2019
Earlier work this paper cites.
Liao, R., Li, Y., Song, Y., Wang, S., Nash, C., Hamilton, W.L., Duvenaud, D., Urtasun, R., Zemel, R.: Efficient graph generation with graph recurrent attention networks. In: NeurIPS (2019)
2019
Earlier work this paper cites.
Madhawa, K., Ishiguro, K., Nakago, K., Abe, M.: Graphnvp: An invertible flow model for generating molecular graphs. arXiv preprint arXiv:1905.11600 (2019)
Original
2019
Earlier work this paper cites.
Song, Y., Ermon, S.: Generative modeling by estimating gradients of the data distribution. Advances in Neural Information Processing Systems 32
2019
Earlier work this paper cites.
Axelrod, S., Gomez-Bombarelli, R.: Geom: Energy-annotated molecular conformations for property prediction and molecular generation. arXiv preprint arXiv:2006.05531 (2020)
Original
2020
Earlier work this paper cites.
Corso, G., Cavalleri, L., Beaini, D., Liò, P., Veličković, P.: Principal neighbourhood aggregation for graph nets. Advances in Neural Information Processing Systems 33
2020
Earlier work this paper cites.
Ho, J., Jain, A., Abbeel, P.: Denoising diffusion probabilistic models. In: Larochelle, H., Ranzato, M., Hadsell, R., Balcan, M., Lin, H. (eds.) Advances in Neural Information Processing Systems. vol. 33, pp. 6840–6851. Curran Associates, Inc. (2020), https://proceedings.neurips.cc/paper/2020/file/4c5bcfec8584af0d967f1ab10179ca4b-Paper.pdf
2020
Earlier work this paper cites.
Jin, W., Barzilay, R., Jaakkola, T.: Hierarchical generation of molecular graphs using structural motifs. In: International Conference on Machine Learning. pp. 4839–4848. PMLR (2020)
2020
Earlier work this paper cites.

Similar

Austin, J., Johnson, D., Ho, J., Tarlow, D., van den Berg, R.: Structured denoising diffusion models in discrete state-spaces. Advances in Neural Information Processing Systems 34
2021
Cited alongside, same era.
Brandstetter, J., Hesselink, R., van der Pol, E., Bekkers, E.J., Welling, M.: Geometric and physical quantities improve e (3) equivariant message passing. arXiv preprint arXiv:2110.02905 (2021)
Original
2021
Cited alongside, same era.
Dwivedi, V.P., Bresson, X.: A generalization of transformer networks to graphs. AAAI Workshop on Deep Learning on Graphs: Methods and Applications (2021)
2021
Cited alongside, same era.
Gasteiger, J., Becker, F., Günnemann, S.: Gemnet: Universal directional graph neural networks for molecules. Advances in Neural Information Processing Systems 34
2021
Cited alongside, same era.

Then

Ingraham, J., Baranov, M., Costello, Z., Frappier, V., Ismail, A., Tie, S., Wang, W., Xue, V., Obermeyer, F., Beam, A., et al.: Illuminating protein space with a programmable generative model. bioRxiv (2022)
2022
Later among the works it cites.
Jo, J., Lee, S., Hwang, S.J.: Score-based generative modeling of graphs via the system of stochastic differential equations. arXiv preprint arXiv:2202.02514 (2022)
Original
2022
Later among the works it cites.
Kaba, S.O., Mondal, A.K., Zhang, Y., Bengio, Y., Ravanbakhsh, S.: Equivariance with learned canonicalization functions. In: NeurIPS 2022 Workshop on Symmetry and Geometry in Neural Representations (2022), https://openreview.net/forum?id=pVD1k8ge25a
2022
Later among the works it cites.
Liao, Y.L., Smidt, T.: Equiformer: Equivariant graph attention transformer for 3d atomistic graphs. arXiv preprint arXiv:2206.11990 (2022)
Original
2022
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Hoogeboom, E., Nielsen, D., Jaini, P., Forré, P., Welling, M.: Argmax flows and multinomial diffusion: Learning categorical distributions. Advances in Neural Information Processing Systems 34

2021

Cited alongside, same era.

Mercado, R., Rastemo, T., Lindelöf, E., Klambauer, G., Engkvist, O., Chen, H., Bjerrum, E.J.: Graph networks for molecular design. Machine Learning: Science and Technology 2

2021

Cited alongside, same era.

Satorras, V.G., Hoogeboom, E., Fuchs, F., Posner, I., Welling, M.: E(n) equivariant normalizing flows. Advances in Neural Information Processing Systems 34

2021

Cited alongside, same era.

Satorras, V.G., Hoogeboom, E., Fuchs, F.B., Posner, I., Welling, M.: E (n) equivariant normalizing flows. arXiv preprint arXiv:2105.09016 (2021)

Original

2021

Cited alongside, same era.

Satorras, V.G., Hoogeboom, E., Welling, M.: E (n) equivariant graph neural networks. arXiv preprint arXiv:2102.09844 (2021)

Original

2021

Cited alongside, same era.

Vignac, C., Frossard, P.: Top-n: Equivariant set and graph generation without exchangeability. arXiv preprint arXiv:2110.02096 (2021)

2021

Cited alongside, same era.

Bao, F., Zhao, M., Hao, Z., Li, P., Li, C., Zhu, J.: Equivariant energy-guided sde for inverse molecular design. arXiv preprint arXiv:2209.15408 (2022)

Original

2022

Cited alongside, same era.

Corso, G., Stärk, H., Jing, B., Barzilay, R., Jaakkola, T.: Diffdock: Diffusion steps, twists, and turns for molecular docking. arXiv preprint arXiv:2210.01776 (2022)

Original

2022

Cited alongside, same era.

Luo, T., Mo, Z., Pan, S.J.: Fast graph generative model via spectral diffusion. arXiv preprint arXiv:2211.08892 (2022)

2022

Later among the works it cites.

Maziarz, K., Jackson-Flux, H.R., Cameron, P., Sirockin, F., Schneider, N., Stiefl, N., Segler, M., Brockschmidt, M.: Learning to extend molecular scaffolds with structural motifs. In: International Conference on Learning Representations (ICLR) (2022)

2022

Later among the works it cites.

Schneuing, A., Du, Y., Harris, C., Jamasb, A., Igashov, I., Du, W., Blundell, T., Lió, P., Gomes, C., Welling, M., et al.: Structure-based drug design with equivariant diffusion models. arXiv preprint arXiv:2210.13695 (2022)

2022

Later among the works it cites.

Shi, C., Wang, C., Lu, J., Zhong, B., Tang, J.: Protein sequence and structure co-design with equivariant translation. arXiv preprint arXiv:2210.08761 (2022)

Original

2022

Later among the works it cites.

Wang, Z., Nie, W., Qiao, Z., Xiao, C., Baraniuk, R., Anandkumar, A.: Retrieval-based controllable molecule generation. arXiv preprint arXiv:2208.11126 (2022)

Original

2022

Later among the works it cites.

Watson, J.L., Juergens, D., Bennett, N.R., Trippe, B.L., Yim, J., Eisenach, H.E., Ahern, W., Borst, A.J., Ragotte, R.J., Milles, L.F., et al.: Broadly applicable and accurate protein design by integrating structure prediction networks and diffusion generative models. bioRxiv (2022)

2022

Later among the works it cites.

Wu, K.E., Yang, K.K., Berg, R.v.d., Zou, J.Y., Lu, A.X., Amini, A.P.: Protein structure generation via folding diffusion. arXiv preprint arXiv:2209.15611 (2022)

2022

Later among the works it cites.

Xu, M., Yu, L., Song, Y., Shi, C., Ermon, S., Tang, J.: Geodiff: A geometric diffusion model for molecular conformation generation. In: International Conference on Learning Representations (2022), https://openreview.net/forum?id=PzcvxEMzvQC

2022

Later among the works it cites.

Zhang, L.H., Tozzo, V., Higgins, J.M., Ranganath, R.: Set norm and equivariant skip connections: Putting the deep in deep sets (2022), https://openreview.net/forum?id=MDT30TEtaVY

2022

Later among the works it cites.

Hua, C., Luan, S., Xu, M., Ying, R., Fu, J., Ermon, S., Precup, D.: Mudiff: Unified diffusion for complete molecule generation. arXiv preprint arXiv:2304.14621 (2023)

Original

2023

Closest in time.

Morehead, A., Cheng, J.: Geometry-complete diffusion for 3d molecule generation. arXiv preprint arXiv:2302.04313 (2023)

Original

2023

Closest in time.

Peng, X., Guan, J., Liu, Q., Ma, J.: Moldiff: Addressing the atom-bond inconsistency problem in 3d molecule diffusion generation. arXiv preprint arXiv:2305.07508 (2023)

2023

Closest in time.

Vignac, C., Krawczuk, I., Siraudin, A., Wang, B., Cevher, V., Frossard, P.: Digress: Discrete denoising diffusion for graph generation. In: The Eleventh International Conference on Learning Representations (2023), https://openreview.net/forum?id=UaAD-Nu86WX

2023

Closest in time.