OmniJet-$\alpha$: The first cross-task foundation model for particle physics

Anja Butter, Tilman Plehn, and Ramon Winterhalder, “How to GAN LHC Events,” SciPost Phys. 7

Original

1907

Earlier work this paper cites.

Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Ves Stoyanov, and Luke Zettlemoyer, “BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension,” (2019), arXiv:1910.13461 [cs.CL]

Original

1910

Earlier work this paper cites.

Tom B. Brown et al. , “Language models are few-shot learners,” (2020), arXiv:2005.14165 [cs.CL]

Original

2005

Earlier work this paper cites.

Erik Buhmann, Sascha Diefenbacher, Engin Eren, Frank Gaede, Gregor Kasieczka, Anatolii Korol, and Katja Krüger, “Getting High: High Fidelity Simulation of High Granularity Calorimeters with High Speed,” Comput. Softw. Big Sci. 5

Original

2005

Earlier work this paper cites.

The CMS Collaboration, “The CMS experiment at the CERN LHC,” JINST 3

2008

Earlier work this paper cites.

Matteo Cacciari, Gavin P Salam, and Gregory Soyez, “The anti-kt jet clustering algorithm,” Journal of High Energy Physics 2008

2008

Earlier work this paper cites.

Jesse Thaler and Ken Van Tilburg, “Identifying Boosted Objects with N-subjettiness,” JHEP 03

Original

2011

Earlier work this paper cites.

J. Alwall, R. Frederix, S. Frixione, V. Hirschi, F. Maltoni, O. Mattelaer, H.-S. Shao, T. Stelzer, P. Torrielli, and M. Zaro, “The automated computation of tree-level and next-to-leading order differential cross sections, and their matching to parton shower simulations,” Journal of High Energy Physics 2014

2014

Earlier work this paper cites.

J. de Favereau, C. Delaere, P. Demin, A. Giammanco, V. Lemaître, A. Mertens, and M. Selvaggi, “DELPHES 3: a modular framework for fast simulation of a generic collider experiment,” Journal of High Energy Physics 2014

2014

Earlier work this paper cites.

Torbjörn Sjöstrand, Stefan Ask, Jesper R. Christiansen, Richard Corke, Nishita Desai, Philip Ilten, Stephen Mrenna, Stefan Prestel, Christine O. Rasmussen, and Peter Z. Skands, “An introduction to PYTHIA 8.2,” Computer Physics Communications 191

2015

Earlier work this paper cites.

Jimmy Lei Ba, Jamie Ryan Kiros, and Geoffrey E. Hinton, “Layer normalization,” (2016), arXiv:1607.06450 [stat.ML]

Original

2016

Earlier work this paper cites.

Luke de Oliveira, Michela Paganini, and Benjamin Nachman, “Learning Particle Physics by Example: Location-Aware Generative Adversarial Networks for Physics Synthesis,” Computing and Software for Big Science 1

2017

Earlier work this paper cites.

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin, “Attention Is All You Need,” in 31st International Conference on Neural Information Processing Systems (2017) arXiv:1706.03762 [cs.CL]

Original

2017

Earlier work this paper cites.

Gregor Kasieczka, Tilman Plehn, Michael Russell, and Torben Schell, “Deep-learning Top Taggers or The End of QCD?” JHEP 05

Original

2017

Earlier work this paper cites.

Diederik P. Kingma and Jimmy Ba, “Adam: A method for stochastic optimization,” (2017), arXiv:1412.6980 [cs.LG]

Original

2017

Earlier work this paper cites.

Sebastian Macaluso and David Shih, “Pulling out all the tops with computer vision and deep learning,” Journal of High Energy Physics 2018

2018

Earlier work this paper cites.

Michela Paganini, Luke de Oliveira, and Benjamin Nachman, “Accelerating Science with Generative Adversarial Networks: An Application to 3D Particle Showers in Multilayer Calorimeters,” Phys. Rev. Lett. 120

Original

2018

Earlier work this paper cites.

Aaron van den Oord, Oriol Vinyals, and Koray Kavukcuoglu, “Neural discrete representation learning,” (2018), arXiv:1711.00937 [cs.LG]

Original

2018

Earlier work this paper cites.

Alec Radford, Karthik Narasimhan, Tim Salimans, and Ilya Sutskever, “Improving language understanding by generative pre-training,” (2018)

2018

Earlier work this paper cites.

Manzil Zaheer, Satwik Kottur, Siamak Ravanbakhsh, Barnabas Poczos, Ruslan Salakhutdinov, and Alexander Smola, “Deep Sets,” (2018), arXiv:1703.06114 [cs.LG]

Original

2018

Earlier work this paper cites.

Leslie N. Smith, “A disciplined approach to neural network hyper-parameters: Part 1 – learning rate, batch size, momentum, and weight decay,” (2018), arXiv:1803.09820 [cs.LG]

Original

2018

Earlier work this paper cites.

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova, “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding,” (2019), arXiv:1810.04805 [cs.CL]

Original

2019

Cited alongside, same era.

Johannes Albrecht et al. (HEP Software Foundation), “A Roadmap for HEP Software and Computing R&D for the 2020s,” Comput. Softw. Big Sci. 3

Original

2019

Cited alongside, same era.

Patrick T. Komiske, Eric M. Metodiev, and Jesse Thaler, “Energy flow networks: deep sets for particle jets,” Journal of High Energy Physics 2019

2019

Cited alongside, same era.

Adam Paszke et al. , “PyTorch: An Imperative Style, High-Performance Deep Learning Library,” in Advances in Neural Information Processing Systems 32 , edited by H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alché-Buc, E. Fox, and R. Garnett (Curran Associates, Inc., 2019) pp. 8024–8035

2019

Cited alongside, same era.

Junze Liu, Aishik Ghosh, Dylan Smith, Pierre Baldi, and Daniel Whiteson, “Generalizing to new geometries with Geometry-Aware Autoregressive Models (GAAMs) for fast calorimeter simulation,” JINST 18

Original

2023

Later among the works it cites.

Dalila Salamani, Anna Zaborowska, and Witold Pokorski, “MetaHEP: Meta learning for fast shower simulation of high energy physics experiments,” Phys. Lett. B 844

2023

Later among the works it cites.

Thorben Finke, Michael Krämer, Alexander Mück, and Jan Tönshoff, “Learning the language of QCD jets with transformers,” JHEP 06

Original

2023

Later among the works it cites.

Anja Butter, Nathan Huetsch, Sofia Palacios Schweitzer, Tilman Plehn, Peter Sorrenson, and Jonas Spinner, “Jet Diffusion versus JetGPT – Modern Networks for the LHC,” (2023), arXiv:2305.10475 [hep-ph]

Original

2023

Later among the works it cites.