Fetching the paper…

Reading the bibliography…

2023

Learning the language of QCD jets with transformers

Finke, Thorben, Krämer, Michael, Mück, Alexander et al.

Original
PDF
Post on X

Understand

Transformers have become the primary architecture for natural language processing.

In this study, we explore their use for auto-regressive density estimation in high-energy jet physics, which involves working with a high-dimensional space.
We draw an analogy between sentences and words in natural language and jets and their constituents in high-energy physics.
Specifically, we investigate density estimation for light QCD jets and hadronically decaying boosted top jets.

Learning the language of QCD jets with transformers · Around

Built on

H. Qu and L. Gouskos, ParticleNet: Jet Tagging via Particle Clouds
Original
1902
Earlier work this paper cites.
A. Butter et al., The Machine Learning landscape of top taggers
Original
1902
Earlier work this paper cites.
A. Holtzman, J. Buys, L. Du, M. Forbes, and Y. Choi, The Curious Case of Neural Text Degeneration
Original
1904
Earlier work this paper cites.
A. Andreassen, I. Feige, C. Frye, and M. D. Schwartz, Binary JUNIPR: an interpretable probabilistic model for discrimination
Original
1906
Earlier work this paper cites.
T. Wolf, L. Debut, V. Sanh, J. Chaumond, C. Delangue, et al., HuggingFace’s Transformers: State-of-the-art Natural Language Processing
Original
1910
Earlier work this paper cites.

Similar

B. Nachman and D. Shih, Anomaly Detection with Density Estimation
Original
2001
Cited alongside, same era.
R. Fakoor, P. Chaudhari, J. Mueller, and A. J. Smola, TraDE: Transformers for Density Estimation
Original
2004
Cited alongside, same era.
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, et al., Attention is all you need
Original
2017
Cited alongside, same era.
A. Andreassen, I. Feige, C. Frye, and M. D. Schwartz, JUNIPR: a Framework for Unsupervised Machine Learning in Particle Physics
Original
2019
Cited alongside, same era.
Curran Associates, Inc., 2019
A. Paszke, S. Gross, F. Massa, A. Lerer, J. Bradbury, et al., PyTorch: An Imperative Style, High-Performance Deep Learning Library · 2019

Then

G. Kasieczka, T. Plehn, J. Thompson, and M. Russel, Top Quark Tagging Reference Dataset
2019
Later among the works it cites.
G. Louppe, K. Cho, C. Becot, and K. Cranmer, QCD-Aware Recursive Neural Networks for Jet Physics
Original
2019
Later among the works it cites.
V. Mikuni and F. Canelli, Point cloud transformers applied to collider physics
Original
2021
Later among the works it cites.
2211.15380
Original
J. C. Cresswell, B. L. Ross, G. Loaiza-Ganem, H. Reyes-Gonzalez, M. Letizia, et al., CaloMan: Fast generation of calorimeter showers with density estimation on learned manifolds · 2022
Later among the works it cites.
B. M. Dillon, G. Kasieczka, H. Olischlager, T. Plehn, P. Sorrenson, et al., Symmetries, safety, and self-supervision
Original

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Cited alongside, same era.

M. Feickert and B. Nachman, A Living Review of Machine Learning for Particle Physics

Cited in the paper.

S. Badger et al., Machine Learning and LHC Event Generation

Cited in the paper.

I. J. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, et al., Generative Adversarial Networks

Cited in the paper.

D. J. Rezende and S. Mohamed, Variational Inference with Normalizing Flows

Cited in the paper.

G. Loaiza-Ganem, B. L. Ross, J. C. Cresswell, and A. L. Caterini, Diagnosing and Fixing Manifold Overfitting in Deep Generative Models

Cited in the paper.

C. Krause and D. Shih, CaloFlow: Fast and Accurate Generation of Calorimeter Showers with Normalizing Flows

Cited in the paper.

C. Krause and D. Shih, CaloFlow II: Even Faster and Still Accurate Generation of Calorimeter Showers with Normalizing Flows

Cited in the paper.

2022

Later among the works it cites.