Fetching the paper…
Reading the bibliography…
Learning scientific document representations can be substantially improved through contrastive learning objectives, where the challenge lies in creating positive and negative training samples that encode the desired similarity semantics.
Bibliographic coupling between scientific papers
M. M. Kessler. 1963 · 1963
Earlier work this paper cites.
The scientific enterprise: Public knowledge. an essay concerning the social dimension of science
Simon Pasternack. 1969 · 1969
Earlier work this paper cites.
Co-citation in the scientific literature: A new measure of the relationship between two documents
Henry Small. 1973 · 1973
Earlier work this paper cites.
Medical subject headings (mesh)
Carolyn E. Lipscomb. 2000 · 2000
Earlier work this paper cites.
CERT: Contrastive Self-supervised Learning for Language Understanding
Hongchao Fang, Sicheng Wang, Meng Zhou, Jiayuan Ding, and Pengtao Xie. 2020 · 2005
Earlier work this paper cites.
Automatic classification of citation function
Simone Teufel, Advaith Siddharthan, and Dan Tidhar. 2006 · 2006
Earlier work this paper cites.
Blind men and elephants: What do citation summaries tell us about a research article?
Aaron Elkiss, Siwei Shen, Anthony Fader, Güneş Erkan, David States, and Dragomir Radev. 2008 · 2008
Earlier work this paper cites.
Citation Proximity Analysis (CPA) - A new approach for identifying related work based on Co-Citation Analysis
Bela Gipp and J Beel. 2009 · 2009
Earlier work this paper cites.
CLEAR: Contrastive Learning for Sentence Representation
Zhuofeng Wu, Sinong Wang, Jiatao Gu, Madian Khabsa, Fei Sun, and Hao Ma. 2020 · 2012
Earlier work this paper cites.
Zero-shot learning through cross-modal transfer
Richard Socher, Milind Ganjoo, Christopher D Manning, and Andrew Ng. 2013 · 2013
Earlier work this paper cites.
DeepWalk: online learning of social representations
Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014 · 2014
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik P. Kingma and Jimmy Lei Ba. 2015 · 2015
Earlier work this paper cites.
Facenet: A unified embedding for face recognition and clustering
Florian Schroff, Dmitry Kalenichenko, and James Philbin. 2015 · 2015
Earlier work this paper cites.
An overview of microsoft academic service (mas) and applications
Arnab Sinha, Zhihong Shen, Yang Song, Hao Ma, Darrin Eide, Bo-June Paul Hsu, and Kuansan Wang. 2015 · 2015
Earlier work this paper cites.
Network representation learning with rich text information
Cheng Yang, Zhiyuan Liu, Deli Zhao, Maosong Sun, and Edward Y. Chang. 2015 · 2015
Earlier work this paper cites.
Hard negative mining for metric learning based zero-shot classification
Maxime Bucher, Stéphane Herbin, and Frédéric Jurie. 2016 · 2016
Earlier work this paper cites.
node2vec: Scalable Feature Learning for Networks
Aditya Grover and Jure Leskovec. 2016 · 2016
Earlier work this paper cites.
Attention Is All You Need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Earlier work this paper cites.
Sampling Matters in Deep Embedding Learning
Chao-yuan Wu, R. Manmatha, Alexander J Smola, and Philipp Krahenbuhl. 2017 · 2017
Earlier work this paper cites.
Content-based citation recommendation
Chandra Bhagavatula, Sergey Feldman, Russell Power, and Waleed Ammar. 2018 · 2018
Earlier work this paper cites.
Daniel Matthew Cer, Yinfei Yang, Sheng yi Kong, Nan Hua, Nicole Limtiaco, Rhomni St. John, Noah Constant, Mario Guajardo-Cespedes, Steve Yuan, Chris Tar, Yun-Hsuan Sung, Brian Strope, and Ray Kurzweil. 2018 · 2018
Cited alongside, same era.
hyperdoc2vec: Distributed Representations of Hypertext Documents
Jialong Han, Yan Song, Wayne Xin Zhao, Shuming Shi, and Haisong Zhang. 2018 · 2018
Cited alongside, same era.
Zero-shot recognition via semantic embeddings and knowledge graphs
X. Wang, Yufei Ye, and Abhinav Kumar Gupta. 2018 · 2018
Cited alongside, same era.
SciBERT: A Pretrained Language Model for Scientific Text
Iz Beltagy, Kyle Lo, and Arman Cohan. 2019 · 2019
Cited alongside, same era.
Global Vectors for Node Representations
Robin Brochier, Adrien Guille, and Julien Velcin. 2019 · 2019
Cited alongside, same era.
QURATOR: Innovative Technologies for Content and Data Curation
Georg Rehm, Peter Bourgonje, Stefanie Hegele, Florian Kintzel, Julán Moreno Schneider, Malte Ostendorff, Karolina Zaczynska, Armin Berger, Stefan Grill, Sören Räuchle, Jens Rauenbusch, Lisa Rutenburg, André Schmidt, Mikka Wild, Henry Hoffmann, Julian Fink, Sarah Schulz, Jurica Seva, Joachim Quantz, Joachim Böttger, Josefine Matthey, Rolf Fricke, Jan Thomsen, Adrian Paschke, Jamal Al Qundus, Thomas Hoppe, Naouel Karam, Frauke Weichhardt, Christian Fillies, Clemens Neudecker, Mike Gerber, Kai Labusch, Vahid Rezanezhad, Robin Schaefer, David Zellhöfer, Daniel Siewert, Patrick Bunk, Lydia Pintscher, Elena Aleynikova, and Franziska Heine. 2020 · 2020
Later among the works it cites.
A primer in bertology: What we know about how BERT works
Anna Rogers, Olga Kovaleva, and Anna Rumshisky. 2020 · 2020
Later among the works it cites.
What makes for good views for contrastive learning?
Yonglong Tian, Chen Sun, Ben Poole, Dilip Krishnan, Cordelia Schmid, and Phillip Isola. 2020b · 2020
Later among the works it cites.
Fact or Fiction: Verifying Scientific Claims
David Wadden, Shanchuan Lin, Kyle Lo, Lucy Lu Wang, Madeleine van Zuylen, Arman Cohan, and Hannaneh Hajishirzi. 2020 · 2020
Later among the works it cites.
Understanding contrastive representation learning through alignment and uniformity on the hypersphere
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Arman Cohan, Waleed Ammar, Madeleine van Zuylen, and Field Cady. 2019 · 2019
Cited alongside, same era.
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019
Cited alongside, same era.
BioBERT: a pre-trained biomedical language representation model for biomedical text mining
Jinhyuk Lee, Wonjin Yoon, Sungdong Kim, Donghyeon Kim, Sunkyu Kim, Chan Ho So, and Jaewoo Kang. 2019 · 2019
Cited alongside, same era.
PyTorch-BigGraph: A Large-scale Graph Embedding System
Adam Lerer, Ledell Wu, Jiajun Shen, Timothee Lacroix, Luca Wehrstedt, Abhijit Bose, and Alex Peysakhovich. 2019 · 2019
Cited alongside, same era.
Decoupled weight decay regularization
Ilya Loshchilov and Frank Hutter. 2019 · 2019
Cited alongside, same era.
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Nils Reimers and Iryna Gurevych. 2019 · 2019
Cited alongside, same era.
A theoretical analysis of contrastive unsupervised representation learning
Nikunj Saunshi, Orestis Plevrakis, Sanjeev Arora, Mikhail Khodak, and Hrishikesh Khandeparkar. 2019 · 2019
Cited alongside, same era.
Tongzhou Wang and Phillip Isola. 2020 · 2020
Later among the works it cites.
Transformers: State-of-the-Art Natural Language Processing
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, and Jamie Brew. 2020 · 2020
Later among the works it cites.
Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval
Lee Xiong, Chenyan Xiong, Ye Li, Kwok-Fung Tang, Jialin Liu, Paul Bennett, Junaid Ahmed, and Arnold Overwijk. 2020 · 2020
Later among the works it cites.
SimCSE: Simple contrastive learning of sentence embeddings
Tianyu Gao, Xingcheng Yao, and Danqi Chen. 2021 · 2021
Later among the works it cites.
DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations
John Giorgi, Osvald Nitski, Bo Wang, and Gary Bader. 2021 · 2021
Later among the works it cites.
Billion-Scale Similarity Search with GPUs
Jeff Johnson, Matthijs Douze, and Herve Jegou. 2021 · 2021
Later among the works it cites.
Comparative analysis on cross-modal information retrieval: A review
Parminder Kaur, Husanbir Singh Pannu, and Avleen Kaur Malhi. 2021 · 2021
Later among the works it cites.
Self-guided contrastive learning for BERT sentence representations
Taeuk Kim, Kang Min Yoo, and Sang-goo Lee. 2021 · 2021
Later among the works it cites.
Explaining Relationships Between Scientific Documents
Kelvin Luu, Xinyi Wu, Rik Koncel-Kedziorski, Kyle Lo, Isabel Cachola, and Noah A. Smith. 2021 · 2021
Later among the works it cites.
Data-Efficient Pretraining via Contrastive Self-Supervision
Nils Rethmeier and Isabelle Augenstein. 2021 · 2021
Later among the works it cites.
Text data augmentation for deep learning
Connor Shorten, Taghi M. Khoshgoftaar, and Borko Furht. 2021 · 2021
Later among the works it cites.
CiteWorth: Cite-worthiness detection for improved scientific document understanding
Dustin Wright and Isabelle Augenstein. 2021 · 2021
Later among the works it cites.
Smoothed Contrastive Learning for Unsupervised Sentence Embedding
Xing Wu, Chaochen Gao, Liangjun Zang, Jizhong Han, Zhongyuan Wang, and Songlin Hu. 2021 · 2021
Later among the works it cites.
BitFit: Simple parameter-efficient fine-tuning for transformer-based masked language-models
Elad Ben Zaken, Yoav Goldberg, and Shauli Ravfogel. 2022 · 2022
Closest in time.
Longitudinal Citation Prediction using Temporal Graph Neural Networks
Andreas Nugaard Holm, Barbara Plank, Dustin Wright, and Isabelle Augenstein. 2022 · 2022
Closest in time.
A primer on contrastive pretraining in language processing: Methods, lessons learned & perspectives
Nils Rethmeier and Isabelle Augenstein. 2022 · 2022
Closest in time.