Fetching the paper…
Reading the bibliography…
Retrieval-based language models (R-LM) model the probability of natural language text by combining a standard language model (LM) with examples retrieved from an external datastore at test time.
Learning and extracting finite state automata with second-order recurrent neural networks
Giles, C. L., Miller, C. B., Chen, D., Chen, H.-H., Sun, G.-Z., and Lee, Y.-C · 1992
Earlier work this paper cites.
Extraction of rules from discrete-time recurrent neural networks
Omlin, C. W. and Giles, C. L · 1996
Earlier work this paper cites.
Generalizing and hybridizing count-based and neural language models
Neubig, G. and Dyer, C · 2016
Earlier work this paper cites.
Weighting finite-state transductions with neural context
Rastogi, P., Cotterell, R., and Eisner, J · 2016
Earlier work this paper cites.
Neural machine translation of rare words with subword units
Sennrich, R., Haddow, B., and Birch, A · 2016
Earlier work this paper cites.
Unbounded cache model for online language modeling with open vocabulary
Grave, E., Cisse, M. M., and Joulin, A · 2017
Earlier work this paper cites.
Efficient softmax approximation for gpus
Joulin, A., Cissé, M., Grangier, D., Jégou, H., et al · 2017
Earlier work this paper cites.
Six challenges for neural machine translation
Koehn, P. and Knowles, R · 2017
Earlier work this paper cites.
Pointer sentinel mixture models
Merity, S., Xiong, C., Bradbury, J., and Socher, R · 2017
Earlier work this paper cites.
Attention is all you need
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., and Polosukhin, I · 2017
Earlier work this paper cites.
SPTAG: A library for fast approximate nearest neighbor search , 2018
Chen, Q., Wang, H., Li, M., Ren, G., Li, S., Zhu, J., Li, J., Liu, C., Zhang, L., and Wang, J · 2018
Earlier work this paper cites.
Search engine guided neural machine translation
Gu, J., Wang, Y., Cho, K., and Li, V. O · 2018
Earlier work this paper cites.
Generating sentences by editing prototypes
Guu, K., Hashimoto, T. B., Oren, Y., and Liang, P · 2018
Earlier work this paper cites.
A retrieve-and-edit framework for predicting structured outputs
Hashimoto, T. B., Guu, K., Oren, Y., and Liang, P · 2018
Earlier work this paper cites.
Retrieval-based neural code generation
Hayati, S. A., Olivier, R., Avvaru, P., Yin, P., Tomasic, A., and Neubig, G · 2018
Cited alongside, same era.
Rational recurrences
Peng, H., Schwartz, R., Thomson, S., and Smith, N. A · 2018
Cited alongside, same era.
Bridging cnns, rnns, and weighted finite-state machines
Schwartz, R., Thomson, S., and Smith, N. A · 2018
Cited alongside, same era.
Extracting automata from recurrent neural networks using queries and counterexamples
Weiss, G., Goldberg, Y., and Yahav, E · 2018
Cited alongside, same era.
Guiding neural machine translation with retrieved translation pieces
Zhang, J., Utiyama, M., Sumita, E., Neubig, G., and Nakamura, S · 2018
Cited alongside, same era.
Adaptive input representations for neural language modeling
Baevski, A. and Auli, M · 2019
Cited alongside, same era.
Learning sparse prototypes for text generation
He, J., Berg-Kirkpatrick, T., and Neubig, G · 2020
Later among the works it cites.
Dense passage retrieval for open-domain question answering
Karpukhin, V., Oguz, B., Min, S., Lewis, P., Wu, L., Edunov, S., Chen, D., and Yih, W.-t · 2020
Later among the works it cites.
Generalization through memorization: Nearest neighbor language models
Khandelwal, U., Levy, O., Jurafsky, D., Zettlemoyer, L., and Lewis, M · 2020
Later among the works it cites.
Improving language models by retrieving from trillions of tokens
Borgeaud, S., Mensch, A., Hoffmann, J., Cai, T., Rutherford, E., Millican, K., Driessche, G. v. d., Lespiau, J.-B., Damoc, B., Clark, A., et al · 2021
Later among the works it cites.
Efficient nearest neighbor language models
He, J., Neubig, G., and Berg-Kirkpatrick, T · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Findings of the 2019 conference on machine translation (WMT19)
Barrault, L., Bojar, O., Costa-jussà, M. R., Federmann, C., Fishel, M., Graham, Y., Haddow, B., Huck, M., Koehn, P., Malmasi, S., Monz, C., Müller, M., Pal, S., Post, M., and Zampieri, M · 2019
Cited alongside, same era.
Billion-scale similarity search with gpus
Johnson, J., Douze, M., and Jégou, H · 2019
Cited alongside, same era.
Neural finite-state transducers: Beyond rational relations
Lin, C.-C., Zhu, H., Gormley, M. R., and Eisner, J · 2019
Cited alongside, same era.
Facebook fair’s wmt19 news translation task submission
Ng, N., Yee, K., Baevski, A., Ott, M., Auli, M., and Edunov, S · 2019
Cited alongside, same era.
Learning deterministic weighted automata with queries and counterexamples
Weiss, G., Goldberg, Y., and Yahav, E · 2019
Cited alongside, same era.
Unsupervised domain clusters in pretrained language models
Aharoni, R. and Goldberg, Y · 2020
Cited alongside, same era.
Jiang, Q., Wang, M., Cao, J., Cheng, S., Huang, S., and Li, L · 2021
Later among the works it cites.
Nearest neighbor machine translation
Khandelwal, U., Fan, A., Jurafsky, D., Zettlemoyer, L., and Lewis, M · 2021
Later among the works it cites.
Learning to retrieve passages without supervision
Ram, O., Shachaf, G., Levy, O., Berant, J., and Globerson, A · 2021
Later among the works it cites.
Lexically-aware semi-supervised learning for ocr post-correction
Rijhwani, S., Rosenblum, D., Anastasopoulos, A., and Neubig, G · 2021
Later among the works it cites.
Learning to retrieve prompts for in-context learning
Rubin, O., Herzig, J., and Berant, J · 2021
Later among the works it cites.
Capturing structural locality in non-parametric language models
Xu, F. F., He, J., Neubig, G., and Hellendoorn, V. J · 2021
Later among the works it cites.
Adaptive semiparametric language models
Yogatama, D., de Masson d’Autume, C., and Kong, L · 2021
Later among the works it cites.
GNN-LM: Language modeling based on global contexts via GNN
Meng, Y., Zong, S., Li, X., Sun, X., Zhang, T., Wu, F., and Li, J · 2022
Closest in time.