Built on

Well-read students learn better: The impact of student initialization on knowledge distillation
Original
I. Turc, M. Chang, K. Lee, and K. Toutanova · 1908
Earlier work this paper cites.
The probabilistic relevance framework: Bm25 and beyond
S. Robertson and H. Zaragoza · 2009
Earlier work this paper cites.
Wikispeedia: An online game for inferring semantic distances between concepts
R. West, J. Pineau, and D. Precup · 2009
Earlier work this paper cites.
Distance distribution and average shortest path length estimation in real-world networks
Q. Ye, B. Wu, and B. Wang · 2010
Earlier work this paper cites.
Auto-encoding variational bayes
Original
D. P. Kingma and M. Welling · 2013
Earlier work this paper cites.
Adam: A method for stochastic optimization
Original
D. P. Kingma and J. Ba · 2014
Earlier work this paper cites.
Webnav: A new large-scale task for natural language based sequential decision making
Original
R. Nogueira and K. Cho · 2016
Earlier work this paper cites.
Reading wikipedia to answer open-domain questions
Original
D. Chen, A. Fisch, J. Weston, and A. Bordes · 2017
Earlier work this paper cites.
Go for a walk and arrive at the answer: Reasoning over paths in knowledge bases using reinforcement learning
Original
R. Das, S. Dhuliawala, M. Zaheer, L. Vilnis, I. Durugkar, A. Krishnamurthy, A. J. Smola, and A. McCallum · 2017
Earlier work this paper cites.
Attention is all you need
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin · 2017
Earlier work this paper cites.
Deeppath: A reinforcement learning method for knowledge graph reasoning
Original
W. Xiong, T. Hoang, and W. Y. Wang · 2017
Earlier work this paper cites.
Impala: Scalable distributed deep-rl with importance weighted actor-learner architectures
Original
L. Espeholt, H. Soyer, R. Munos, K. Simonyan, V. Mnih, T. Ward, Y. Doron, V. Firoiu, T. Harley, I. Dunning, S. Legg, and K. Kavukcuoglu · 2018
Earlier work this paper cites.
Multi-hop knowledge graph reasoning with reward shaping
Original
X. V. Lin, R. Socher, and C. Xiong · 2018
Earlier work this paper cites.

Similar

M-walk: Learning to walk over graphs using monte carlo tree search
Y. Shen, J. Chen, P.-S. Huang, Y. Guo, and J. Gao · 2018
Cited alongside, same era.
The web as a knowledge-base for answering complex questions
Original
A. Talmor and J. Berant · 2018
Cited alongside, same era.
FEVER: a large-scale dataset for fact extraction and VERification
J. Thorne, A. Vlachos, C. Christodoulopoulos, and A. Mittal · 2018
Cited alongside, same era.
Collaborative policy learning for open knowledge graph reasoning
Original
C. Fu, T. Chen, M. Qu, W. Jin, and X. Ren · 2019
Cited alongside, same era.
Latent retrieval for weakly supervised open domain question answering
K. Lee, M.-W. Chang, and K. Toutanova · 2019
Cited alongside, same era.

Then

Dense passage retrieval for open-domain question answering
Original
V. Karpukhin, B. Oguz, S. Min, L. Wu, S. Edunov, D. Chen, and W. Yih · 2020
Later among the works it cites.
Rocketqa: An optimized training approach to dense passage retrieval for open-domain question answering
Original
Y. Qu, Y. Ding, J. Liu, K. Liu, R. Ren, X. Zhao, D. Dong, H. Wu, and H. Wang · 2020
Later among the works it cites.
Revisiting the open-domain question answering pipeline
Original
S. J. Semnani and M. Pandey · 2020
Later among the works it cites.
Big bird: Transformers for longer sequences
M. Zaheer, G. Guruganesh, K. A. Dubey, J. Ainslie, C. Alberti, S. Ontanon, P. Pham, A. Ravula, Q. Wang, L. Yang, et al · 2020
Later among the works it cites.
Webgpt: Browser-assisted question-answering with human feedback
Original

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…

2022

Learning to Navigate Wikipedia by Taking Random Walks

Zaheer, Manzil, Marino, Kenneth, Grathwohl, Will et al.

Understand

A fundamental ability of an intelligent web-based agent is seeking out and acquiring new information.

Internet search engines reliably find the correct vicinity but the top results may be a few links away from the desired target.
A complementary approach is navigation via hyperlinks, employing a policy that comprehends local content and selects a link that moves it closer to the target.
In this paper, we show that behavioral cloning of randomly sampled trajectories is sufficient to learn an effective link selection policy.

Built on

Well-read students learn better: The impact of student initialization on knowledge distillation
Original
I. Turc, M. Chang, K. Lee, and K. Toutanova · 1908
Earlier work this paper cites.
The probabilistic relevance framework: Bm25 and beyond
S. Robertson and H. Zaragoza · 2009
Earlier work this paper cites.
Wikispeedia: An online game for inferring semantic distances between concepts
R. West, J. Pineau, and D. Precup · 2009
Earlier work this paper cites.
Distance distribution and average shortest path length estimation in real-world networks
Q. Ye, B. Wu, and B. Wang · 2010
Earlier work this paper cites.
Auto-encoding variational bayes
Original
D. P. Kingma and M. Welling · 2013
Earlier work this paper cites.
Adam: A method for stochastic optimization
Original
D. P. Kingma and J. Ba · 2014
Earlier work this paper cites.
Webnav: A new large-scale task for natural language based sequential decision making
Original
R. Nogueira and K. Cho · 2016
Earlier work this paper cites.
Reading wikipedia to answer open-domain questions
Original
D. Chen, A. Fisch, J. Weston, and A. Bordes · 2017
Earlier work this paper cites.
Go for a walk and arrive at the answer: Reasoning over paths in knowledge bases using reinforcement learning
Original
R. Das, S. Dhuliawala, M. Zaheer, L. Vilnis, I. Durugkar, A. Krishnamurthy, A. J. Smola, and A. McCallum · 2017
Earlier work this paper cites.
Attention is all you need
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin · 2017
Earlier work this paper cites.
Deeppath: A reinforcement learning method for knowledge graph reasoning
Original
W. Xiong, T. Hoang, and W. Y. Wang · 2017
Earlier work this paper cites.
Impala: Scalable distributed deep-rl with importance weighted actor-learner architectures
Original
L. Espeholt, H. Soyer, R. Munos, K. Simonyan, V. Mnih, T. Ward, Y. Doron, V. Firoiu, T. Harley, I. Dunning, S. Legg, and K. Kavukcuoglu · 2018
Earlier work this paper cites.
Multi-hop knowledge graph reasoning with reward shaping
Original
X. V. Lin, R. Socher, and C. Xiong · 2018
Earlier work this paper cites.

Similar

M-walk: Learning to walk over graphs using monte carlo tree search
Y. Shen, J. Chen, P.-S. Huang, Y. Guo, and J. Gao · 2018
Cited alongside, same era.
The web as a knowledge-base for answering complex questions
Original
A. Talmor and J. Berant · 2018
Cited alongside, same era.
FEVER: a large-scale dataset for fact extraction and VERification
J. Thorne, A. Vlachos, C. Christodoulopoulos, and A. Mittal · 2018
Cited alongside, same era.
Collaborative policy learning for open knowledge graph reasoning
Original
C. Fu, T. Chen, M. Qu, W. Jin, and X. Ren · 2019
Cited alongside, same era.
Latent retrieval for weakly supervised open domain question answering
K. Lee, M.-W. Chang, and K. Toutanova · 2019
Cited alongside, same era.

Then

Dense passage retrieval for open-domain question answering
Original
V. Karpukhin, B. Oguz, S. Min, L. Wu, S. Edunov, D. Chen, and W. Yih · 2020
Later among the works it cites.
Rocketqa: An optimized training approach to dense passage retrieval for open-domain question answering
Original
Y. Qu, Y. Ding, J. Liu, K. Liu, R. Ren, X. Zhao, D. Dong, H. Wu, and H. Wang · 2020
Later among the works it cites.
Revisiting the open-domain question answering pipeline
Original
S. J. Semnani and M. Pandey · 2020
Later among the works it cites.
Big bird: Transformers for longer sequences
M. Zaheer, G. Guruganesh, K. A. Dubey, J. Ainslie, C. Alberti, S. Ontanon, P. Pham, A. Ravula, Q. Wang, L. Yang, et al · 2020
Later among the works it cites.
Webgpt: Browser-assisted question-answering with human feedback
Original

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Roberta: A robustly optimized BERT pretraining approach

Original

Y. Liu, M. Ott, N. Goyal, J. Du, M. Joshi, D. Chen, O. Levy, M. Lewis, L. Zettlemoyer, and V. Stoyanov · 2019

Cited alongside, same era.

Distilbert, a distilled version of bert: smaller, faster, cheaper and lighter

Original

V. Sanh, L. Debut, J. Chaumond, and T. Wolf · 2019

Cited alongside, same era.

Team DOMLIN: Exploiting evidence enhancement for the FEVER shared task

D. Stammbach and G. Neumann · 2019

Cited alongside, same era.

Learning to retrieve reasoning paths over wikipedia graph for question answering

A. Asai, K. Hashimoto, H. Hajishirzi, R. Socher, and C. Xiong · 2020

Cited alongside, same era.

Learning discrete energy-based models via auxiliary-variable local exploration

H. Dai, R. Singh, B. Dai, C. Sutton, and D. Schuurmans · 2020

Cited alongside, same era.

Denoising diffusion probabilistic models

J. Ho, A. Jain, and P. Abbeel · 2020

Cited alongside, same era.

Improving efficient neural ranking models with cross-architecture knowledge distillation

Original

S. Hofstätter, S. Althammer, M. Schröder, M. Sertkan, and A. Hanbury · 2020

Cited alongside, same era.

R. Nakano, J. Hilton, S. Balaji, J. Wu, L. Ouyang, C. Kim, C. Hesse, S. Jain, V. Kosaraju, W. Saunders, X. Jiang, K. Cobbe, T. Eloundou, G. Krueger, K. Button, M. Knight, B. Chess, and J. Schulman · 2021

Later among the works it cites.

Rocketqa: An optimized training approach to dense passage retrieval for open-domain question answering

Y. Qu, Y. Ding, J. Liu, K. Liu, R. Ren, W. X. Zhao, D. Dong, H. Wu, and H. Wang · 2021

Later among the works it cites.

Evidence selection as a token-level prediction task

D. Stammbach · 2021

Later among the works it cites.

Wikigraphs: A wikipedia text - knowledge graph paired dataset

Original

L. Wang, Y. Li, Ö. Aslan, and O. Vinyals · 2021

Later among the works it cites.

Neurally-guided semantic navigation in knowledge graph