2018

Seq2Slate: Re-ranking and Slate Optimization with RNNs

Bello, Irwan, Kulkarni, Sayali, Jain, Sagar et al.

Understand

Ranking is a central task in machine learning and information retrieval.

In this task, it is especially important to present the user with a slate of items that is appealing as a whole.
This in turn requires taking into account interactions between items, since intuitively, placing an item on the slate affects the decision of which other items should be placed alongside it.
In this work, we propose a sequence-to-sequence model for ranking called seq2slate.

Built on

A learning algorithm for continually running fully recurrent neural networks
Ronald J. Williams and David Zipser · 1989
Earlier work this paper cites.
Simple statistical gradient following algorithms for connectionnist reinforcement learning
Ronald Williams · 1992
Earlier work this paper cites.
Long short-term memory
Sepp Hochreiter and Jurgen Schmidhuber · 1997
Earlier work this paper cites.
Bidirectional recurrent neural networks
M. Schuster and K.K. Paliwal · 1997
Earlier work this paper cites.
Support vector learning for ordinal regression
Ralf Herbrich, Thore Graepel, and Klaus Obermayer · 1999
Earlier work this paper cites.
Random forests
Leo Breiman · 2001
Earlier work this paper cites.
Greedy function approximation: a gradient boosting machine
Jerome H Friedman · 2001
Earlier work this paper cites.
Optimizing search engines using clickthrough data
Thorsten Joachims · 2002
Earlier work this paper cites.
An efficient boosting algorithm for combining preferences
Yoav Freund, Raj Iyer, Robert E Schapire, and Yoram Singer · 2003
Earlier work this paper cites.
Learning to rank using gradient descent
Chris Burges, Tal Shaked, Erin Renshaw, Ari Lazier, Matt Deeds, Nicole Hamilton, and Greg Hullender · 2005
Earlier work this paper cites.
Learning to rank: from pairwise approach to listwise approach
Zhe Cao, Tao Qin, Tie-Yan Liu, Ming-Feng Tsai, and Hang Li · 2007
Earlier work this paper cites.
Linear feature-based models for information retrieval
Donald Metzler and W Bruce Croft · 2007
Earlier work this paper cites.
Adarank: a boosting algorithm for information retrieval
Jun Xu and Hang Li · 2007
Earlier work this paper cites.
A support vector method for optimizing average precision
Yisong Yue, Thomas Finley, Filip Radlinski, and Thorsten Joachims · 2007
Earlier work this paper cites.
Learning to rank relational objects and its application to web search
Tao Qin, Tie-Yan Liu, Xu-Dong Zhang, De-Sheng Wang, Wen-Ying Xiong, and Hang Li · 2008
Earlier work this paper cites.
Learning to rank for information retrieval
Tie-Yan Liu et al · 2009
Earlier work this paper cites.
Global ranking using continuous conditional random fields
Tao Qin, Tie-Yan Liu, Xu-Dong Zhang, De-Sheng Wang, and Hang Li · 2009
Earlier work this paper cites.
Adapting boosting for information retrieval measures
Qiang Wu, Christopher JC Burges, Krysta M Svore, and Jianfeng Gao · 2010
Earlier work this paper cites.

Similar

Ranking via sinkhorn propagation
Original
Ryan Prescott Adams and Richard S Zemel · 2011
Cited alongside, same era.
Learning deep structured semantic models for web search using clickthrough data
Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, and Larry Heck · 2013
Cited alongside, same era.
Learning to rank using high-order information
Puneet Kumar Dokania, Aseem Behl, CV Jawahar, and M Pawan Kumar · 2014
Cited alongside, same era.
Adam: A method for stochastic optimization
Diederik Kingma and Jimmy Ba · 2014
Cited alongside, same era.
Learning structured models with the auc loss and its generalizations
Nir Rosenfeld, Ofer Meshi, Danny Tarlow, and Amir Globerson · 2014
Cited alongside, same era.
Sequence to sequence learning with neural networks
Ilya Sutskever, Oriol Vinyals, and Quoc V Le · 2014
Cited alongside, same era.
Learning for search result diversification
Yadong Zhu, Yanyan Lan, Jiafeng Guo, Xueqi Cheng, and Shuzi Niu · 2014
Cited alongside, same era.
Neural machine translation by jointly learning to align and translate
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio · 2015
Cited alongside, same era.
Scheduled sampling for sequence prediction with recurrent neural networks
Samy Bengio, Oriol Vinyals, Navdeep Jaitly, and Noam Shazeer · 2015
Cited alongside, same era.
Gradient Estimation Using Stochastic Computation Graphs
John Schulman, Nicolas Heess, Theophane Weber, and Pieter Abbeel · 2015
Cited alongside, same era.
Professor forcing: A new algorithm for training recurrent networks
Anirudh Goyal, Alex Lamb, Ying Zhang, Saizheng Zhang, Aaron C. Courville, and Yoshua Bengio · 2016
Cited alongside, same era.
A deep relevance matching model for ad-hoc retrieval
Jiafeng Guo, Yixing Fan, Qingyao Ai, and W. Bruce Croft · 2016
Cited alongside, same era.

Then

An actor-critic algorithm for sequence prediction
Dzmitry Bahdanau, Philemon Brakel, Kelvin Xu, Anirudh Goyal, Ryan Lowe, Joelle Pineau, Aaron Courville, and Yoshua Bengio · 2017
Later among the works it cites.
Neural combinatorial optimization with reinforcement learning
Irwan Bello, Hieu Pham, Quoc V. Le, Mohammad Norouzi, and Samy Bengio · 2017
Later among the works it cites.
Max-sum diversification, monotone submodular functions, and dynamic updates
Allan Borodin, Aadhar Jain, Hyun Chul Lee, and Yuli Ye · 2017
Later among the works it cites.
Unbiased learning-to-rank with biased feedback
Thorsten Joachims, Adith Swaminathan, and Tobias Schnabel · 2017
Later among the works it cites.
Neural models for information retrieval
Original
Bhaskar Mitra and Nick Craswell · 2017
Later among the works it cites.
Deep choice model using pointer networks for airline itinerary prediction
Alejandro Mottini and Rodrigo Acuna-Agost · 2017
Later among the works it cites.
Maximizing subset accuracy with recurrent neural networks in multi-label classification
Jinseok Nam, Eneldo Loza Mencía, Hyunwoo J Kim, and Johannes Fürnkranz · 2017
Later among the works it cites.
Deeprank: A new deep architecture for relevance ranking in information retrieval
Liang Pang, Yanyan Lan, Jiafeng Guo, Jun Xu, Jingfang Xu, and Xueqi Cheng · 2017
Later among the works it cites.
Visual permutation learning
Rodrigo Santa Cruz, Basura Fernando, Anoop Cherian, and Stephen Gould · 2017
Later among the works it cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin · 2017
Later among the works it cites.
An attention-based deep net for learning to rank
Original
Baiyang Wang and Diego Klabjan · 2017
Later among the works it cites.
Seq2sql: Generating structured queries from natural language using reinforcement learning
Original
Victor Zhong, Caiming Xiong, and Richard Socher · 2017
Later among the works it cites.
Learning permutations with sinkhorn policy gradient
Patrick Emami and Sanjay Ranka · 2018
Closest in time.
Deep learning with logged bandit feedback
T. Joachims, A. Swaminathan, and M. de Rijke · 2018
Closest in time.
Reparameterizing the birkhoff polytope for variational permutation inference
Scott Linderman, Gonzalo Mena, Hal Cooper, Liam Paninski, and John Cunningham · 2018
Closest in time.
Learning latent permutations with gumbel-sinkhorn networks
Gonzalo Mena, David Belanger, Scott Linderman, and Jasper Snoek · 2018
Closest in time.
Top-k off-policy correction for a reinforce recommender system
Minmin Chen, Alex Beutel, Paul Covington, Sagar Jain, Francois Belletti, and Ed Chi · 2019
Closest in time.
Universal transformers
Mostafa Dehghani, Stephan Gouws, Oriol Vinyals, Jakob Uszkoreit, and Lukasz Kaiser · 2019
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…