2015

Improved Deep Learning Baselines for Ubuntu Corpus Dialogs

Kadlec, Rudolf, Schmid, Martin, Kleindienst, Jan

Understand

This paper presents results of our experiments for the next utterance ranking on the Ubuntu Dialog Corpus -- the largest publicly available multi-turn dialog corpus.

First, we use an in-house implementation of previously reported models to do an independent evaluation using the same data.
Second, we evaluate the performances of various LSTMs, Bi-LSTMs and CNNs on the dataset.
Third, we create an ensemble by averaging predictions of multiple models.

Built on

S. Hochreiter and J. Schmidhuber, “Long Short-Term Memory,” Neural Computation
1997
Earlier work this paper cites.
M. Schuster and K. K. Paliwal, “Bidirectional recurrent neural networks,” IEEE Transactions on Signal Processing
1997
Earlier work this paper cites.
Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, “Gradient-based learning applied to document recognition,” Proceedings of the IEEE
1998
Earlier work this paper cites.
F. Gers, N. Schraudolph, and J. Schmidhuber, “Learning Precise Timing with LSTM Recurrent Networks,” Journal of Machine Learning Research
2002
Earlier work this paper cites.
T.-Y. Liu, “Learning to rank for information retrieval,” Foundations and Trends in Information Retrieval
2009
Earlier work this paper cites.
F. Bastien, P. Lamblin, R. Pascanu, J. Bergstra, I. J. Goodfellow, A. Bergeron, N. Bouchard, and Y. Bengio, “Theano: new features and speed improvements.” Deep Learning and Unsupervised Feature Learning NIPS 2012 Workshop, 2012
2012
Earlier work this paper cites.
S. R. K. Branavan, D. Silver, and R. Barzilay, “Learning to win by reading manuals in a monte-carlo framework,” Journal of Artificial Intelligence Research
2012
Earlier work this paper cites.

Similar

Y. Kim, “Convolutional neural networks for sentence classification,” arXiv preprint arXiv:1408.5882
Original
2014
Cited alongside, same era.
J. Pennington, R. Socher, and C. D. Manning, “GloVe: Global Vectors for Word Representation,” Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing
2014
Cited alongside, same era.
I. Sutskever, O. Vinyals, and Q. V. Le, “Sequence to Sequence Learning with Neural Networks,” NIPS
2014
Cited alongside, same era.
A. Graves, G. Wayne, and I. Danihelka, “Neural Turing Machines,” pp. 1–26, Oct. 2014
2014
Cited alongside, same era.
R. Lowe, N. Pow, I. Serban, and J. Pineau, “The ubuntu dialogue corpus: A large dataset for research in unstructured multi-turn dialogue systems,” arXiv preprint arXiv:1506.08909
Original
2015
Cited alongside, same era.
O. Vinyals and Q. Le, “A neural conversational model,” arXiv preprint arXiv:1506.05869
Original
2015
Cited alongside, same era.

Then

B. van Merrienboer, D. Bahdanau, V. Dumoulin, D. Serdyuk, D. Warde-farley, J. Chorowski, and Y. Bengio, “Blocks and Fuel : Frameworks for deep learning,” pp. 1–5, 2015
2015
Closest in time.
D. P. Kingma and J. L. Ba, “Adam: a Method for Stochastic Optimization,” International Conference on Learning Representations
2015
Closest in time.
G. Mesnil, T. Mikolov, M. Ranzato, and Y. Bengio, “Ensemble of Generative and Discriminative Techniques for Sentiment Analysis of Movie Reviews,” 2015
2015
Closest in time.
S. Sukhbaatar, A. Szlam, J. Weston, and R. Fergus, “End-To-End Memory Networks,” pp. 1–11, 2015
2015
Closest in time.
A. Joulin and T. Mikolov, “Inferring Algorithmic Patterns with Stack-Augmented Recurrent Nets,” 2015
2015
Closest in time.
D. Bahdanau, K. Cho, and Y. Bengio, “Neural Machine Translation by Jointly Learning to Align and Translate,” ICLR
2015
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…