SkillNet-NLG: General-Purpose Natural Language Generation with a Sparsely Activated Approach

Multi-task deep neural networks for natural language understanding

Original

Xiaodong Liu, Pengcheng He, Weizhu Chen, and Jianfeng Gao. 2019 · 1901

Earlier work this paper cites.

Exploring the limits of transfer learning with a unified text-to-text transformer

Original

Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. 2019 · 1910

Earlier work this paper cites.

Huggingface’s transformers: State-of-the-art natural language processing

Original

Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, and Alexander M. Rush. 2020 · 1910

Earlier work this paper cites.

LCSTS: A large scale Chinese short text summarization dataset

Baotian Hu, Qingcai Chen, and Fangze Zhu. 2015 · 1972

Earlier work this paper cites.

Gshard: Scaling giant models with conditional computation and automatic sharding

Original

Dmitry Lepikhin, HyoukJoong Lee, Yuanzhong Xu, Dehao Chen, Orhan Firat, Yanping Huang, Maxim Krikun, Noam Shazeer, and Zhifeng Chen. 2020 · 2006

Earlier work this paper cites.

Enhancing topic-to-essay generation with external commonsense knowledge

Pengcheng Yang, Lei Li, Fuli Luo, Tianyu Liu, and Xu Sun. 2019 · 2012

Earlier work this paper cites.

Adam: A method for stochastic optimization

Original

Diederik P Kingma and Jimmy Ba. 2014 · 2014

Earlier work this paper cites.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Cited alongside, same era.

Topic-to-essay generation with neural networks

Xiaocheng Feng, Ming Liu, Jiahao Liu, Bing Qin, Yibo Sun, and Ting Liu. 2018 · 2018

Cited alongside, same era.

Overview of the nlpcc 2018 shared task: Grammatical error correction

Yuanyuan Zhao, Nan Jiang, Weiwei Sun, and Xiaojun Wan. 2018 · 2018

Cited alongside, same era.

BART: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension

Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, and Luke Zettlemoyer. 2020 · 2020

Cited alongside, same era.

Multilingual denoising pre-training for neural machine translation

Yinhan Liu, Jiatao Gu, Naman Goyal, Xian Li, Sergey Edunov, Marjan Ghazvininejad, Mike Lewis, and Luke Zettlemoyer. 2020 · 2020

Cited alongside, same era.

Maskgec: Improving neural grammatical error correction via dynamic masking

Zewei Zhao and Houfeng Wang. 2020 · 2020

Later among the works it cites.

KdConv: A Chinese multi-domain dialogue dataset towards multi-turn knowledge-driven conversation

Hao Zhou, Chujie Zheng, Kaili Huang, Minlie Huang, and Xiaoyan Zhu. 2020 · 2020

Later among the works it cites.

Introducing pathways: A next-generation ai architecture

Jeff Dean. 2021 · 2021

Later among the works it cites.

Lot: A benchmark for evaluating chinese long text understanding and generation

Original

Jian Guan, Zhuoer Feng, Yamei Chen, Ruilin He, Xiaoxi Mao, Changjie Fan, and Minlie Huang. 2021 · 2021

Later among the works it cites.

Cpt: A pre-trained unbalanced transformer for both chinese language understanding and generation

Original

Yunfan Shao, Zhichao Geng, Yitao Liu, Junqi Dai, Fei Yang, Li Zhe, Hujun Bao, and Xipeng Qiu. 2021 · 2021