Reframing instructional prompts to gptk’s language
Original
Swaroop Mishra, Daniel Khashabi, Chitta Baral, Yejin Choi, and Hannaneh Hajishirzi · 2021
Later among the works it cites.
Fedscale: Benchmarking model and system performance of federated learning at scale
Original
Fan Lai, Yinwei Dai, Xiangfeng Zhu, Harsha V. Madhyastha, and Mosharaf Chowdhury · 2021
Later among the works it cites.
Fednlp: A research platform for federated learning in natural language processing
Original
Bill Yuchen Lin, Chaoyang He, ZiHang Zeng, Hulin Wang, Yufen Huang, M. Soltanolkotabi, Xiang Ren, and S. Avestimehr · 2021
Later among the works it cites.
Are all users treated fairly in federated learning systems?
Umberto Michieli and Mete Ozay · 2021
Later among the works it cites.
The pile: An 800gb dataset of diverse text for language modeling, 2021
Original
Leo Gao, Stella Biderman, Sid Black, Laurence Golding, Travis Hoppe, Charles Foster, Jason Phang, Horace He, Anish Thite, Noa Nabeshima, Shawn Presser, and Connor Leahy · 2021
Later among the works it cites.
Zero-offload: Democratizing billion-scale model training
Original
Jie Ren, Samyam Rajbhandari, Reza Yazdani Aminabadi, Olatunji Ruwase, Shuangyan Yang, Minjia Zhang, Dong Li, and Yuxiong He · 2021
Later among the works it cites.
Zero-infinity: Breaking the gpu memory wall for extreme scale deep learning
Original
Samyam Rajbhandari, Olatunji Ruwase, Jeff Rasley, Shaden Smith, and Yuxiong He · 2021
Later among the works it cites.
Apple a15 bionic powers iphone 13 and ipad mini, September 2021
Andrew E. Freedman · 2021
Later among the works it cites.
Distributed deep learning in open collaborations
Original
Michael Diskin, Alexey Bukhtiyarov, Max Ryabinin, Lucile Saulnier, Anton Sinitsin, Dmitry Popov, Dmitry V Pyrkin, Maxim Kashirin, Alexander Borzunov, and et al. Albert Villanova del Moral · 2021
Later among the works it cites.
Openai api, Nov 2021
OpenAI · 2021
Later among the works it cites.
Palm: Scaling language modeling with pathways
Original
Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, et al · 2022
Closest in time.
Generated knowledge prompting for commonsense reasoning
Jiacheng Liu, Alisa Liu, Ximing Lu, Sean Welleck, Peter West, Ronan Le Bras, Yejin Choi, and Hannaneh Hajishirzi · 2022
Closest in time.
Fedbert: When federated learning meets pre-training
Yuanyishu Tian, Yao Wan, Lingjuan Lyu, Dezhong Yao, Hai Jin, and Lichao Sun · 2022
Closest in time.
Large language models can be strong differentially private learners
Xuechen Li, Florian Tramer, Percy Liang, and Tatsunori Hashimoto · 2022
Closest in time.
Multitask prompted training enables zero-shot task generalization
Original
Victor Sanh, Albert Webson, Colin Raffel, Stephan H. Bach, Lintang Sutawika, Zaid Alyafeai, Antoine Chaffin, Arnaud Stiegler, Teven Le Scao, Arun Raja, and et. al · 2022
Closest in time.
Rethinking architecture design for tackling data heterogeneity in federated learning
Original
Liangqiong Qu, Yuyin Zhou, Paul Pu Liang, Yingda Xia, Feifei Wang, Ehsan Adeli, Li Fei-Fei, and Daniel Rubin · 2022
Closest in time.
Promptsource: An integrated development environment and repository for natural language prompts, 2022
Stephen H. Bach, Victor Sanh, Zheng-Xin Yong, Albert Webson, Colin Raffel, Nihal V. Nayak, Abheesht Sharma, Taewoon Kim, M Saiful Bari, Thibault Fevry, Zaid Alyafeai, Manan Dey, Andrea Santilli, Zhiqing Sun, Srulik Ben-David, Canwen Xu, Gunjan Chhablani, Han Wang, Jason Alan Fries, Maged S. Al-shaibani, Shanya Sharma, Urmish Thakker, Khalid Almubarak, Xiangru Tang, Xiangru Tang, Mike Tian-Jian Jiang, and Alexander M. Rush · 2022
Closest in time.
URL https://blakespot.com/ios_device_specifications_grid.html
Blake’s ios device specifications grid, April 2022 · 2022
Closest in time.
Unifying language learning paradigms
Original
Yi Tay, Mostafa Dehghani, Vinh Q. Tran, Xavier Garcia, Dara Bahri, Tal Schuster, Huaixiu Steven Zheng, Neil Houlsby, and Donald Metzler · 2022
Closest in time.
Ask me anything: A simple strategy for prompting language models
Original
Simran Arora, Avanika Narayan, Mayee F. Chen, Laurel Orr, Neel Guha, Kush Bhatia, Ines Chami, Frederic Sala, and Christopher Ré · 2022
Closest in time.
URL https://www.speedtest.net/global-index/united-states
United states’ mobile and fixed broadband internet speeds, 2022 · 2022
Closest in time.
Introducing accelerated pytorch training on mac, May 2022
PyTorch · 2022
Closest in time.
Q1’22 saw a decline in gpu and pc shipments quarter-to-quarter, May 2022
Jon Peddie and Robert Dow · 2022
Closest in time.
URL https://stats.foldingathome.org/os
Os statistics., July 2022 · 2022
Closest in time.
Training language models to follow instructions with human feedback
Original
Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, and et al · 2022
Closest in time.
Opt: Open pre-trained transformer language models
Original
Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona Diab, Xian Li, Xi Victoria Lin, and et. al · 2022
Closest in time.