Fetching the paper…
Reading the bibliography…
Efficiently scheduling data processing jobs on distributed compute clusters requires complex algorithms.
Critical-path planning and scheduling. In Proceedings of the Eastern Joint IRE-AIEE-ACM Computer Conference (EJCC)
James E. Kelley Jr and Morgan R. Walker. 1959 · 1959
Earlier work this paper cites.
Dynamic programming
Richard Bellman. 1966 · 1966
Earlier work this paper cites.
Monte Carlo sampling methods using Markov chains and their applications
W Keith Hastings. 1970 · 1970
Earlier work this paper cites.
Universal packet routing algorithms. In Proceedings of the 29 th annual Symposium on Foundations of Computer Science (FOCS)
Tom Leighton, Bruce Maggs, and Satish Rao. 1988 · 1988
Earlier work this paper cites.
Simple statistical gradient-following algorithms for connectionist reinforcement learning
Ronald J Williams. 1992 · 1992
Earlier work this paper cites.
A no-wait flowshop scheduling heuristic to minimize makespan
Chandrasekharan Rajendran. 1994 · 1994
Earlier work this paper cites.
Improved approximation algorithms for shop scheduling problems
David B Shmoys, Clifford Stein, and Joel Wein. 1994 · 1994
Earlier work this paper cites.
Neuro-dynamic programming: an overview. In Decision and Control, 1995., Proceedings of the 34th IEEE Conference on
Dimitri P Bertsekas and John N Tsitsiklis. 1995 · 1995
Earlier work this paper cites.
Neural network design
Martin T Hagan, Howard B Demuth, Mark H Beale, and Orlando De Jesús. 1996 · 1996
Earlier work this paper cites.
Scheduling multithreaded computations by work stealing
Robert D Blumofe and Charles E Leiserson. 1999 · 1999
Earlier work this paper cites.
The optimal reward baseline for gradient-based reinforcement learning. In Proceedings of the 17 th Conference on Uncertainty in Artificial Intelligence (UAI)
Lex Weaver and Nigel Tao. 2001 · 2001
Earlier work this paper cites.
Multi-processor scheduling to minimize flow time with ε \varepsilon resource augmentation. In Proceedings of the 36 th Annual ACM Symposium on Theory of Computing
Chandra Chekuri, Ashish Goel, Sanjeev Khanna, and Amit Kumar. 2004 · 2004
Earlier work this paper cites.
Variance reduction techniques for gradient estimates in reinforcement learning
Evan Greensmith, Peter L Bartlett, and Jonathan Baxter. 2004 · 2004
Earlier work this paper cites.
Basis function adaptation in temporal difference reinforcement learning
Ishai Menache, Shie Mannor, and Nahum Shimkin. 2005 · 2005
Earlier work this paper cites.
Pattern Recognition and Machine Learning
Christopher M. Bishop. 2006 · 2006
Earlier work this paper cites.
Reinforcement learning for MDPs with constraints. In Proceedings of the 17 th European Conference on Machine Learning (ECML)
Peter Geibel. 2006 · 2006
Earlier work this paper cites.
Dryad: Distributed Data-parallel Programs from Sequential Building Blocks. In Proceedings of the 2 nd ACM SIGOPS/EuroSys European Conference on Computer Systems (EuroSys)
Michael Isard, Mihai Budiu, Yuan Yu, Andrew Birrell, and Dennis Fetterly. 2007 · 2007
Earlier work this paper cites.
Building intuition: insights from basic operations management models and principles
Dilip Chhajed and Timothy J Lowe. 2008 · 2008
Earlier work this paper cites.
(Acyclic) job shops are hard to approximate. In Proceedings of the 49 th IEEE Symposium on Foundations of Computer Science (FOCS)
Monaldo Mastrolilli and Ola Svensson. 2008 · 2008
Earlier work this paper cites.
Curriculum learning. In Proceedings of the 26 th annual International Conference on Machine Learning (ICML)
Yoshua Bengio, Jérôme Louradour, Ronan Collobert, and Jason Weston. 2009 · 2009
Earlier work this paper cites.
Quincy: fair scheduling for distributed computing clusters. In Proceedings of the 22 nd ACM Symposium on Operating Systems Principles (SOSP)
Michael Isard, Vijayan Prabhakaran, Jon Currey, Udi Wieder, Kunal Talwar, and Andrew Goldberg. 2009 · 2009
Earlier work this paper cites.
FlumeJava: Easy, Efficient Data-parallel Pipelines. In Proceedings of the 2010 ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI)
Craig Chambers, Ashish Raniwala, Frances Perry, Stephen Adams, Robert R. Henry, Robert Bradshaw, and Nathan Weizenbaum. 2010 · 2010
Earlier work this paper cites.
Dominant Resource Fairness: Fair Allocation of Multiple Resource Types. In Proceedings of the 8 th USENIX Symposium on Networked Systems Design and Implementation (NSDI)
Ali Ghodsi, Matei Zaharia, Benjamin Hindman, Andy Konwinski, Scott Shenker, and Ion Stoica. 2011 · 2011
Earlier work this paper cites.
Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center. In Proceedings of the 8 th USENIX Conference on Networked Systems Design and Implementation (NSDI)
Benjamin Hindman, Andy Konwinski, Matei Zaharia, Ali Ghodsi, Anthony D Joseph, Randy H Katz, Scott Shenker, and Ion Stoica. 2011 · 2011
Earlier work this paper cites.
JIT compilation policy for modern machines. In ACM SIGPLAN Notices
Prasad A. Kulkarni. 2011 · 2011
Earlier work this paper cites.
Re-optimizing Data-parallel Computing. In Proceedings of the 9 th USENIX Conference on Networked Systems Design and Implementation (NSDI)
Sameer Agarwal, Srikanth Kandula, Nicolas Bruno, Ming-Chuan Wu, Ion Stoica, and Jingren Zhou. 2012 · 2012
Earlier work this paper cites.
Jockey: guaranteed job latency in data parallel clusters. In Proceedings of the 7 th ACM European Conference on Computer Systems (EuroSys)
Andrew D Ferguson, Peter Bodik, Srikanth Kandula, Eric Boutin, and Rodrigo Fonseca. 2012 · 2012
Cited alongside, same era.
Resilient Distributed Datasets: A Fault-tolerant Abstraction for In-memory Cluster Computing. In Proceedings of the 9 th USENIX Conference on Networked Systems Design and Implementation (NSDI)
Matei Zaharia, Mosharaf Chowdhury, Tathagata Das, Ankur Dave, Justin Ma, Murphy McCauley, Michael J. Franklin, Scott Shenker, and Ion Stoica. 2012 · 2012
Cited alongside, same era.
Apache Tez Project
Apache Tez 2013 · 2013
Cited alongside, same era.
The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines, second edition
Luiz André Barroso, Jimmy Clidaras, and Urs Hölzle. 2013 · 2013
Cited alongside, same era.
Hierarchical Scheduling for Diverse Datacenter Workloads. In Proceedings of the 4 th Annual Symposium on Cloud Computing (SoCC)
Efficient Queue Management for Cluster Scheduling. In Proceedings of the 11 th European Conference on Computer Systems (EuroSys)
Jeff Rasley, Konstantinos Karanasos, Srikanth Kandula, Rodrigo Fonseca, Milan Vojnovic, and Sriram Rao. 2016 · 2016
Later among the works it cites.
Mastering the game of Go with deep neural networks and tree search
David Silver, Aja Huang, Christopher J. Maddison, Arthur Guez, Laurent Sifre, George van den Driessche, Julian Schrittwieser, Ioannis Antonoglou, Veda Panneershelvam, Marc Lanctot, Sander Dieleman, Dominik Grewe, John Nham, Nal Kalchbrenner, Ilya Sutskever, Timothy Lillicrap, Madeleine Leach, Koray Kavukcuoglu, Thore Graepel, and Demis Hassabis. 2016 · 2016
Later among the works it cites.
TetriSched: Global Rescheduling with Adaptive Plan-ahead in Dynamic Heterogeneous Clusters. In Proceedings of the 11 th European Conference on Computer Systems (EuroSys)
Alexey Tumanov, Timothy Zhu, Jun Woo Park, Michael A. Kozuch, Mor Harchol-Balter, and Gregory R. Ganger. 2016 · 2016
Later among the works it cites.
Constrained policy optimization. In Proceedings of the 34 th International Conference on Machine Learning-Volume 70
Joshua Achiam, David Held, Aviv Tamar, and Pieter Abbeel. 2017 · 2017
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Arka A. Bhattacharya, David Culler, Eric Friedman, Ali Ghodsi, Scott Shenker, and Ion Stoica. 2013 · 2013
Cited alongside, same era.
Paragon: QoS-aware Scheduling for Heterogeneous Datacenters. In Proceedings of the 18 th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS)
Christina Delimitrou and Christos Kozyrakis. 2013 · 2013
Cited alongside, same era.
Choosy: max-min fair sharing for datacenter jobs with constraints. In Proceedings of the 8 th ACM European Conference on Computer Systems (EuroSys)
Ali Ghodsi, Matei Zaharia, Scott Shenker, and Ion Stoica. 2013 · 2013
Cited alongside, same era.
Omega: flexible, scalable schedulers for large compute clusters. In Proceedings of the 8 th ACM European Conference on Computer Systems (EuroSys)
Malte Schwarzkopf, Andy Konwinski, Michael Abd-El-Malek, and John Wilkes. 2013 · 2013
Cited alongside, same era.
Apache Hadoop YARN: Yet Another Resource Negotiator. In Proceedings of the 4 th annual Symposium on Cloud Computing (SoCC)
Vinod Kumar Vavilapalli, Arun C. Murthy, Chris Douglas, Sharad Agarwal, Mahadev Konar, Robert Evans, Thomas Graves, Jason Lowe, Hitesh Shah, Siddharth Seth, Bikas Saha, Carlo Curino, Owen O’Malley, Sanjay Radia, Benjamin Reed, and Eric Baldeschwieler. 2013 · 2013
Cited alongside, same era.
Hadoop Fair Scheduler
Apache Hadoop. 2014 · 2014
Cited alongside, same era.
Quasar: Resource-efficient and QoS-aware Cluster Management. In Proceedings of the 19 th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS)
Christina Delimitrou and Christos Kozyrakis. 2014 · 2014
Cited alongside, same era.
Multi-resource Packing for Cluster Schedulers. In Proceedings of the 2014 ACM SIGCOMM Conference (SIGCOMM)
Robert Grandl, Ganesh Ananthanarayanan, Srikanth Kandula, Sriram Rao, and Aditya Akella. 2014 · 2014
Cited alongside, same era.
Cluster data collected from production clusters in Alibaba for cluster management research
Alibaba. 2017 · 2017
Later among the works it cites.
Learning Combinatorial Optimization Algorithms over Graphs. In Proceedings of the 31 st Conference on Neural Information Processing Systems (NeurIPS)
Hanjun Dai, Elias B. Khalil, Yuyu Zhang, Bistra Dilkina, and Le Song. 2017 · 2017
Later among the works it cites.
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks. In Proceedings of the 34 th International Conference on Machine Learning (ICML)
Chelsea Finn, Pieter Abbeel, and Sergey Levine. 2017 · 2017
Later among the works it cites.
Cooperative multi-agent control using deep reinforcement learning. In Proceedings of the 2017 International Conference on Autonomous Agents and Multiagent Systems (AAMAS)
Jayesh K Gupta, Maxim Egorov, and Mykel Kochenderfer. 2017 · 2017
Later among the works it cites.
Imbalance in the cloud: An analysis on alibaba cluster trace. In Proceedings of the 2017 IEEE International Conference on Big Data (BigData)
Chengzhi Lu, Kejiang Ye, Guoyao Xu, Cheng-Zhong Xu, and Tongxin Bai. 2017 · 2017
Later among the works it cites.
Device Placement Optimization with Reinforcement Learning. In Proceedings of the 33 rd International Conference on Machine Learning (ICML)
Azalia Mirhoseini, Hieu Pham, Quoc V Le, Benoit Steiner, Rasmus Larsen, Yuefeng Zhou, Naveen Kumar, Mohammad Norouzi, Samy Bengio, and Jeff Dean. 2017 · 2017
Later among the works it cites.
Robust Adversarial Reinforcement Learning. In Proceedings of the 34 th International Conference on Machine Learning (ICML)
Lerrel Pinto, James Davidson, Rahul Sukthankar, and Abhinav Gupta. 2017 · 2017
Later among the works it cites.
Mastering the game of Go without human knowledge
David Silver, Julian Schrittwieser, Karen Simonyan, Ioannis Antonoglou, Aja Huang, Arthur Guez, Thomas Hubert, Lucas Baker, Matthew Lai, Adrian Bolton, Yutian Chen, Timothy Lillicrap, Fan Hui, Laurent Sifre, George van den Driessche, Thore Graepel, and Demis Hassabis. 2017 · 2017
Later among the works it cites.
Reinforcement Learning: An Introduction, Second Edition
Richard. S. Sutton and Andrew. G. Barto. 2017 · 2017
Later among the works it cites.
Placeto: Efficient Progressive Device Placement Optimization. In Proceedings of the 1 st Machine Learning for Systems Workshop
Ravichandra Addanki, Shaileshh Bojja Venkatakrishnan, Shreyan Gupta, Hongzi Mao, and Mohammad Alizadeh. 2018 · 2018
Closest in time.
AI and Compute
Dario Amodei and Danny Hernandez. 2018 · 2018
Closest in time.
Spark: Dynamic Resource Allocation
Apache Spark. 2018 · 2018
Closest in time.
Relational inductive biases, deep learning, and graph networks
Peter W. Battaglia, Jessica B. Hamrick, Victor Bapst, Alvaro Sanchez-Gonzalez, Vinícius Flores Zambaldi, Mateusz Malinowski, Andrea Tacchetti, David Raposo, Adam Santoro, Ryan Faulkner, Çaglar Gülçehre, Francis Song, Andrew J. Ballard, Justin Gilmer, George E. Dahl, Ashish Vaswani, Kelsey Allen, Charles Nash, Victoria Langston, Chris Dyer, Nicolas Heess, Daan Wierstra, Pushmeet Kohli, Matthew Botvinick, Oriol Vinyals, Yujia Li, and Razvan Pascanu. 2018 · 2018
Closest in time.
Model-based reinforcement learning via meta-policy optimization
Ignasi Clavera, Jonas Rothfuss, John Schulman, Yasuhiro Fujita, Tamim Asfour, and Pieter Abbeel. 2018 · 2018
Closest in time.
Combinatorial optimization with graph convolutional networks and guided tree search. In Proceedings of the 32 nd Conference on Neural Information Processing Systems (NeurIPS)
Zhuwen Li, Qifeng Chen, and Vladlen Koltun. 2018 · 2018
Closest in time.
Scaling Multi-Agent Reinforcement Learning
Eric Liang and Richard Liaw. 2018 · 2018
Closest in time.
A Hierarchical Model for Device Placement. In Proceedings of the 6 th International Conference on Learning Representations (ICLR)
Azalia Mirhoseini, Anna Goldie, Hieu Pham, Benoit Steiner, Quoc V Le, and Jeff Dean. 2018 · 2018
Closest in time.
Thanh Thi Nguyen, Ngoc Duy Nguyen, and Saeid Nahavandi. 2018 · 2018
Closest in time.
The TPC-H Benchmarks
TPC-H 2018 · 2018
Closest in time.
Real-world Video Adaptation with Reinforcement Learning. In Proceedings of the 2019 Reinforcement Learning for Real Life Workshop
Hongzi Mao, Shannon Chen, Drew Dimmery, Shaun Singh, Drew Blaisdell, Yuandong Tian, Mohammad Alizadeh, and Eytan Bakshy. 2019a · 2019
Closest in time.
Variance Reduction for Reinforcement Learning in Input-Driven Environments
Hongzi Mao, Shaileshh Bojja Venkatakrishnan, Malte Schwarzkopf, and Mohammad Alizadeh. 2019b · 2019
Closest in time.
Neo: A Learned Query Optimizer
Ryan Marcus, Parimarjan Negi, Hongzi Mao, Chi Zhang, Mohammad Alizadeh, Tim Kraska, Olga Papaemmanouil, and Nesime Tatbul. 2019 · 2019
Closest in time.