Fetching the paper…
Reading the bibliography…
This paper focuses on the design of time-invariant memoryless control policies for fully observed controlled Markov chains, with a finite state space.
Linear Programming in a Markov Chain
P. Wolfe and G.B. Dantzig · 1962
Earlier work this paper cites.
Markov Renewal Programming by Linear Fractional Programming
B. Fox · 1966
Earlier work this paper cites.
Linear programming and Markov decision chains
A. Hordijk and L.C.M. Kallenberg · 1979
Earlier work this paper cites.
Stochastic systems
P.R. Kumar and P. Varaiya · 1986
Earlier work this paper cites.
Dynamic programming
D.P. Bertsekas · 1987
Earlier work this paper cites.
Controlled Markov chains with constraints
V.S. Borkar · 1990
Earlier work this paper cites.
Discrete-time controlled markov processes with average cost criterion: a survey
A. Arapostathis, V.S. Borkar, E. Fernandez-Guacherand, M. Ghosh, and S.I. Marcus · 1993
Cited alongside, same era.
Markov Decision Processes: Discrete Stochastic Dynamic Programming
M.L. Puterman · 1994
Cited alongside, same era.
Discrete-time Markov control processes: Basic optimality criteria
O. Hernandez-Lerma and J.B. Lasserre · 1996
Cited alongside, same era.
Constrained Markov Decision Processes
E. Altman · 1999
Cited alongside, same era.
A probabilistic language formalism for stochastic discrete-event systems
V.K. Garg, R. Kumar, and S.I. Marcus · 1999
Cited alongside, same era.
Convex Analytic Methods in Markov Decision Processes
V.S. Borkar · 2002
Cited alongside, same era.
Controlled Markov chains with safety upper bound
A. Arapostathis, R. Kumar, and S. Tangirala · 2003
Later among the works it cites.
Information Theory and Statistics: A Tutorial
I. Csiszar and P.C. Shields · 2004
Later among the works it cites.
On non-stationary policies and maximal invariant safe sets of controlled Markov chains
W. Wu, A. Arapostathis, and R. Kumar · 2004
Later among the works it cites.
Control of Markov Chains With Safety Bounds
A. Arapostathis, R. Kumar, and S.P. Hsu · 2005
Later among the works it cites.
On controlled Markov chains with optimality requirement and safety constraint
S.P. Hsu, A. Arapostathis, and R. Kumar · 2010
Later among the works it cites.
CVX: Matlab software for disciplined convex programming, version 1.21
M. Grant and S. Boyd · 2011
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Later among the works it cites.