Fetching the paper…
Reading the bibliography…
We propose and study Collpasing Bandits, a new restless multi-armed bandit (RMAB) setting in which each arm follows a binary-state Markovian process with a special structure: when an arm is played, the state is fully observed, thus "collapsing" any uncertainty, but when an arm is passive, no observation is made, thus allowing uncertainty to evolve.
The optimal control of partially observable Markov processes over the infinite horizon: Discounted costs
E.J. Sondik · 1978
Earlier work this paper cites.
Restless bandits: Activity allocation in a changing world
P. Whittle · 1988
Earlier work this paper cites.
On an index policy for restless bandits
R. R. Weber and G. Weiss · 1990
Earlier work this paper cites.
What do discounted optima converge to?: A theory of discount rate asymptotics in economic models
P.K. Dutta · 1991
Earlier work this paper cites.
Planning and acting in partially observable stochastic domains
L. P. Kaelbling, M. L. Littman, and A. R. Cassandra · 1998
Earlier work this paper cites.
The complexity of optimal queuing network control
C. H. Papadimitriou and J. N. Tsitsiklis · 1999
Earlier work this paper cites.
Whittle’s index policy for a multi-class queueing system with convex holding costs
P.S. Ansell, K.D. Glazebrook, J. Nino-Mora, and M. O’Keeffe · 2003
Earlier work this paper cites.
Monitoring depression treatment outcomes with the patient health questionnaire-9
B. Löwe, J. Unützer, C.M. Callahan, A.J. Perkins, and K. Kroenke · 2004
Earlier work this paper cites.
Some indexable families of restless bandit problems
K. D. Glazebrook, D. Ruiz-Hernandez, and C. Kirkbride · 2006
Earlier work this paper cites.
Effectiveness of community health workers in the care of people with hypertension
J.N. Brownstein, F.M. Chowdhury, S.L. Norris, T. Horsley, L. Jack Jr, X. Zhang, and D. Satterfield · 2007
Earlier work this paper cites.
Indexability of restless bandit problems and optimality of Whittle index for dynamic multichannel access
K. Liu and Q. Zhao · 2010
Cited alongside, same era.
Can community health workers improve adherence to highly active antiretroviral therapy in the USA? A review of the literature
S. Kenya, N. Chida, S. Symes, and G. Shor-Posner · 2011
Cited alongside, same era.
Optimality of myopic scheduling and Whittle indexability for energy harvesting sensors
F. Iannello, O. Simeone, and U. Spagnolini · 2012
Cited alongside, same era.
House calls by community health workers and public health nurses to improve adherence to isoniazid monotherapy for latent tuberculosis infection: a retrospective study
A.H. Chang, A. Polesky, and G. Bhatia · 2013
Cited alongside, same era.
Using community health workers to improve clinical outcomes among people living with HIV: a randomized controlled trial
S. Kenya, J. Jones, K. Arheart, E. Kobetz, N. Chida, S. Baer, A. Powell, S. Symes, T. Hunte, A. Monroe, et al · 2013
Age of information: Whittle index for scheduling stochastic arrivals
Y. Hsu · 2018
Later among the works it cites.
Selective sensing of a heterogeneous population of units with dynamic health conditions
Y. Lin, S. Liu, and S. Huang · 2018
Later among the works it cites.
On the whittle index for restless multiarmed hidden Markov bandits
R. Meshram, D. Manjunath, and A. Gopalan · 2018
Later among the works it cites.
Reducing the risk of postpartum depression in a low-income community through a community health worker intervention
C. Mundorf, A. Shankar, T. Moran, S. Heller, A. Hassan, E. Harville, and M. Lichtveld · 2018
Later among the works it cites.
Community health workers improve disease control and medication adherence among patients with diabetes and/or hypertension in Chiapas, Mexico: an observational stepped-wedge study
P.M. Newman, M.F. Franke, J. Arrieta, H. Carrasco, P. Elliott, H. Flores, A. Friedman, S. Graham, L. Martinez, L. Palazuelos, et al · 2018
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Markov Decision Processes: Discrete Stochastic Dynamic Programming
M. L. Puterman · 2014
Cited alongside, same era.
The effects on tuberculosis treatment adherence from utilising community health workers: a comparison of selected rural and urban settings in Kenya
J. Rahedi Ong’ang’o, C. Mwachari, H. Kipruto, and S. Karanja · 2014
Cited alongside, same era.
Restless poachers: Handling exploration-exploitation tradeoffs in security domains
Y. Qian, C. Zhang, B. Krishnamachari, and M. Tambe · 2016
Cited alongside, same era.
Indexability and optimal index policies for a class of reinitialising restless bandits
S.S. Villar · 2016
Cited alongside, same era.
Group maintenance: A restless bandits approach
A. Abbou and V. Makis · 2019
Later among the works it cites.
Restless bandits with controlled restarts: Indexability and computation of Whittle index
N. Akbarzadeh and A. Mahajan · 2019
Later among the works it cites.
Learning to prescribe interventions for tuberculosis patients using digital adherence data
J. A. Killian, B. Wilder, A. Sharma, V. Choudhary, B. Dilkina, and M. Tambe · 2019
Later among the works it cites.
Whittle index for AoI-aware scheduling
B. Sombabu, A. Mate, D. Manjunath, and S. Moharir · 2020
Closest in time.