A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning

Is imitation learning the route to humanoid robots?

S. Schaal · 1999

Earlier work this paper cites.

Approximately optimal approximate reinforcement learning

S. Kakade and J. Langford · 2002

Earlier work this paper cites.

Max margin markov networks

B. Taskar, C. Guestrin, and D. Koller · 2003

Earlier work this paper cites.

Apprenticeship learning via inverse reinforcement learning

P. Abbeel and A. Y. Ng · 2004

Earlier work this paper cites.

On the generalization ability of on-line learning algorithms

N. Cesa-Bianchi, A. Conconi, and C. Gentile · 2004

Earlier work this paper cites.

Error limiting reductions between classification tasks

A. Beygelzimer, V. Dani, T. Hayes, J. Langford, and B. Zadrozny · 2005

Earlier work this paper cites.

Logarithmic regret algorithms for online convex optimization

E. Hazan, A. Kalai, S. Kale, and A. Agarwal · 2006

Earlier work this paper cites.

Lower bounds for reductions, 2006

M. Kääriäinen · 2006

Cited alongside, same era.

Boosting structured prediction for imitation learning

N. Ratliff, D. Bradley, J. A. Bagnell, and J. Chestnutt · 2006

Cited alongside, same era.

(Online) subgradient methods for structured prediction

N. Ratliff, J. A. Bagnell, and M. Zinkevich · 2007

Cited alongside, same era.

Mind the duality gap: Logarithmic regret algorithms for online optimization

S. Kakade and S. Shalev-Shwartz · 2008

Cited alongside, same era.

High performance outdoor navigation from overhead data using imitation learning

D. Silver, J. A. Bagnell, and A. Stentz · 2008

Cited alongside, same era.

A survey of robot learning from demonstration

B. D. Argall, S. Chernova, M. Veloso, and B. Browning · 2009

Cited alongside, same era.

sgd code, 2009

L. Bottou · 2009

Later among the works it cites.

Interactive policy learning through confidence-based autonomy

S. Chernova and M. Veloso · 2009

Later among the works it cites.

Search-based structured prediction

H. Daumé III, J. Langford, and D. Marcu · 2009

Later among the works it cites.

On the generalization ability of online strongly convex programming algorithms

S. Kakade and A. Tewari · 2009

Later among the works it cites.

Mario AI Competition, 2009

J. Togelius and S. Karakovskiy · 2009

Later among the works it cites.

Efficient reductions for imitation learning

S. Ross and J. A. Bagnell · 2010

Closest in time.