Safe Exploration for Efficient Policy Evaluation and Comparison

Understand

High-quality data plays a central role in ensuring the accuracy of policy evaluation.

• This paper initiates the study of efficient and safe data collection for bandit policy evaluation.
• We formulate the problem and investigate its several representative variants.
• For each variant, we analyze its statistical properties, derive the corresponding exploration policy, and design an efficient algorithm for computing it.