Peer Prediction for Learning Agents

Understand

Peer prediction refers to a collection of mechanisms for eliciting information from human agents when direct verification of the obtained information is unavailable.

• They are designed to have a game-theoretic equilibrium where everyone reveals their private information truthfully.
• This result holds under the assumption that agents are Bayesian and they each adopt a fixed strategy across all tasks.
• Human agents however are observed in many domains to exhibit learning behavior in sequential settings.