Multiplayer Bandit Learning, from Competition to Cooperation

Understand

The stochastic multi-armed bandit model captures the tradeoff between exploration and exploitation.

• We study the effects of competition and cooperation on this tradeoff.
• Suppose there are $k$ arms and two players, Alice and Bob.
• In every round, each player pulls an arm, receives the resulting reward, and observes the choice of the other player but not their reward.