6.S890 | Fall 2024 | Graduate

Topics in Multiagent Learning

Readings

Readings will consist of a mixture of textbooks, papers, and course notes. If a reading is not specified here, please read the lecture notes associated with each class. 

Session 2: Setting and Equilibria: The Nash Equilibrium

Nash, John. “Non-cooperative games.” Annals of Mathematics 54, no. 2 (1951): 286–95.

Session 3: Setting and Equilibria: The Correlated Equilibrium

Von Stengel, Bernhard. “Zero-sum games and linear programming duality." Mathematics of Operations Research 49, no. 2 (2024): 1091–1108.

Session 4: Learning in Games: Foundations

Introduction to Blum, Avrim, and Yishay Mansour. “From external to internal regret.” (PDF) Journal of Machine Learning Research 8, no. 6 (2007). 

Session 6: Learning in Games: Algorithms (part II)

Syrgkanis, Vasilis, Alekh Agarwal, Haipeng Luo, and Robert E. Schapire. “Fast convergence of regularized learning in games.” Advances in Neural Information Processing Systems 28 (2015).

Session 7: Learning in Games: Bandit Feedback

Zimmert, Julian, and Yevgeny Seldin. “Tsallis-inf: An optimal algorithm for stochastic and adversarial bandits.” (PDF) Journal of Machine Learning Research 22, no. 28 (2021): 1–49.

Session 8: Learning in Games: Φ-Regret Minimization

Gordon, Geoffrey J., Amy Greenwald, and Casey Marks. “No-regret learning in convex games.” In Proceedings of the 25th International Conference on Machine Learning, pp. 360–367 (2008).

Blum, Avrim, and Yishay Mansour. “From external to internal regret.” (PDF) Journal of Machine Learning Research 8, no. 6 (2007). 

Session 18: Combinatorial Games and Kernelized MWU (Part I)

Farina, Gabriele, Chung-Wei Lee, Haipeng Luo, and Christian Kroer. “Kernelized multiplicative weights for 0/1-polyhedral games: Bridging the gap between learning in extensive-form and normal-form games.” (PDF) In International Conference on Machine Learning (2022): 6337–6357.

Session 20: Computation of Exact Equilibria

Papadimitriou, Christos H., and Tim Roughgarden. “Computing correlated equilibria in multi-player games.” Journal of the ACM (JACM) 55, no. 3 (2008): 1–29.

Jiang, Albert Xin, and Kevin Leyton-Brown. “Polynomial-time computation of exact correlated equilibrium in compact games.” Games and Economic Behavior 91 (2015): 347–359.

Farina, Gabriele, and Charilaos Pipis. “Polynomial-time computation of exact Φ-equilibria in polyhedral games.” Advances in Neural Information Processing Systems 37 (2024): 4207–4234.

Course Info

As Taught In
Fall 2024
Level
Learning Resource Types
Lecture Notes
Problem Set Solutions
Problem Sets
Projects
Readings