Introduction to Learning in Games
Basic Elements of Games
Robust Games in Networks
Basic Robust Games
Basics of Robust Cooperative Games
Distributed Strategic Learning
Distributed Strategic Learning in Wireless Networks
Strategy Learning
Introduction
Strategy Learning under Perfect Action Monitoring
Fully Distributed Strategy-Learning
Stochastic Approximations
Chapter Review
Discussions and Open Issues
Payoff Learning and Dynamics
Introduction
Learning Equilibrium Payoffs
Payoff Dynamics
Routing Games with Parallel Links
Numerical Values of Payoffs Are Not Observed
Introduction
Model and Notations
Pseudo-Trajectory
Hybrid and Combined Dynamics
Learning in Games with Continuous Action Spaces
CODIPAS for Stable Games with Continuous Action Spaces 183
CODIPAS-RL via Extremum-Seeking
Designer and Users in an Hierarchical System
From Fictitious Play with Inertia to CODIPAS-RL . . . . . 191
CODIPAS-RL with Random Number of Active Players
CODIPAS for Multi-Armed Bandit Problems
CODIPAS and Evolutionary Game Dynamics
Fastest Learning Algorithms
Learning under Delayed Measurement
Introduction
Learning under Delayed Imperfect Payoffs
Reacting to the Interference
Learning in Constrained Robust Games
Introduction
Constrained One-Shot Games
Quality of Experience
Relevance in QoE and QoS satisfaction
Satisfaction Levels as Benchmarks
Satisfactory Solution
Efficient Satisfactory Solution
Learning a Satisfactory Solution
From Nash Equilibrium to Satisfactory Solution
Mixed and Near-Satisfactory Solution
CODIPAS with Dynamic Satisfaction Level
Random Matrix Games
Mean-Variance Response and Demand Satisfaction
Learning under Random Updates
Introduction
Description of the Random Update Model
Fully Distributed Learning
Dynamic Routing Games with Random Traffic
Extensions
Mobility-Based Learning in Cognitive Radio Networks
Hybrid Strategic Learning
Quiz
Chapter Review
Fully Distributed Learning for Global Optima
Introduction
Resource Selection Games
Frequency Selection Games
User-Centric Network Selection
Markov Chain Adjustment
Pareto Optimal Solutions
Learning in Risk-Sensitive Games
Introduction
Risk-Sensitive in Dynamic Environment
Risk-sensitive CODIPAS
Risk-Sensitivity in Networking and Communications
Risk-Sensitive Mean Field Learning
Extensions
Chapter Review
Appendix
Basics of Dynamical Systems
Basics of Stochastic Approximations
Differential Inclusion
Markovian Noise
Biography
Hamidou Tembine
