AMU - AMSE
5-9 Boulevard Maurice Bourdet, CS 50498
13205 Marseille Cedex 1
Faure
Publications
This paper considers a stochastic approximation algorithm, with decreasing step size and martingale difference noise. Under very mild assumptions, we prove the nonconvergence of this process toward a certain class of repulsive sets for the associated ordinary differential equation (ODE). We then use this result to derive the convergence of the process when the ODE is cooperative in the sense of Hirsch [SIAM J. Math. Anal. 16 (1985) 423-439]. In particular, this allows us to extend significantly the main result of Hofbauer and Sandholm [Econometrica 70 (2002) 2265-2294] on the convergence of stochastic fictitious play in supermodular games.
A successful method to describe the asymptotic behavior of a discrete time stochastic process governed by some recursive formula is to relate it to the limit sets of a well-chosen mean differential equation. Under an attainability condition, Benaïm proved that convergence to a given attractor of the flow induced by this dynamical system occurs with positive probability for a class of Robbins Monro algorithms. Benaïm, Hofbauer, and Sorin generalised this approach for stochastic approximation algorithms whose average behavior is related to a differential inclusion instead. We pursue the analogy by extending to this setting the result of convergence with positive probability to an attractor.
Nous prouvons un principe de grandes déviations autonormalisé pour la moyenne empirique de fonctionnelles additives non bornées d'une chaı̂ne de Markov. L'autonormalisation s'applique à des cas pour lesquels une hypothèse de domination serait nécessaire pour avoir un principe de grandes déviations traditionnel. Nous suivons ainsi la voie ouverte par Dembo et Shao [2] dans le cas de suites indépendantes et identiquement distribuées pour l'obtention de principes de grandes déviations partiels.