Depuis Ruelle, puis Rugh, Baladi, Tsujii, Liverani et d'autres, on sait que la fuite vers l'équilibre statistique dans de nombreux systèmes dynamiques chaotiques est gouvernée par le spectre de résonances de Ruelle de l'opérateur de transfert. A la suite de récents travaux de Faure, Sjöstrand et Roy, cette thèse propose une approche semiclassique de systèmes dynamiques chaotiques de type partiellement expansifs. Une partie du mémoire est consacrée aux extensions d'applications expansives vers des groupes de Lie compacts, en se reistreignant essentiellement aux extensions vers le groupe spécial unitaire SU(2). On se sert de la théorie des états cohérents pour les groupes de Lie, développée dans les années 70 par Perelomov et Gilmore, pour mettre en oeuvre les outils semiclassiques et la théorie des résonances de Helfer et Sjöstrand. On en déduira une estimation de Weyl et un gap spectral pour les résonances de Ruelle prouvant que la fuite vers l'équilibre statistique dans ces modèles est gouvernée par un opérateur de rang fini (en accord avec les résultats obtenus par Tsujii pour les semi-flots partiellement expansifs). On étend ensuite cette approche aux modèles "ouverts" pour lesquels la dynamique présente un ensemble captif de Cantor. On montrera l'existence d'un spectre discret de résonances de Ruelle et on prouve une loi de Weyl fractale, analogue classique du théorème de Lin-Guillopé-Zworski pour les résonances du laplacien hyperbolique sur les surfaces à courbure négative constante. On montre aussi un gap spectral asymptotique. On expliquera pourquoi ces modèles semblent être des objets d'étude adaptés pour approcher des questions importantes et difficiles du chaos classique ou quantique. On pense en particulier au problème de la minoration du nombre de résonances, étudié dans le contexte des applications quantiques par Nonnenmacher et Zworski. / Since the work of Ruelle, then Rugh, Baladi, Tsujii, Liverani and others, it is kown that the convergence towards statistical equilibrium in many chaotic dynamical systems is gouverned by the Ruelle spectrum of resonances of the so-called transfer operator. Following recent works from Faure, Sjöstrand and Roy, this thesis gives a semiclassical approach for partially expanding chaotic dynamical systems. The first part of the thesis is devoted to compact Lie groups extenstions of expanding maps, essentially restricting to SU(2) extensions. Using Perlomov's coherent state theory for Lie groups, we apply the semiclassical theory of resonances of Helfer and Sjöstrand. We deduce Weyl type estimations and a spectral gap for the Ruelle resonances, showing that the convergence towards equilibrium is controled by a finite rank operator (as Tsujii already showed for partially expanding semi-flows). We then extend this approach to "open" models, for which the dynamics exhibits a fractal invariant reppeler. We show the existence of a discrete spectrum of resonances and we prove a fractal Weyl law, the classical analogue of Lin-Guillopé-Zworski's theorem on resonances of non-compact hyperbolic surfaces. We also show an asymptotic spectral gap. Finally we breifly explain why these models are interseting "toy models" to explore important questions of classical and quantum chaos. In particular, we have in mind the problem of proving lower bounds on the number of resonances, studied in the context of open quantum maps by Nonnenmacher and Zworski.

Classical partial transport barriers govern both classical and quantum dynamics of generic Hamiltonian systems. Chaotic eigenstates of quantum systems are known to localize on either side of a partial barrier if the flux connecting the two sides is not resolved by means of Heisenberg's uncertainty. Surprisingly, in open systems, in which orbits can escape, chaotic resonance states exhibit such a localization even if the flux across the partial barrier is quantum mechanically resolved. We explain this using the concept of conditionally invariant measures by introducing a new quantum mechanically relevant class of such fractal measures. We numerically find quantum-to-classical correspondence for localization transitions depending on the openness of the system and on the decay rate of resonance states. Moreover, we show that the number of long-lived chaotic resonance states that localize on one particular side of the partial barrier is described by an individual fractal Weyl law. For a generic phase space, this implies a hierarchy of fractal Weyl laws, one for each region of the hierarchical decomposition of phase space.

Classical partial transport barriers govern both classical and quantum dynamics of generic Hamiltonian systems. Chaotic eigenstates of quantum systems are known to localize on either side of a partial barrier if the flux connecting the two sides is not resolved by means of Heisenberg's uncertainty. Surprisingly, in open systems, in which orbits can escape, chaotic resonance states exhibit such a localization even if the flux across the partial barrier is quantum mechanically resolved. We explain this using the concept of conditionally invariant measures by introducing a new quantum mechanically relevant class of such fractal measures. We numerically find quantum-to-classical correspondence for localization transitions depending on the openness of the system and on the decay rate of resonance states. Moreover, we show that the number of long-lived chaotic resonance states that localize on one particular side of the partial barrier is described by an individual fractal Weyl law. For a generic phase space, this implies a hierarchy of fractal Weyl laws, one for each region of the hierarchical decomposition of phase space.