In this thesis we employ various mean-field approaches to study the shortrange interaction effects in topological insulators. We start with the Kane-Mele model on the decorated honeycomb lattice and study the stability of topological insulator phase against different perturbations. We establish an adiabatic connection between a noninteracting topological insulator and a strongly interacting spin liquid in its Majorana fermion representation. We use the Hartree-Fock mean-field approach, slave-rotor approach and slave-boson approach to study correlation effects related to topological insulators. With the spontaneous symmetry breaking mechanism, we can have an interaction driven topological insulator with extended Hubbard models on the kagome lattice and decorated honeycomb lattice. For the interplay among spin-orbit coupling, distortion and correlation effect in transition metal oxides, we use the slave-rotor mean-field approach to study its phase transition. We identify regimes where a strong topological Mott insulator and a weak topological insulator reside due to the strong Coulomb interaction and distortion. This is relevant to experiments with the transition metal oxides as they hold promise to realize topological insulators. To study the doping effects and a possible spin liquid in Kane-Mele-Hubbard model on the honeycomb lattice, we employ the slave-boson mean-field approach which is appropriate for the intermediate interaction strength. We compare our results with those obtained from other methods. / text

Les matériaux corrélés offrent une richesse de nouveaux phénomènes, dont beaucoup ne sont pas encore - ou seulement partiellement - compris. Au centre de cette thèse sont des modèles multi-orbitalaires que j'etudie à travers une palette de méthodes, dont la théorie du champ moyen dynamique. Dans le modèle de Hubbard multi-orbitalaire proche de la transition de Mott, je mets en évidence un régime de mauvais métal induit par le couplage de Hund. Les propriétés de la transition de Mott dans ce système sont analysées. Dans un deuxèime temps, je traite un modèle élargi pour inclure des degrés de liberté des ligands dans les oxydes. Plus spécifiquement, cette thèse étudie les effets des interactions inter-couches entre orbitales corrélés d'un atome de métal de transition et les orbitales p des ligands. Une partie du travail est dédiée au développement de nouvelles méthodes dont une approche de rotateurs esclaves à ce problème. Le dernier chapitre concerne le domaine de la spintronique moléculaire, où j'étudie la physique du "spin-state switching" en fonction de l'hybridation d'un ion de métal de transition avec ses ligands dans les molecules organométalliques du type porphyrine de nickel. / The physics of correlated materials offers a wealth of new phenomena, many of which are not yet - or only partially - understood. In this thesis, we focus on multi-orbital models, which we study using various methods, including dynamical mean-field theory. We show that in the multi-orbital Hubbard model close to the Mott transition, Hund's coupling gives rise to a bad metal regime the properties of which we analyze. Furthermore, we consider a more general class of models that include oxygen ligands. More specifically, we study the effect of inter-shell interactions between correlated metal- and ligand p-orbitals. In this context, we develop and test a new slave-rotor approach to treat such interactions in an effective manner. The final chapter constitutes an excursion to the field of molecular spintronics, where we study the physics of the hybridization-induced spin-state switching in organometallic nickel porphyrin molecules.