Electrical energy is the basic necessity for the economic development of human societies. In recent decades, the electricity industry is undergoing enormous changes, which have evolved into a large-scale and competitive industry. The integration of volatile renewable energy, and the emergence of transmission switching (TS) techniques bring great challenges to the existing power system operations problems, especially security-constrained unit commitment (SCUC) solution engines. In order to deal with the uncertainty of volatile renewable energy, scenario-based stochastic optimization approach has been widely employed to ensure the reliability and economic of power systems, in which each scenario would represent a possible system situation. Meanwhile, the emergence of TS techniques allows the system operators to change the topology of transmission systems in order to improve economic benefits by mitigating transmission congestion. However, with the introduction of extra scenarios and decision variables, the complexity of the SCUC model increases dramatically and more computational efforts are required, which might make the power system operation problems difficult to solve and even intractable. Therefore, an advanced solution technique is urgently needed to solve both stochastic SCUC problems and TS-based SCUC problems in an effective and fast way. In this dissertation, a decomposition framework is presented for the optimal operation of the large-scale power system, which decomposes the original large-size power system optimization problem into smaller-size and tractable subproblems, and solves these decomposed subproblems in a parallel manner with the help of high performance computing techniques. Numerical case studies on a modified I 118-bus system and a practical 1168-bus system demonstrate the effectiveness and efficiency of the proposed approach which will offer the power system a secure and economic operation under various uncertainties and contingencies.