Abstract In this study, we employed the Monte Carlo simulation method to investigate the q-state coupled XY model based on the Landau free energy of couple hexatic order and herringbone order proposed by Bruinsma and Aeppli. On two-dimensional triangular lattices simulation results reveal that the q-state coupled XY model will generate a q-state clock phase transition and a XY transition. The unique generated q-state clock phase transition and XY transition will couple in some coupling parameter domain. The novel coupled transitions behavior agree with the phase transition of some kinds of liquid crystal. For example, the three-state Potts phase transition generated by a 3-state coupled XY model and the Sm-A ¡÷Hex-B transition of free ¡V standing two layers liquid crystal are matched. Their heat capacity anomaly is similar and the heat capacity exponent is both closed to £\¡Ü0.3. We also investigated the system of coupled ferromagnetic order and antiferromagnetic order. Adapted the positive coupling parameter on the Hamiltonian of 3-state coupled XY model, the simulation results reveal that the system generate an antiferromagnetic three-state Potts transition. In some parameter domain the antiferromagnetic three-state Potts transition and XY transition are coupled, and become a novel transition. The novel transition may explain the Sm-A ¡÷Hex-B transition of some kinds of liquid crystal which lack herringbone order.