Our work is closely connected with the problem of splitting of separatrices (breaking of homoclinic orbits) in a singularly perturbed model describing gravity water waves on a surface of finite depth. The singularly perturbed model is a family of singularly perturbed fourth-order nonlinear ordinary differential equations, parametrized by an external parameter (in addition to the small parameter of the perturbations). It is known that in general separatrices will not survive a singular perturbation. However, it was proven by Tovbis and Pelinovsky that there is a discrete set of exceptional values of the external parameter for which separatrices do survive the perturbation. Since our family of equations can be written in the Hamiltonian form, the question is whether or not survival of separatrices implies integrability of the corresponding equation. The complete integrability of the system is examined from two viewpoints: 1) the existence of a second first integral in involution (Liouville integrability), and 2) the existence of single-valued, meromorphic solutions (complex analytic integrability). In the latter case, a singular point analysis is done using the technique given by Ablowitz, Ramani, and Segur (the ARS algorithm) to determine whether the system is of Painlevé-type (P-type), lacking movable critical points. The system is shown by the algorithm to fail to be of P-type, a strong indication of nonintegrability.

We derive two hierarchies of 1+1 dimensional soliton-type integrable systems from two spectral problems associated with the Lie algebra of the special orthogonal Lie group SO(3,R). By using the trace identity, we formulate Hamiltonian structures for the resulting equations. Further, we show that each of these equations can be written in Hamiltonian form in two distinct ways, leading to the integrability of the equations in the sense of Liouville. We also present finite-dimensional Hamiltonian systems by means of symmetry constraints and discuss their integrability based on the existence of sufficiently many integrals of motion.