One of the major challenges hindering advancement of quantum computing is the sensitive nature of the physical systems used to build a quantum computer. One suggestion for improving reliability is a particular type of logic gates, based on Berry's geometric phase, showing improved robustness to external disturbance of the quantum system over the course of a calculation. Such logic gates have previously been shown for the smallest possible two-level qubits. Using the method of adiabatic shortcut we endevour to discover similarly realistic and robust logic gates for units of quantum information in higher dimensions. The example shown in this paper discusses three-level qutrits, but is expected to apply to theoretically unlimited higher dimensions since new geometric complications are expected to arise primarily when moving from a two-level to a multi-level problem.  We here present a set of primitive single-qutrit gates able to perform universal quantum computations if supplemented by a two-qutrit gate. We also present a set of condensed single-qutrit gates for commonly needed operations. By detailing the underlying mathematical framework, relying on the multi-dimensional generalisation of Berry's phase describing the time evolution of degenerate quantum states, we also suggest an easily scalable geometric interpretation of quantum gates in higher dimensions along with visual representation of logic gates using parameters of the physical system to sequentially unlock and manipulate subspaces of the quantum information unit.