<p dir="ltr">Complexity has played an increasingly important role in recent years. In this dissertation, we study some notions of complexity in systems that exhibit critical behaviour. Our results show that complexity as it is generally understood in holographic and lattice models of criticality can have several ambiguities. But despite these ambiguities, there are some features that are universally true. On the phase diagram of the system, it is the critical point which has the most complex ground state. States of physical systems with a large complexity tend to be hard to simulate using quantum circuits. Near the critical point, there is a part of complexity which is non-analytic and scales universally, i.e, the scaling is independent of the microscopic details of the Hamiltonian but depends only on the dimensionality of the system, and of the deforming operator. The coefficient of this term is unambiguous, i.e, it is not affected by the various changes in the definition of complexity which plague all the analytic terms near the critical point. We show this in lattice, field-theoretic and holographic calculations. These results were first presented in our earlier studies.</p>