During the spring of 2014 two midwives in Sweden were denied work because they refused to perform abortion on the grounds of their religious beliefs. Shortly after the health authorities were sued for discrimination. The purpose of this study is to examine whether there should be room for exemptions based on one’s conscience in a neutral liberal state. This essay applies Cécile Labordes theory of individual exceptions and liberal justices on the midwives’ case in Sweden to perform this purpose. Should, or could, they have been exempted from performing abortion and thus be allowed to work as midwives? This essay’s analysis demonstrates that the current case is not compatible with justice and there is thus no room for exemptions on a national level. However, there should be space for exemptions for cases that are compatible with justice, in order for all citizens in a pluralistic society to live in accordance with their own conception of the good.