Society and technology are advancing, in which morality is being artificially implemented into machines, often known as artificial moral agency. Along with this implementation, knowledge about the underpinnings of morality, such as the neurocognitive and ethical basis are an important matter. Human moral judgment has been speculated to be a function for survival, as it favors altruism and prosocial behavior. The neural correlates of moral judgment stem from several structures of the human brain that control cognitive and affective functions such as decision making, cognitive control, theory of mind (ToM) and empathy. In relation to these, the ventromedial prefrontal cortex (vmPFC) has been widely linked to moral behavior such as ToM and moral judgment. The anterior cingulate cortex (ACC) has been linked to regulation of conflict and the dorsolateral prefrontal cortex (dlPFC) to remain cognitive control, which both have strong correlations to moral behavior. Damage to areas such as the vmPFC and ACC have demonstrated abnormal response to guilt, ToM, empathy, risky behavior as well as sociopathic tendencies, which emphasizes the importance of these structures for human morality. By investigating research in the fields of cognitive neuroscience, moral psychology and machine ethics, this thesis aims at seeking out the importance of cognitive neuroscience for the development of artificial moral agency and to furthermore discuss the necessity of emotions in artificial moral agents, which naturally lack the affective part of moral judgment. Lastly, this thesis will cover some of the main dilemmas with this integration and some future implications.