Man overboard is one of the most common and dangerous accidents that can occur whentraveling on a boat. Available research on man overboard systems with cameras have focusedon man overboard taking place from larger ships, which involves a fall from a height.Recreational boat manufacturers often use cord-based kill switches that turns of the engineif the wearer falls overboard. The aim of this thesis is to create a man overboard warningsystem based on state-of-the-art object detection models that can detect man overboard situationthrough inputs from a camera. Awell performing warning system would allow boatmanufactures to comply with safety regulations and expand the kill-switch coverage to allpassengers on the boat. Furthermore, the aim is also to create two new datasets: one dedicatedto human detection and one with man overboard fall sequences. YOLOv5 achievedthe highest performance on a new human detection dataset, with an average precision of97%. A Mobilenet-SSD-v1 network based on weights from training on the PASCAL VOCdataset and additional training on the new man overboard dataset is used as the detectionmodel in final warning system. The man overboard warning system achieves an accuracyof 50% at best, with a precision of 58% and recall of 78%.