{"id":{"repo_id":"rowan","oai_identifier":"oai:rdw.rowan.edu:etd-4288"},"canonical_url":"https://search.ndltd.org/etd/rowan/oai:rdw.rowan.edu:etd-4288","repository":{"repo_id":"rowan","name":"Rowan University","base_url":"https://rdw.rowan.edu/do/oai/"},"display":{"title":"LOW-POWER SENSOR DESIGN AND FUSION TO EDGE DEVICES FOR HIGH-SPEED OBJECT DETECTION AND ENHANCED SOLDIER SITUATIONAL AWARENESS","abstract":"Threat detection and physiological monitoring of soldiers from fused sensor data collected in real time is currently limited to running deep neural networks with substantial computing needs. The lack of data acquisition from sensor readings and efficient detection of novel enemy signatures motivates the need for a low-power, low-cost, wireless multisensor fusion computing system. We propose the current trends in Internet of Things to deploy a chargeable, wireless multi-channel acquisition system that can be interfaced to a high speed, Single Board Computer (SBC) such as the NVIDIA Jetson Orin capable of running object detection models, such as YOLOv7-tiny to enable high speed target detection, and monitoring of soldier’s health and weapon states at a low-cost, and low-power. Target detection and data fusion was achieved at ∼60 FPS with a YOLOv7-tiny model trained on a custom drone dataset with a NVIDIA Jetson Orin equipped with a USB camera, and connected to a custom wireless Wearable Multi-Channel Physiological Device (WMCPD) centered around the ESP32 and interfaced to two physiological sensors: Pulse Oximeter, and GSR sensor that synchronized heart rate, Oxygen saturation (SpO2), and Galvanic Skin Response (GSR). Based on the power metrics required for the ESP32 and the interfaced sensors, a multi-channel acquisition system was designed that features a USB-C battery charging interface capable of charging a Li-Ion (500 mAh) to power the system. This Low Power, wearable multi-channel, physiological device (WMCPD) can transmit the sensitive fused, physiological data to wireless devices such as the Edge device, or the HoloLens 2, to not only keep track of the soldier’s physiological state, but to further exemplify efficient processing at the edge and capture soldier feedback from real-time sensitive data collection, and its affect on integrating to the external devices in the mixed reality setting (TGGSE) such as the Orin or Hololens. Additionally, a custom weapon sensing device was developed that monitors the real-time ammunition, and recoil of a soldier’s gun, and was designed to be serially compatible with military devices and vehicles over MilCAN.","abstract_html":"Threat detection and physiological monitoring of soldiers from fused sensor data collected in real time is currently limited to running deep neural networks with substantial computing needs. The lack of data acquisition from sensor readings and efficient detection of novel enemy signatures motivates the need for a low-power, low-cost, wireless multisensor fusion computing system. We propose the current trends in Internet of Things to deploy a chargeable, wireless multi-channel acquisition system that can be interfaced to a high speed, Single Board Computer (SBC) such as the NVIDIA Jetson Orin capable of running object detection models, such as YOLOv7-tiny to enable high speed target detection, and monitoring of soldier’s health and weapon states at a low-cost, and low-power. Target detection and data fusion was achieved at ∼60 FPS with a YOLOv7-tiny model trained on a custom drone dataset with a NVIDIA Jetson Orin equipped with a USB camera, and connected to a custom wireless Wearable Multi-Channel Physiological Device (WMCPD) centered around the ESP32 and interfaced to two physiological sensors: Pulse Oximeter, and GSR sensor that synchronized heart rate, Oxygen saturation (SpO2), and Galvanic Skin Response (GSR). Based on the power metrics required for the ESP32 and the interfaced sensors, a multi-channel acquisition system was designed that features a USB-C battery charging interface capable of charging a Li-Ion (500 mAh) to power the system. This Low Power, wearable multi-channel, physiological device (WMCPD) can transmit the sensitive fused, physiological data to wireless devices such as the Edge device, or the HoloLens 2, to not only keep track of the soldier’s physiological state, but to further exemplify efficient processing at the edge and capture soldier feedback from real-time sensitive data collection, and its affect on integrating to the external devices in the mixed reality setting (TGGSE) such as the Orin or Hololens. Additionally, a custom weapon sensing device was developed that monitors the real-time ammunition, and recoil of a soldier’s gun, and was designed to be serially compatible with military devices and vehicles over MilCAN.","abstract_has_math":false,"creators":["Wood, Scott Patrick"],"institution":null,"degree_name":"Master of Science (M.S.)","degree_level":"Thesis","degree_discipline":"Electrical and Computer Engineering","degree_department":null,"school":null,"contributors":["Dwaipayan Chakraborty, Ph.D.","John Schmalzel, Ph.D.","Ying Tang, Ph.D."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":null,"date_issued":"","date_published":null,"updated_at":"2026-11-19T08:59:46Z","subjects":["low-power computing systems","high-speed target detection","physiological monitoring","Wearable technology","Wireless sensor networks","Internet of Things","Electrical and Computer Engineering","Engineering"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://rdw.rowan.edu/etd/3282","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://rdw.rowan.edu/etd/3282","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://rdw.rowan.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Ardw.rowan.edu%3Aetd-4288","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Dwaipayan Chakraborty, Ph.D.","John Schmalzel, Ph.D.","Ying Tang, Ph.D."]},{"key":"dc:creator","label":"Author","values":["Wood, Scott Patrick"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.available","label":"Dc Date Available","values":["2024-09-06T07:00:00Z"]},{"key":"dc:date.created","label":"Dc Date Created","values":["2024-09-05T07:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Electrical and Computer Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master of Science (M.S.)"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["low-power computing systems","high-speed target detection","physiological monitoring","Wearable technology","Wireless sensor networks","Internet of Things","Electrical and Computer Engineering","Engineering"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://rdw.rowan.edu/etd/3282"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Threat detection and physiological monitoring of soldiers from fused sensor data collected in real time is currently limited to running deep neural networks with substantial computing needs. The lack of data acquisition from sensor readings and efficient detection of novel enemy signatures motivates the need for a low-power, low-cost, wireless multisensor fusion computing system. We propose the current trends in Internet of Things to deploy a chargeable, wireless multi-channel acquisition system that can be interfaced to a high speed, Single Board Computer (SBC) such as the NVIDIA Jetson Orin capable of running object detection models, such as YOLOv7-tiny to enable high speed target detection, and monitoring of soldier’s health and weapon states at a low-cost, and low-power. Target detection and data fusion was achieved at ∼60 FPS with a YOLOv7-tiny model trained on a custom drone dataset with a NVIDIA Jetson Orin equipped with a USB camera, and connected to a custom wireless Wearable Multi-Channel Physiological Device (WMCPD) centered around the ESP32 and interfaced to two physiological sensors: Pulse Oximeter, and GSR sensor that synchronized heart rate, Oxygen saturation (SpO2), and Galvanic Skin Response (GSR). Based on the power metrics required for the ESP32 and the interfaced sensors, a multi-channel acquisition system was designed that features a USB-C battery charging interface capable of charging a Li-Ion (500 mAh) to power the system. This Low Power, wearable multi-channel, physiological device (WMCPD) can transmit the sensitive fused, physiological data to wireless devices such as the Edge device, or the HoloLens 2, to not only keep track of the soldier’s physiological state, but to further exemplify efficient processing at the edge and capture soldier feedback from real-time sensitive data collection, and its affect on integrating to the external devices in the mixed reality setting (TGGSE) such as the Orin or Hololens. Additionally, a custom weapon sensing device was developed that monitors the real-time ammunition, and recoil of a soldier’s gun, and was designed to be serially compatible with military devices and vehicles over MilCAN."]},{"key":"dc:title","label":"Title","values":["LOW-POWER SENSOR DESIGN AND FUSION TO EDGE DEVICES FOR HIGH-SPEED OBJECT DETECTION AND ENHANCED SOLDIER SITUATIONAL AWARENESS"]}]}],"canonical_facts":{"dc:contributor":["Dwaipayan Chakraborty, Ph.D.","John Schmalzel, Ph.D.","Ying Tang, Ph.D."],"dc:creator":["Wood, Scott Patrick"],"dc:date.available":["2024-09-06T07:00:00Z"],"dc:date.created":["2024-09-05T07:00:00Z"],"dc:description.abstract":["Threat detection and physiological monitoring of soldiers from fused sensor data collected in real time is currently limited to running deep neural networks with substantial computing needs. The lack of data acquisition from sensor readings and efficient detection of novel enemy signatures motivates the need for a low-power, low-cost, wireless multisensor fusion computing system. We propose the current trends in Internet of Things to deploy a chargeable, wireless multi-channel acquisition system that can be interfaced to a high speed, Single Board Computer (SBC) such as the NVIDIA Jetson Orin capable of running object detection models, such as YOLOv7-tiny to enable high speed target detection, and monitoring of soldier’s health and weapon states at a low-cost, and low-power. Target detection and data fusion was achieved at ∼60 FPS with a YOLOv7-tiny model trained on a custom drone dataset with a NVIDIA Jetson Orin equipped with a USB camera, and connected to a custom wireless Wearable Multi-Channel Physiological Device (WMCPD) centered around the ESP32 and interfaced to two physiological sensors: Pulse Oximeter, and GSR sensor that synchronized heart rate, Oxygen saturation (SpO2), and Galvanic Skin Response (GSR). Based on the power metrics required for the ESP32 and the interfaced sensors, a multi-channel acquisition system was designed that features a USB-C battery charging interface capable of charging a Li-Ion (500 mAh) to power the system. This Low Power, wearable multi-channel, physiological device (WMCPD) can transmit the sensitive fused, physiological data to wireless devices such as the Edge device, or the HoloLens 2, to not only keep track of the soldier’s physiological state, but to further exemplify efficient processing at the edge and capture soldier feedback from real-time sensitive data collection, and its affect on integrating to the external devices in the mixed reality setting (TGGSE) such as the Orin or Hololens. Additionally, a custom weapon sensing device was developed that monitors the real-time ammunition, and recoil of a soldier’s gun, and was designed to be serially compatible with military devices and vehicles over MilCAN."],"dc:identifier":["https://rdw.rowan.edu/etd/3282"],"dc:subject":["low-power computing systems","high-speed target detection","physiological monitoring","Wearable technology","Wireless sensor networks","Internet of Things","Electrical and Computer Engineering","Engineering"],"dc:title":["LOW-POWER SENSOR DESIGN AND FUSION TO EDGE DEVICES FOR HIGH-SPEED OBJECT DETECTION AND ENHANCED SOLDIER SITUATIONAL AWARENESS"],"thesis:degree_discipline":["Electrical and Computer Engineering"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["Master of Science (M.S.)"]},"updated_at":"2026-11-19T08:59:46Z"}