{"id":{"repo_id":"mcmaster","oai_identifier":"oai:macsphere.mcmaster.ca:11375/29762"},"canonical_url":"https://search.ndltd.org/etd/mcmaster/oai:macsphere.mcmaster.ca:11375/29762","repository":{"repo_id":"mcmaster","name":"McMaster University","base_url":"https://macsphere.mcmaster.ca/server/oai/request"},"display":{"title":"Vehicle Perception System Based on Heterogeneous Neural Network Sensor Fusion","abstract":"Previous research conducted in the CMHT lab at McMaster University led to the successful development of a Light detection and ranging (LiDAR)-based vehicle perception system, notable for its highly accurate detection of highway objects and moderate classification capabilities. This thesis builds upon that foundation, enhancing the existing system by incorporating sensor fusion with Infrared (IR) cameras and standard cameras. The implementation of sensor fusion significantly augments the system’s performance, enabling it to detect and classify objects effectively under adverse weather conditions and in poor lighting. Key contributions of this research include: • The development of a hardware-synchronized sensor system, blending LiDAR, IR cameras, and cameras. • The creation of a comprehensive sensor calibration process and a novel multi-sensor dataset, the first of its kind to include annotations under various lighting and weather conditions. • The development of an innovative ground segmentation technique using the Savitzky-Golay filter and peak detection, significantly improve the speed of ground point elimination. • The introduction of a novel optimizer cm-reSVSF for complex-valued neural networks, demonstrating superior performance compared to traditional algorithms like ADAM and SGD.","abstract_html":"Previous research conducted in the CMHT lab at McMaster University led to the successful development of a Light detection and ranging (LiDAR)-based vehicle perception system, notable for its highly accurate detection of highway objects and moderate classification capabilities. This thesis builds upon that foundation, enhancing the existing system by incorporating sensor fusion with Infrared (IR) cameras and standard cameras. The implementation of sensor fusion significantly augments the system’s performance, enabling it to detect and classify objects effectively under adverse weather conditions and in poor lighting. Key contributions of this research include: • The development of a hardware-synchronized sensor system, blending LiDAR, IR cameras, and cameras. • The creation of a comprehensive sensor calibration process and a novel multi-sensor dataset, the first of its kind to include annotations under various lighting and weather conditions. • The development of an innovative ground segmentation technique using the Savitzky-Golay filter and peak detection, significantly improve the speed of ground point elimination. • The introduction of a novel optimizer cm-reSVSF for complex-valued neural networks, demonstrating superior performance compared to traditional algorithms like ADAM and SGD.","abstract_has_math":false,"creators":["Liu, Chang"],"institution":null,"degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":"Computing and Software","school":null,"contributors":[],"advisors":["von Mohrenschildt, Martin","Habibi, Saeid"],"committee_chairs":[],"committee_members":[],"year":2024,"date_issued":"2024","date_published":"2024","updated_at":"2026-11-18T19:37:24Z","subjects":["Deep Learning","ADAS","Vehicle Perception system","CNN","CVNN","Hybrid Neural Network","SVSF","cm-reSVSF","Sensor Calibration","Dataset"],"languages":["en"],"rights":[],"rights_urls":[],"identifier_entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://doi.org/10.71548/18464"],"render_values":[{"text":"https://doi.org/10.71548/18464","href":"https://doi.org/10.71548/18464","code":true}]}],"person_identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/11375/29762","outbound_label":"Handle","outbound_source":"dc:identifier.uri","record_url":"http://hdl.handle.net/11375/29762","record_label":"Repository record","record_kind":"handle","record_source":"dc:identifier.uri","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://macsphere.mcmaster.ca/server/oai/request?verb=GetRecord&metadataPrefix=dim&identifier=oai%3Amacsphere.mcmaster.ca%3A11375%2F29762","prefix":"dim"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["von Mohrenschildt, Martin","Habibi, Saeid"]},{"key":"dc:contributor.department","label":"Department","values":["Computing and Software"]},{"key":"dc:creator","label":"Author","values":["Liu, Chang"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2024-05-07T14:52:39Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2024-05-07T14:52:39Z"]},{"key":"dc:date.issued","label":"Date","values":["2024"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Deep Learning","ADAS","Vehicle Perception system","CNN","CVNN","Hybrid Neural Network","SVSF","cm-reSVSF","Sensor Calibration","Dataset"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["http://hdl.handle.net/11375/29762","https://doi.org/10.71548/18464"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Previous research conducted in the CMHT lab at McMaster University led to the successful development of a Light detection and ranging (LiDAR)-based vehicle perception system, notable for its highly accurate detection of highway objects and moderate classification capabilities. This thesis builds upon that foundation, enhancing the existing system by incorporating sensor fusion with Infrared (IR) cameras and standard cameras. The implementation of sensor fusion significantly augments the system’s performance, enabling it to detect and classify objects effectively under adverse weather conditions and in poor lighting. Key contributions of this research include: • The development of a hardware-synchronized sensor system, blending LiDAR, IR cameras, and cameras. • The creation of a comprehensive sensor calibration process and a novel multi-sensor dataset, the first of its kind to include annotations under various lighting and weather conditions. • The development of an innovative ground segmentation technique using the Savitzky-Golay filter and peak detection, significantly improve the speed of ground point elimination. • The introduction of a novel optimizer cm-reSVSF for complex-valued neural networks, demonstrating superior performance compared to traditional algorithms like ADAM and SGD."]},{"key":"dc:description.degree","label":"Dc Description Degree","values":["Candidate in Philosophy"]},{"key":"dc:title","label":"Title","values":["Vehicle Perception System Based on Heterogeneous Neural Network Sensor Fusion"]},{"key":"others:access_status","label":"Others Access Status","values":["open.access"]}]}],"canonical_facts":{"dc:contributor.advisor":["von Mohrenschildt, Martin","Habibi, Saeid"],"dc:contributor.department":["Computing and Software"],"dc:creator":["Liu, Chang"],"dc:date.accessioned":["2024-05-07T14:52:39Z"],"dc:date.available":["2024-05-07T14:52:39Z"],"dc:date.issued":["2024"],"dc:description.abstract":["Previous research conducted in the CMHT lab at McMaster University led to the successful development of a Light detection and ranging (LiDAR)-based vehicle perception system, notable for its highly accurate detection of highway objects and moderate classification capabilities. This thesis builds upon that foundation, enhancing the existing system by incorporating sensor fusion with Infrared (IR) cameras and standard cameras. The implementation of sensor fusion significantly augments the system’s performance, enabling it to detect and classify objects effectively under adverse weather conditions and in poor lighting. Key contributions of this research include: • The development of a hardware-synchronized sensor system, blending LiDAR, IR cameras, and cameras. • The creation of a comprehensive sensor calibration process and a novel multi-sensor dataset, the first of its kind to include annotations under various lighting and weather conditions. • The development of an innovative ground segmentation technique using the Savitzky-Golay filter and peak detection, significantly improve the speed of ground point elimination. • The introduction of a novel optimizer cm-reSVSF for complex-valued neural networks, demonstrating superior performance compared to traditional algorithms like ADAM and SGD."],"dc:description.degree":["Candidate in Philosophy"],"dc:identifier.uri":["http://hdl.handle.net/11375/29762","https://doi.org/10.71548/18464"],"dc:language.iso":["en"],"dc:subject":["Deep Learning","ADAS","Vehicle Perception system","CNN","CVNN","Hybrid Neural Network","SVSF","cm-reSVSF","Sensor Calibration","Dataset"],"dc:title":["Vehicle Perception System Based on Heterogeneous Neural Network Sensor Fusion"],"dc:type":["Thesis"],"others:access_status":["open.access"]},"updated_at":"2026-11-18T19:37:24Z"}