{"id":{"repo_id":"cornell","oai_identifier":"oai:ecommons.cornell.edu:1813/44339"},"canonical_url":"https://search.ndltd.org/etd/cornell/oai:ecommons.cornell.edu:1813/44339","repository":{"repo_id":"cornell","name":"Cornell University","base_url":"https://ecommons.cornell.edu/server/oai/request"},"display":{"title":"Multi-Object, Multi-Sensor Detection And Tracking Of Pedestrians On A Mobile Robot","abstract":"Autonomous mobile robots will play an important role in human society in the near future. In particular, many autonomous mobile robots will perform long-term tasks in the same environments that humans reside, sometimes even interacting with people face-to-face. Examples of such robots include self-driving cars, domestic service robots, autonomous couriers, and robotic tour guides. Robots that perform these missions must plan based on accurate, robust information about the local dynamic state of the nearby pedestrians; this work explores the means of attaining dynamic scene information on person-scale mobile robots. From a multi-object tracking perspective, varying environment backgrounds, sensor noise, false detections (clutter), occlusion, and imperfect measurement extraction make inferring information about the dynamic scene difficult. Pedestrians also have certain quirks that pose additional challenges as trackable objects - they walk in groups, have difficult-to-predict motion, and vary in appearance (such as differing clothes and height). In this work, a suite of five different tracking \"architectures\" are developed and compared, leveraging sensor data from a 2D lidar sensor and an array of cameras with non-overlapping fields of view. In each architecture, the multi-sensor data are fused in a recursive Bayesian multi-object tracker, with certain differences in modeling representation and measurement pre-processing. These tracking algorithms are evaluated quantitatively in a set of real-world experiments, and the overall tracking performance of each architecture is evaluated with a set of rigorous multiobject metric scores. It is found that the high recall rate of the lidar detection complements the higher-precision but lower-recall visual detection, and that some simple pre-processing steps are of benefit in high-clutter scenarios.","abstract_html":"Autonomous mobile robots will play an important role in human society in the near future. In particular, many autonomous mobile robots will perform long-term tasks in the same environments that humans reside, sometimes even interacting with people face-to-face. Examples of such robots include self-driving cars, domestic service robots, autonomous couriers, and robotic tour guides. Robots that perform these missions must plan based on accurate, robust information about the local dynamic state of the nearby pedestrians; this work explores the means of attaining dynamic scene information on person-scale mobile robots. From a multi-object tracking perspective, varying environment backgrounds, sensor noise, false detections (clutter), occlusion, and imperfect measurement extraction make inferring information about the dynamic scene difficult. Pedestrians also have certain quirks that pose additional challenges as trackable objects - they walk in groups, have difficult-to-predict motion, and vary in appearance (such as differing clothes and height). In this work, a suite of five different tracking &quot;architectures&quot; are developed and compared, leveraging sensor data from a 2D lidar sensor and an array of cameras with non-overlapping fields of view. In each architecture, the multi-sensor data are fused in a recursive Bayesian multi-object tracker, with certain differences in modeling representation and measurement pre-processing. These tracking algorithms are evaluated quantitatively in a set of real-world experiments, and the overall tracking performance of each architecture is evaluated with a set of rigorous multiobject metric scores. It is found that the high recall rate of the lidar detection complements the higher-precision but lower-recall visual detection, and that some simple pre-processing steps are of benefit in high-clutter scenarios.","abstract_has_math":false,"creators":["de la Garza, Lucas"],"institution":"Cornell University","degree_name":"M.S., Aerospace Engineering","degree_level":"Master of Science","degree_discipline":"Aerospace Engineering","degree_department":null,"school":null,"contributors":[],"advisors":[],"committee_chairs":["Campbell,Mark"],"committee_members":["Savransky,Dmitry"],"year":2016,"date_issued":"2016-05-29","date_published":"2016-05-29","updated_at":"2026-11-19T03:19:03Z","subjects":["tracking","data fusion","robot perception"],"languages":["en_US"],"rights":[],"rights_urls":[],"identifier_entries":[{"key":"dc:identifier.doi","label":"DOI","values":["https://doi.org/10.7298/X4JW8BSP"],"render_values":[{"text":"https://doi.org/10.7298/X4JW8BSP","href":"https://doi.org/10.7298/X4JW8BSP","code":true}]},{"key":"dc:identifier.bibid","label":"Dc Identifier Bibid","values":["9597156"],"render_values":[{"text":"9597156","href":null,"code":true}]}],"person_identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/1813/44339","outbound_label":"Handle","outbound_source":"dc:identifier.uri","record_url":"https://hdl.handle.net/1813/44339","record_label":"Repository record","record_kind":"handle","record_source":"dc:identifier.uri","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://ecommons.cornell.edu/server/oai/request?verb=GetRecord&metadataPrefix=dim&identifier=oai%3Aecommons.cornell.edu%3A1813%2F44339","prefix":"dim"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.chair","label":"Chair","values":["Campbell,Mark"]},{"key":"dc:contributor.committeemember","label":"Committee Member","values":["Savransky,Dmitry"]},{"key":"dc:creator","label":"Author","values":["de la Garza, Lucas"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2016-07-05T15:30:09Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2021-05-30T06:00:24Z"]},{"key":"dc:date.issued","label":"Date","values":["2016-05-29"]},{"key":"dc:type","label":"Dc Type","values":["dissertation or thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Aerospace Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Master of Science"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M.S., Aerospace Engineering"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["Cornell University"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["tracking","data fusion","robot perception"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en_US"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.bibid","label":"Dc Identifier Bibid","values":["9597156"]},{"key":"dc:identifier.doi","label":"DOI","values":["https://doi.org/10.7298/X4JW8BSP"]},{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/1813/44339"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"cerif:openaire","label":"Cerif Openaire","values":["<Publication xmlns=\"https://www.openaire.eu/cerif-profile/1.1/\" id=\"d10e77cc-d939-49a6-b12c-ab52e069c8b2\"> <Type xmlns=\"https://www.openaire.eu/cerif-profile/vocab/COAR_Publication_Types\">http://purl.org/coar/resource_type/c_1843</Type> <Language>en_US</Language> <Title>Multi-Object, Multi-Sensor Detection And Tracking Of Pedestrians On A Mobile Robot</Title> <PublishedIn> <Publication> </Publication> </PublishedIn> <PublicationDate>2016-05-29</PublicationDate> <DOI>https://doi.org/10.7298/X4JW8BSP</DOI> <Authors> <Author> <DisplayName>de la Garza, Lucas</DisplayName> <Affiliation> <OrgUnit> </OrgUnit> </Affiliation> </Author> </Authors> <Editors> </Editors> <Publishers> <Publisher> <OrgUnit /> </Publisher> </Publishers> <Keyword>tracking</Keyword> <Keyword>data fusion</Keyword> <Keyword>robot perception</Keyword> <Abstract>Autonomous mobile robots will play an important role in human society in the near future. In particular, many autonomous mobile robots will perform long-term tasks in the same environments that humans reside, sometimes even interacting with people face-to-face. Examples of such robots include self-driving cars, domestic service robots, autonomous couriers, and robotic tour guides. Robots that perform these missions must plan based on accurate, robust information about the local dynamic state of the nearby pedestrians; this work explores the means of attaining dynamic scene information on person-scale mobile robots. From a multi-object tracking perspective, varying environment backgrounds, sensor noise, false detections (clutter), occlusion, and imperfect measurement extraction make inferring information about the dynamic scene difficult. Pedestrians also have certain quirks that pose additional challenges as trackable objects - they walk in groups, have difficult-to-predict motion, and vary in appearance (such as differing clothes and height). In this work, a suite of five different tracking \"architectures\" are developed and compared, leveraging sensor data from a 2D lidar sensor and an array of cameras with non-overlapping fields of view. In each architecture, the multi-sensor data are fused in a recursive Bayesian multi-object tracker, with certain differences in modeling representation and measurement pre-processing. These tracking algorithms are evaluated quantitatively in a set of real-world experiments, and the overall tracking performance of each architecture is evaluated with a set of rigorous multiobject metric scores. It is found that the high recall rate of the lidar detection complements the higher-precision but lower-recall visual detection, and that some simple pre-processing steps are of benefit in high-clutter scenarios.</Abstract> <Access xmlns=\"http://purl.org/coar/access_right\" > </Access> </Publication>"]},{"key":"cris:virtual.author","label":"Cris Virtual Author","values":["de la Garza, Lucas"]},{"key":"cris:virtualsource.collection","label":"Cris Virtualsource Collection","values":["5893a6ea-7af3-41d7-abc6-04bcd26ab5df"]},{"key":"dc:description.abstract","label":"Abstract","values":["Autonomous mobile robots will play an important role in human society in the near future. In particular, many autonomous mobile robots will perform long-term tasks in the same environments that humans reside, sometimes even interacting with people face-to-face. Examples of such robots include self-driving cars, domestic service robots, autonomous couriers, and robotic tour guides. Robots that perform these missions must plan based on accurate, robust information about the local dynamic state of the nearby pedestrians; this work explores the means of attaining dynamic scene information on person-scale mobile robots. From a multi-object tracking perspective, varying environment backgrounds, sensor noise, false detections (clutter), occlusion, and imperfect measurement extraction make inferring information about the dynamic scene difficult. Pedestrians also have certain quirks that pose additional challenges as trackable objects - they walk in groups, have difficult-to-predict motion, and vary in appearance (such as differing clothes and height). In this work, a suite of five different tracking \"architectures\" are developed and compared, leveraging sensor data from a 2D lidar sensor and an array of cameras with non-overlapping fields of view. In each architecture, the multi-sensor data are fused in a recursive Bayesian multi-object tracker, with certain differences in modeling representation and measurement pre-processing. These tracking algorithms are evaluated quantitatively in a set of real-world experiments, and the overall tracking performance of each architecture is evaluated with a set of rigorous multiobject metric scores. It is found that the high recall rate of the lidar detection complements the higher-precision but lower-recall visual detection, and that some simple pre-processing steps are of benefit in high-clutter scenarios."]},{"key":"dc:description.collection","label":"Dc Description Collection","values":["Cornell Theses and Dissertations"]},{"key":"dc:format.mimetype","label":"Dc Format Mimetype","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Multi-Object, Multi-Sensor Detection And Tracking Of Pedestrians On A Mobile Robot"]},{"key":"dspace:entity.type","label":"Dspace Entity Type","values":["Publication"]},{"key":"others:access_status","label":"Others Access Status","values":["open.access"]}]}],"canonical_facts":{"cerif:openaire":["<Publication xmlns=\"https://www.openaire.eu/cerif-profile/1.1/\" id=\"d10e77cc-d939-49a6-b12c-ab52e069c8b2\"> <Type xmlns=\"https://www.openaire.eu/cerif-profile/vocab/COAR_Publication_Types\">http://purl.org/coar/resource_type/c_1843</Type> <Language>en_US</Language> <Title>Multi-Object, Multi-Sensor Detection And Tracking Of Pedestrians On A Mobile Robot</Title> <PublishedIn> <Publication> </Publication> </PublishedIn> <PublicationDate>2016-05-29</PublicationDate> <DOI>https://doi.org/10.7298/X4JW8BSP</DOI> <Authors> <Author> <DisplayName>de la Garza, Lucas</DisplayName> <Affiliation> <OrgUnit> </OrgUnit> </Affiliation> </Author> </Authors> <Editors> </Editors> <Publishers> <Publisher> <OrgUnit /> </Publisher> </Publishers> <Keyword>tracking</Keyword> <Keyword>data fusion</Keyword> <Keyword>robot perception</Keyword> <Abstract>Autonomous mobile robots will play an important role in human society in the near future. In particular, many autonomous mobile robots will perform long-term tasks in the same environments that humans reside, sometimes even interacting with people face-to-face. Examples of such robots include self-driving cars, domestic service robots, autonomous couriers, and robotic tour guides. Robots that perform these missions must plan based on accurate, robust information about the local dynamic state of the nearby pedestrians; this work explores the means of attaining dynamic scene information on person-scale mobile robots. From a multi-object tracking perspective, varying environment backgrounds, sensor noise, false detections (clutter), occlusion, and imperfect measurement extraction make inferring information about the dynamic scene difficult. Pedestrians also have certain quirks that pose additional challenges as trackable objects - they walk in groups, have difficult-to-predict motion, and vary in appearance (such as differing clothes and height). In this work, a suite of five different tracking \"architectures\" are developed and compared, leveraging sensor data from a 2D lidar sensor and an array of cameras with non-overlapping fields of view. In each architecture, the multi-sensor data are fused in a recursive Bayesian multi-object tracker, with certain differences in modeling representation and measurement pre-processing. These tracking algorithms are evaluated quantitatively in a set of real-world experiments, and the overall tracking performance of each architecture is evaluated with a set of rigorous multiobject metric scores. It is found that the high recall rate of the lidar detection complements the higher-precision but lower-recall visual detection, and that some simple pre-processing steps are of benefit in high-clutter scenarios.</Abstract> <Access xmlns=\"http://purl.org/coar/access_right\" > </Access> </Publication>"],"cris:virtual.author":["de la Garza, Lucas"],"cris:virtualsource.collection":["5893a6ea-7af3-41d7-abc6-04bcd26ab5df"],"dc:contributor.chair":["Campbell,Mark"],"dc:contributor.committeemember":["Savransky,Dmitry"],"dc:creator":["de la Garza, Lucas"],"dc:date.accessioned":["2016-07-05T15:30:09Z"],"dc:date.available":["2021-05-30T06:00:24Z"],"dc:date.issued":["2016-05-29"],"dc:description.abstract":["Autonomous mobile robots will play an important role in human society in the near future. In particular, many autonomous mobile robots will perform long-term tasks in the same environments that humans reside, sometimes even interacting with people face-to-face. Examples of such robots include self-driving cars, domestic service robots, autonomous couriers, and robotic tour guides. Robots that perform these missions must plan based on accurate, robust information about the local dynamic state of the nearby pedestrians; this work explores the means of attaining dynamic scene information on person-scale mobile robots. From a multi-object tracking perspective, varying environment backgrounds, sensor noise, false detections (clutter), occlusion, and imperfect measurement extraction make inferring information about the dynamic scene difficult. Pedestrians also have certain quirks that pose additional challenges as trackable objects - they walk in groups, have difficult-to-predict motion, and vary in appearance (such as differing clothes and height). In this work, a suite of five different tracking \"architectures\" are developed and compared, leveraging sensor data from a 2D lidar sensor and an array of cameras with non-overlapping fields of view. In each architecture, the multi-sensor data are fused in a recursive Bayesian multi-object tracker, with certain differences in modeling representation and measurement pre-processing. These tracking algorithms are evaluated quantitatively in a set of real-world experiments, and the overall tracking performance of each architecture is evaluated with a set of rigorous multiobject metric scores. It is found that the high recall rate of the lidar detection complements the higher-precision but lower-recall visual detection, and that some simple pre-processing steps are of benefit in high-clutter scenarios."],"dc:description.collection":["Cornell Theses and Dissertations"],"dc:format.mimetype":["application/pdf"],"dc:identifier.bibid":["9597156"],"dc:identifier.doi":["https://doi.org/10.7298/X4JW8BSP"],"dc:identifier.uri":["https://hdl.handle.net/1813/44339"],"dc:language.iso":["en_US"],"dc:subject":["tracking","data fusion","robot perception"],"dc:title":["Multi-Object, Multi-Sensor Detection And Tracking Of Pedestrians On A Mobile Robot"],"dc:type":["dissertation or thesis"],"dspace:entity.type":["Publication"],"others:access_status":["open.access"],"thesis:degree_discipline":["Aerospace Engineering"],"thesis:degree_level":["Master of Science"],"thesis:degree_name":["M.S., Aerospace Engineering"],"thesis:institution_name":["Cornell University"]},"updated_at":"2026-11-19T03:19:03Z"}