{"id":{"repo_id":"usf","oai_identifier":"oai:digitalcommons.usf.edu:etd-11212"},"canonical_url":"https://search.ndltd.org/etd/usf/oai:digitalcommons.usf.edu:etd-11212","repository":{"repo_id":"usf","name":"University of South Florida","base_url":"https://digitalcommons.usf.edu/do/oai/"},"display":{"title":"Refining the Machine Learning Pipeline for US-based Public Transit Systems","abstract":"According to the Population Division of the United Nations, in the United States, almost 90% of the population will live in urban areas by the year 2050. As the population in a given area increases, higher traffic congestion follows due to an increase of vehicles in the road. A possible way to alleviate congestion could be with widespread use of public transit. However, according to the US Census Bureau, the percentage of individuals commuting through public transportation has been decreasing steadily over time, and the American Community Survey reports that during 2019, only around five percent of the US population reported relying on public transit on a daily or weekly basis. In order to reverse the trend of decreasing ridership, changes to how cities organize their communities and transit systems need to take place. Part of these efforts include improving information systems operated by transit agencies through artificial intelligence and other means to aid operators in the decision-making process and help riders be better informed of any changes to their commute. This work pertains to the implementations and improvements to techniques used when performing machine learning activities in the public transportation space. Standard machine learning pipelines are organized as four modules: data collection, feature extraction, model learning and evaluation. Throughout this dissertation, three of the four modules are evaluated, their limitations explored, and addressed through novel techniques that address issues such as: reproducibility across datasets, technique transfers across transit operators and decreasing the barrier of entry into the field. The data collection module is transformed from an active process of limited observations to a passive process capable of capturing all of the available data a transit operator has available. The feature extraction module evolves from a sequential process involving the combination and preprocessing of tabular data into a module capable of generating datasets from hierarchial time-series data streams at a rate of thousands of records per second. This technique would allow feature generation to participate as part of the fine-tuning process. Finally, the evaluation module introduces new standards for evaluating public transit models by proposing visualizations and test sets based on routes and times rather than a single-value performance metric. The module also proposes the use of shifting binary classification techniques to provide a easier-to-understand insights in model performance.","abstract_html":"According to the Population Division of the United Nations, in the United States, almost 90% of the population will live in urban areas by the year 2050. As the population in a given area increases, higher traffic congestion follows due to an increase of vehicles in the road. A possible way to alleviate congestion could be with widespread use of public transit. However, according to the US Census Bureau, the percentage of individuals commuting through public transportation has been decreasing steadily over time, and the American Community Survey reports that during 2019, only around five percent of the US population reported relying on public transit on a daily or weekly basis. In order to reverse the trend of decreasing ridership, changes to how cities organize their communities and transit systems need to take place. Part of these efforts include improving information systems operated by transit agencies through artificial intelligence and other means to aid operators in the decision-making process and help riders be better informed of any changes to their commute. This work pertains to the implementations and improvements to techniques used when performing machine learning activities in the public transportation space. Standard machine learning pipelines are organized as four modules: data collection, feature extraction, model learning and evaluation. Throughout this dissertation, three of the four modules are evaluated, their limitations explored, and addressed through novel techniques that address issues such as: reproducibility across datasets, technique transfers across transit operators and decreasing the barrier of entry into the field. The data collection module is transformed from an active process of limited observations to a passive process capable of capturing all of the available data a transit operator has available. The feature extraction module evolves from a sequential process involving the combination and preprocessing of tabular data into a module capable of generating datasets from hierarchial time-series data streams at a rate of thousands of records per second. This technique would allow feature generation to participate as part of the fine-tuning process. Finally, the evaluation module introduces new standards for evaluating public transit models by proposing visualizations and test sets based on routes and times rather than a single-value performance metric. The module also proposes the use of shifting binary classification techniques to provide a easier-to-understand insights in model performance.","abstract_has_math":false,"creators":["Adorno, Jennifer"],"institution":"University of South Florida","degree_name":"Doctor of Philosophy (Ph.D.)","degree_level":"Dissertation","degree_discipline":"Computer Science and Engineering","degree_department":null,"school":null,"contributors":["Jarred Ligatti, Ph.D.","Sean Barbeau, Ph.D.","Paul Rosen, Ph.D.","Tempestt Neal, Ph.D.","Yueng DeLaHoz Isaza, Ph.D."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2023,"date_issued":"2023-11-08T08:00:00Z","date_published":"2023-11-08T08:00:00Z","updated_at":"2026-11-19T08:49:16Z","subjects":["data science","high-peformance computing","visualization","Computer Sciences","Urban Studies and Planning"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://digitalcommons.usf.edu/etd/10015","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://digitalcommons.usf.edu/etd/10015","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://digitalcommons.usf.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Adigitalcommons.usf.edu%3Aetd-11212","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Jarred Ligatti, Ph.D.","Sean Barbeau, Ph.D.","Paul Rosen, Ph.D.","Tempestt Neal, Ph.D.","Yueng DeLaHoz Isaza, Ph.D."]},{"key":"dc:creator","label":"Author","values":["Adorno, Jennifer"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2023-11-08T08:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science and Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation","Ph.D."]},{"key":"thesis:degree_name","label":"Degree Name","values":["Doctor of Philosophy (Ph.D.)"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of South Florida"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["data science","high-peformance computing","visualization","Computer Sciences","Urban Studies and Planning"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://digitalcommons.usf.edu/etd/10015"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["According to the Population Division of the United Nations, in the United States, almost 90% of the population will live in urban areas by the year 2050. As the population in a given area increases, higher traffic congestion follows due to an increase of vehicles in the road. A possible way to alleviate congestion could be with widespread use of public transit. However, according to the US Census Bureau, the percentage of individuals commuting through public transportation has been decreasing steadily over time, and the American Community Survey reports that during 2019, only around five percent of the US population reported relying on public transit on a daily or weekly basis. In order to reverse the trend of decreasing ridership, changes to how cities organize their communities and transit systems need to take place. Part of these efforts include improving information systems operated by transit agencies through artificial intelligence and other means to aid operators in the decision-making process and help riders be better informed of any changes to their commute. This work pertains to the implementations and improvements to techniques used when performing machine learning activities in the public transportation space. Standard machine learning pipelines are organized as four modules: data collection, feature extraction, model learning and evaluation. Throughout this dissertation, three of the four modules are evaluated, their limitations explored, and addressed through novel techniques that address issues such as: reproducibility across datasets, technique transfers across transit operators and decreasing the barrier of entry into the field. The data collection module is transformed from an active process of limited observations to a passive process capable of capturing all of the available data a transit operator has available. The feature extraction module evolves from a sequential process involving the combination and preprocessing of tabular data into a module capable of generating datasets from hierarchial time-series data streams at a rate of thousands of records per second. This technique would allow feature generation to participate as part of the fine-tuning process. Finally, the evaluation module introduces new standards for evaluating public transit models by proposing visualizations and test sets based on routes and times rather than a single-value performance metric. The module also proposes the use of shifting binary classification techniques to provide a easier-to-understand insights in model performance."]},{"key":"dc:title","label":"Title","values":["Refining the Machine Learning Pipeline for US-based Public Transit Systems"]}]}],"canonical_facts":{"dc:contributor":["Jarred Ligatti, Ph.D.","Sean Barbeau, Ph.D.","Paul Rosen, Ph.D.","Tempestt Neal, Ph.D.","Yueng DeLaHoz Isaza, Ph.D."],"dc:creator":["Adorno, Jennifer"],"dc:date":["2023-11-08T08:00:00Z"],"dc:description":["According to the Population Division of the United Nations, in the United States, almost 90% of the population will live in urban areas by the year 2050. As the population in a given area increases, higher traffic congestion follows due to an increase of vehicles in the road. A possible way to alleviate congestion could be with widespread use of public transit. However, according to the US Census Bureau, the percentage of individuals commuting through public transportation has been decreasing steadily over time, and the American Community Survey reports that during 2019, only around five percent of the US population reported relying on public transit on a daily or weekly basis. In order to reverse the trend of decreasing ridership, changes to how cities organize their communities and transit systems need to take place. Part of these efforts include improving information systems operated by transit agencies through artificial intelligence and other means to aid operators in the decision-making process and help riders be better informed of any changes to their commute. This work pertains to the implementations and improvements to techniques used when performing machine learning activities in the public transportation space. Standard machine learning pipelines are organized as four modules: data collection, feature extraction, model learning and evaluation. Throughout this dissertation, three of the four modules are evaluated, their limitations explored, and addressed through novel techniques that address issues such as: reproducibility across datasets, technique transfers across transit operators and decreasing the barrier of entry into the field. The data collection module is transformed from an active process of limited observations to a passive process capable of capturing all of the available data a transit operator has available. The feature extraction module evolves from a sequential process involving the combination and preprocessing of tabular data into a module capable of generating datasets from hierarchial time-series data streams at a rate of thousands of records per second. This technique would allow feature generation to participate as part of the fine-tuning process. Finally, the evaluation module introduces new standards for evaluating public transit models by proposing visualizations and test sets based on routes and times rather than a single-value performance metric. The module also proposes the use of shifting binary classification techniques to provide a easier-to-understand insights in model performance."],"dc:identifier":["https://digitalcommons.usf.edu/etd/10015"],"dc:subject":["data science","high-peformance computing","visualization","Computer Sciences","Urban Studies and Planning"],"dc:title":["Refining the Machine Learning Pipeline for US-based Public Transit Systems"],"thesis:degree_discipline":["Computer Science and Engineering"],"thesis:degree_level":["Dissertation","Ph.D."],"thesis:degree_name":["Doctor of Philosophy (Ph.D.)"],"thesis:institution_name":["University of South Florida"]},"updated_at":"2026-11-19T08:49:16Z"}