{"id":{"repo_id":"usf","oai_identifier":"oai:digitalcommons.usf.edu:etd-12047"},"canonical_url":"https://search.ndltd.org/etd/usf/oai:digitalcommons.usf.edu:etd-12047","repository":{"repo_id":"usf","name":"University of South Florida","base_url":"https://digitalcommons.usf.edu/do/oai/"},"display":{"title":"Multimodal Assessment of Human Behavior with Applications in Analysis of Autism Spectrum Disorder","abstract":"Human behavior analysis is an important application area of artificial intelligence. Usingdata collected from sensors (e.g., cameras), human behavior including, but not limited to, emotions, expressions, body movement, and eye gaze are analyzed. This analysis is useful in applications in diverse fields ranging from healthcare, defense, education, and marketing. Considering this, in this dissertation, we have proposed new approaches to emotion and expression recognition, subject identification, and classification of autism spectrum disorder. More specifically, this dissertation has the following contributions: 1) A new approach for multimodal ubiquitous emotion recognition is proposed; 2) Investigation into the impact of large expression variations on 3D subject identification is detailed; 3) An approach to generalizing expression across age ranges (children vs. elderly) is proposed; 4) This is the first work to propose using self-report questionnaire data to classify autism spectrum disorder across age ranges; and (5) This is the first work to proposed a context-based approach to classifying videos of children at risk for autism spectrum disorder.","abstract_html":"Human behavior analysis is an important application area of artificial intelligence. Usingdata collected from sensors (e.g., cameras), human behavior including, but not limited to, emotions, expressions, body movement, and eye gaze are analyzed. This analysis is useful in applications in diverse fields ranging from healthcare, defense, education, and marketing. Considering this, in this dissertation, we have proposed new approaches to emotion and expression recognition, subject identification, and classification of autism spectrum disorder. More specifically, this dissertation has the following contributions: 1) A new approach for multimodal ubiquitous emotion recognition is proposed; 2) Investigation into the impact of large expression variations on 3D subject identification is detailed; 3) An approach to generalizing expression across age ranges (children vs. elderly) is proposed; 4) This is the first work to propose using self-report questionnaire data to classify autism spectrum disorder across age ranges; and (5) This is the first work to proposed a context-based approach to classifying videos of children at risk for autism spectrum disorder.","abstract_has_math":false,"creators":["Jannat, Sk Rahatul"],"institution":"University of South Florida","degree_name":"Doctor of Philosophy (Ph.D.)","degree_level":"Dissertation","degree_discipline":"Computer Science and Engineering","degree_department":null,"school":null,"contributors":["Shaun Canavan, Ph.D.","Dmitry Goldgof, Ph.D.","Heather Agazzi, Ph.D.","Tempestt Neal, Ph.D.","Pei-Sung Lin, Ph.D."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2023,"date_issued":"2023-06-30T07:00:00Z","date_published":"2023-06-30T07:00:00Z","updated_at":"2026-11-19T08:49:56Z","subjects":["Autism","Emotion","Expression","Age","Computer Sciences"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://digitalcommons.usf.edu/etd/10760","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://digitalcommons.usf.edu/etd/10760","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://digitalcommons.usf.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Adigitalcommons.usf.edu%3Aetd-12047","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Shaun Canavan, Ph.D.","Dmitry Goldgof, Ph.D.","Heather Agazzi, Ph.D.","Tempestt Neal, Ph.D.","Pei-Sung Lin, Ph.D."]},{"key":"dc:creator","label":"Author","values":["Jannat, Sk Rahatul"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2023-06-30T07:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science and Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation","Ph.D."]},{"key":"thesis:degree_name","label":"Degree Name","values":["Doctor of Philosophy (Ph.D.)"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of South Florida"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Autism","Emotion","Expression","Age","Computer Sciences"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://digitalcommons.usf.edu/etd/10760"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Human behavior analysis is an important application area of artificial intelligence. Usingdata collected from sensors (e.g., cameras), human behavior including, but not limited to, emotions, expressions, body movement, and eye gaze are analyzed. This analysis is useful in applications in diverse fields ranging from healthcare, defense, education, and marketing. Considering this, in this dissertation, we have proposed new approaches to emotion and expression recognition, subject identification, and classification of autism spectrum disorder. More specifically, this dissertation has the following contributions: 1) A new approach for multimodal ubiquitous emotion recognition is proposed; 2) Investigation into the impact of large expression variations on 3D subject identification is detailed; 3) An approach to generalizing expression across age ranges (children vs. elderly) is proposed; 4) This is the first work to propose using self-report questionnaire data to classify autism spectrum disorder across age ranges; and (5) This is the first work to proposed a context-based approach to classifying videos of children at risk for autism spectrum disorder."]},{"key":"dc:title","label":"Title","values":["Multimodal Assessment of Human Behavior with Applications in Analysis of Autism Spectrum Disorder"]}]}],"canonical_facts":{"dc:contributor":["Shaun Canavan, Ph.D.","Dmitry Goldgof, Ph.D.","Heather Agazzi, Ph.D.","Tempestt Neal, Ph.D.","Pei-Sung Lin, Ph.D."],"dc:creator":["Jannat, Sk Rahatul"],"dc:date":["2023-06-30T07:00:00Z"],"dc:description":["Human behavior analysis is an important application area of artificial intelligence. Usingdata collected from sensors (e.g., cameras), human behavior including, but not limited to, emotions, expressions, body movement, and eye gaze are analyzed. This analysis is useful in applications in diverse fields ranging from healthcare, defense, education, and marketing. Considering this, in this dissertation, we have proposed new approaches to emotion and expression recognition, subject identification, and classification of autism spectrum disorder. More specifically, this dissertation has the following contributions: 1) A new approach for multimodal ubiquitous emotion recognition is proposed; 2) Investigation into the impact of large expression variations on 3D subject identification is detailed; 3) An approach to generalizing expression across age ranges (children vs. elderly) is proposed; 4) This is the first work to propose using self-report questionnaire data to classify autism spectrum disorder across age ranges; and (5) This is the first work to proposed a context-based approach to classifying videos of children at risk for autism spectrum disorder."],"dc:identifier":["https://digitalcommons.usf.edu/etd/10760"],"dc:subject":["Autism","Emotion","Expression","Age","Computer Sciences"],"dc:title":["Multimodal Assessment of Human Behavior with Applications in Analysis of Autism Spectrum Disorder"],"thesis:degree_discipline":["Computer Science and Engineering"],"thesis:degree_level":["Dissertation","Ph.D."],"thesis:degree_name":["Doctor of Philosophy (Ph.D.)"],"thesis:institution_name":["University of South Florida"]},"updated_at":"2026-11-19T08:49:56Z"}