{"id":{"repo_id":"usf","oai_identifier":"oai:digitalcommons.usf.edu:etd-10070"},"canonical_url":"https://search.ndltd.org/etd/usf/oai:digitalcommons.usf.edu:etd-10070","repository":{"repo_id":"usf","name":"University of South Florida","base_url":"https://digitalcommons.usf.edu/do/oai/"},"display":{"title":"Recognizing Emotion in the Wild Using Multimodal Data","abstract":"In this work, I will present our approach of using multi-modal data for recognizing human emotion and behavior in the wild. The study is divided into four tasks: group emotion recognition, driver gaze prediction, student engagement prediction, and emotion recognition using physiological signals. We explore multiple approaches including classical machine learning tools such as random forests, state-of-the-art deep neural networks, and multiple fusion and ensemble-based approaches. We also show that similar approaches can be used across tracks as many of the features generalize well to the different problems (e.g. facial features).","abstract_html":"In this work, I will present our approach of using multi-modal data for recognizing human emotion and behavior in the wild. The study is divided into four tasks: group emotion recognition, driver gaze prediction, student engagement prediction, and emotion recognition using physiological signals. We explore multiple approaches including classical machine learning tools such as random forests, state-of-the-art deep neural networks, and multiple fusion and ensemble-based approaches. We also show that similar approaches can be used across tracks as many of the features generalize well to the different problems (e.g. facial features).","abstract_has_math":false,"creators":["Srivastava, Shivam"],"institution":"University of South Florida","degree_name":"MS in Computer Science (M.S.C.S.)","degree_level":"Thesis","degree_discipline":"Computer Science and Engineering","degree_department":null,"school":null,"contributors":["Shaun Canavan, Ph.D.","Dmitry B. Goldgof, Ph.D.","Srinivas Katkoori, Ph.D."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2021,"date_issued":"2021-03-18T07:00:00Z","date_published":"2021-03-18T07:00:00Z","updated_at":"2026-11-19T08:45:24Z","subjects":["Engagement Prediction","Gaze Detection","Physiological Signals","Computer Sciences"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://digitalcommons.usf.edu/etd/8873","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://digitalcommons.usf.edu/etd/8873","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://digitalcommons.usf.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Adigitalcommons.usf.edu%3Aetd-10070","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Shaun Canavan, Ph.D.","Dmitry B. Goldgof, Ph.D.","Srinivas Katkoori, Ph.D."]},{"key":"dc:creator","label":"Author","values":["Srivastava, Shivam"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2021-03-18T07:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science and Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis","M.S.C.S."]},{"key":"thesis:degree_name","label":"Degree Name","values":["MS in Computer Science (M.S.C.S.)"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of South Florida"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Engagement Prediction","Gaze Detection","Physiological Signals","Computer Sciences"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://digitalcommons.usf.edu/etd/8873"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["In this work, I will present our approach of using multi-modal data for recognizing human emotion and behavior in the wild. The study is divided into four tasks: group emotion recognition, driver gaze prediction, student engagement prediction, and emotion recognition using physiological signals. We explore multiple approaches including classical machine learning tools such as random forests, state-of-the-art deep neural networks, and multiple fusion and ensemble-based approaches. We also show that similar approaches can be used across tracks as many of the features generalize well to the different problems (e.g. facial features)."]},{"key":"dc:title","label":"Title","values":["Recognizing Emotion in the Wild Using Multimodal Data"]}]}],"canonical_facts":{"dc:contributor":["Shaun Canavan, Ph.D.","Dmitry B. Goldgof, Ph.D.","Srinivas Katkoori, Ph.D."],"dc:creator":["Srivastava, Shivam"],"dc:date":["2021-03-18T07:00:00Z"],"dc:description":["In this work, I will present our approach of using multi-modal data for recognizing human emotion and behavior in the wild. The study is divided into four tasks: group emotion recognition, driver gaze prediction, student engagement prediction, and emotion recognition using physiological signals. We explore multiple approaches including classical machine learning tools such as random forests, state-of-the-art deep neural networks, and multiple fusion and ensemble-based approaches. We also show that similar approaches can be used across tracks as many of the features generalize well to the different problems (e.g. facial features)."],"dc:identifier":["https://digitalcommons.usf.edu/etd/8873"],"dc:subject":["Engagement Prediction","Gaze Detection","Physiological Signals","Computer Sciences"],"dc:title":["Recognizing Emotion in the Wild Using Multimodal Data"],"thesis:degree_discipline":["Computer Science and Engineering"],"thesis:degree_level":["Thesis","M.S.C.S."],"thesis:degree_name":["MS in Computer Science (M.S.C.S.)"],"thesis:institution_name":["University of South Florida"]},"updated_at":"2026-11-19T08:45:24Z"}