{"id":{"repo_id":"csusb","oai_identifier":"oai:scholarworks.lib.csusb.edu:etd-3197"},"canonical_url":"https://search.ndltd.org/etd/csusb/oai:scholarworks.lib.csusb.edu:etd-3197","repository":{"repo_id":"csusb","name":"CSUniversity San Bernardino","base_url":"https://scholarworks.lib.csusb.edu/do/oai/"},"display":{"title":"DETERMINING PEDAGOGIC EFFECTIVENESS OF CHATGPT USING QUALITATIVE ANALYSIS OF ACADEMIC QUERY SETS","abstract":"This thesis investigates the effectiveness of ChatGPT in high school and undergraduate education and the subsequent implications of its usage and integration in these educational contexts. While there has been significant discourse on its potential utility, previous studies have not dealt with understanding ChatGPT's effectiveness in high school and undergraduate education by directly evaluating ChatGPT from a student's point of view. To address these gaps, this study uses a qualitative methodological approach to evaluate ChatGPT's real-world utility by evaluating its responses to questions from commonly chosen subjects. These responses are qualitatively rated by student evaluators to assess their usefulness. From the findings, ChatGPT’s performance indicates that it has the potential to provide supplementary assistance in delivering knowledge and aiding students in their academic activities at a foundational level for a chosen subject. However, its performance deteriorates at the advanced levels of a subject leading to more incorrect and lower-quality responses, suggesting the need for safeguards to ensure its responsible application in education at higher levels of study. ChatGPT’s evaluation also highlights broader ethical issues with its usage and integration within educational contexts, for which this thesis explores potential ways to mitigate these issues while providing a holistic educational experience to students. Therefore, the results of this study support the view that ChatGPT proves beneficial as a supplementary knowledge tool in educational contexts, and with appropriate safeguards in place, can be used as a practical learning aid to augment other academic material wherever needed.","abstract_html":"This thesis investigates the effectiveness of ChatGPT in high school and undergraduate education and the subsequent implications of its usage and integration in these educational contexts. While there has been significant discourse on its potential utility, previous studies have not dealt with understanding ChatGPT&#x27;s effectiveness in high school and undergraduate education by directly evaluating ChatGPT from a student&#x27;s point of view. To address these gaps, this study uses a qualitative methodological approach to evaluate ChatGPT&#x27;s real-world utility by evaluating its responses to questions from commonly chosen subjects. These responses are qualitatively rated by student evaluators to assess their usefulness. From the findings, ChatGPT’s performance indicates that it has the potential to provide supplementary assistance in delivering knowledge and aiding students in their academic activities at a foundational level for a chosen subject. However, its performance deteriorates at the advanced levels of a subject leading to more incorrect and lower-quality responses, suggesting the need for safeguards to ensure its responsible application in education at higher levels of study. ChatGPT’s evaluation also highlights broader ethical issues with its usage and integration within educational contexts, for which this thesis explores potential ways to mitigate these issues while providing a holistic educational experience to students. Therefore, the results of this study support the view that ChatGPT proves beneficial as a supplementary knowledge tool in educational contexts, and with appropriate safeguards in place, can be used as a practical learning aid to augment other academic material wherever needed.","abstract_has_math":false,"creators":["Tike, Yash Chandrashekhar"],"institution":null,"degree_name":"Master of Science in Computer Science","degree_level":"Restricted Thesis: Campus only access","degree_discipline":"School of Computer Science and Engineering","degree_department":null,"school":null,"contributors":["Khan, Bilal"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":null,"date_issued":"","date_published":null,"updated_at":"2026-11-19T08:09:44Z","subjects":["Artificial Intelligence","Natural Language Processing","Large Language Model","Chatbot","STEM","Humanities","Artificial Intelligence and Robotics","Data Science","Educational Methods","Educational Technology"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://scholarworks.lib.csusb.edu/etd/1998","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://scholarworks.lib.csusb.edu/etd/1998","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://scholarworks.lib.csusb.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Ascholarworks.lib.csusb.edu%3Aetd-3197","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Khan, Bilal"]},{"key":"dc:creator","label":"Author","values":["Tike, Yash Chandrashekhar"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.available","label":"Dc Date Available","values":["2024-07-15T07:00:00Z"]},{"key":"dc:date.created","label":"Dc Date Created","values":["2024-08-01T07:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["School of Computer Science and Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Restricted Thesis: Campus only access"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master of Science in Computer Science"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Artificial Intelligence","Natural Language Processing","Large Language Model","Chatbot","STEM","Humanities","Artificial Intelligence and Robotics","Data Science","Educational Methods","Educational Technology"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://scholarworks.lib.csusb.edu/etd/1998"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["This thesis investigates the effectiveness of ChatGPT in high school and undergraduate education and the subsequent implications of its usage and integration in these educational contexts. While there has been significant discourse on its potential utility, previous studies have not dealt with understanding ChatGPT's effectiveness in high school and undergraduate education by directly evaluating ChatGPT from a student's point of view. To address these gaps, this study uses a qualitative methodological approach to evaluate ChatGPT's real-world utility by evaluating its responses to questions from commonly chosen subjects. These responses are qualitatively rated by student evaluators to assess their usefulness. From the findings, ChatGPT’s performance indicates that it has the potential to provide supplementary assistance in delivering knowledge and aiding students in their academic activities at a foundational level for a chosen subject. However, its performance deteriorates at the advanced levels of a subject leading to more incorrect and lower-quality responses, suggesting the need for safeguards to ensure its responsible application in education at higher levels of study. ChatGPT’s evaluation also highlights broader ethical issues with its usage and integration within educational contexts, for which this thesis explores potential ways to mitigate these issues while providing a holistic educational experience to students. Therefore, the results of this study support the view that ChatGPT proves beneficial as a supplementary knowledge tool in educational contexts, and with appropriate safeguards in place, can be used as a practical learning aid to augment other academic material wherever needed."]},{"key":"dc:title","label":"Title","values":["DETERMINING PEDAGOGIC EFFECTIVENESS OF CHATGPT USING QUALITATIVE ANALYSIS OF ACADEMIC QUERY SETS"]}]}],"canonical_facts":{"dc:contributor":["Khan, Bilal"],"dc:creator":["Tike, Yash Chandrashekhar"],"dc:date.available":["2024-07-15T07:00:00Z"],"dc:date.created":["2024-08-01T07:00:00Z"],"dc:description.abstract":["This thesis investigates the effectiveness of ChatGPT in high school and undergraduate education and the subsequent implications of its usage and integration in these educational contexts. While there has been significant discourse on its potential utility, previous studies have not dealt with understanding ChatGPT's effectiveness in high school and undergraduate education by directly evaluating ChatGPT from a student's point of view. To address these gaps, this study uses a qualitative methodological approach to evaluate ChatGPT's real-world utility by evaluating its responses to questions from commonly chosen subjects. These responses are qualitatively rated by student evaluators to assess their usefulness. From the findings, ChatGPT’s performance indicates that it has the potential to provide supplementary assistance in delivering knowledge and aiding students in their academic activities at a foundational level for a chosen subject. However, its performance deteriorates at the advanced levels of a subject leading to more incorrect and lower-quality responses, suggesting the need for safeguards to ensure its responsible application in education at higher levels of study. ChatGPT’s evaluation also highlights broader ethical issues with its usage and integration within educational contexts, for which this thesis explores potential ways to mitigate these issues while providing a holistic educational experience to students. Therefore, the results of this study support the view that ChatGPT proves beneficial as a supplementary knowledge tool in educational contexts, and with appropriate safeguards in place, can be used as a practical learning aid to augment other academic material wherever needed."],"dc:identifier":["https://scholarworks.lib.csusb.edu/etd/1998"],"dc:subject":["Artificial Intelligence","Natural Language Processing","Large Language Model","Chatbot","STEM","Humanities","Artificial Intelligence and Robotics","Data Science","Educational Methods","Educational Technology"],"dc:title":["DETERMINING PEDAGOGIC EFFECTIVENESS OF CHATGPT USING QUALITATIVE ANALYSIS OF ACADEMIC QUERY SETS"],"thesis:degree_discipline":["School of Computer Science and Engineering"],"thesis:degree_level":["Restricted Thesis: Campus only access"],"thesis:degree_name":["Master of Science in Computer Science"]},"updated_at":"2026-11-19T08:09:44Z"}