{"id":{"repo_id":"usf","oai_identifier":"oai:digitalcommons.usf.edu:etd-11928"},"canonical_url":"https://search.ndltd.org/etd/usf/oai:digitalcommons.usf.edu:etd-11928","repository":{"repo_id":"usf","name":"University of South Florida","base_url":"https://digitalcommons.usf.edu/do/oai/"},"display":{"title":"Predicting Human Chess Moves with Large Language Models","abstract":"As artificial intelligence (AI) surpasses human performance in more tasks, the interest in leveraging and collaborating with this technology for greater productivity continues to grow. However, the black-box nature of current AI can make it difficult to interpret and unsuitable to perform tasks that are more complex and require human intuition. This has led to the pursuit of AI systems that can model individual behavior. Chess offers an ideal environment to explore this task due to its complexity, structure, and the abundance of data containing unique human decision-making examples. Given that a chess game can be fully represented with text, and considering the prominence of state-of-the-art natural language processing techniques in reasoning tasks, this work investigates how well large language models can predict human chess moves compared to approaches that are specialized in chess. Additionally, I determine the extent to which prompt engineering affects the performance of large language models in predicting human chess moves. The results show that, while prompt engineering improves the accuracy of large language models, this technique falls short of matching the performance of chess-specific approaches.","abstract_html":"As artificial intelligence (AI) surpasses human performance in more tasks, the interest in leveraging and collaborating with this technology for greater productivity continues to grow. However, the black-box nature of current AI can make it difficult to interpret and unsuitable to perform tasks that are more complex and require human intuition. This has led to the pursuit of AI systems that can model individual behavior. Chess offers an ideal environment to explore this task due to its complexity, structure, and the abundance of data containing unique human decision-making examples. Given that a chess game can be fully represented with text, and considering the prominence of state-of-the-art natural language processing techniques in reasoning tasks, this work investigates how well large language models can predict human chess moves compared to approaches that are specialized in chess. Additionally, I determine the extent to which prompt engineering affects the performance of large language models in predicting human chess moves. The results show that, while prompt engineering improves the accuracy of large language models, this technique falls short of matching the performance of chess-specific approaches.","abstract_has_math":false,"creators":["Kreiger, Benjamin"],"institution":"University of South Florida","degree_name":"MS in Computer Science (M.S.C.S.)","degree_level":"Thesis","degree_discipline":"Engineering","degree_department":null,"school":null,"contributors":["John Licato, Ph.D.","Gene Kim, Ph.D.","Seungbae Kim, Ph.D.","Tempestt Neal, Ph.D."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2024,"date_issued":"2024-11-01T07:00:00Z","date_published":"2024-11-01T07:00:00Z","updated_at":"2026-11-19T08:50:05Z","subjects":["player modeling","action prediction","NLP","prompt engineering","GPT","Computer Sciences"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://digitalcommons.usf.edu/etd/10641","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://digitalcommons.usf.edu/etd/10641","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://digitalcommons.usf.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Adigitalcommons.usf.edu%3Aetd-11928","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["John Licato, Ph.D.","Gene Kim, Ph.D.","Seungbae Kim, Ph.D.","Tempestt Neal, Ph.D."]},{"key":"dc:creator","label":"Author","values":["Kreiger, Benjamin"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2024-11-01T07:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis","M.S.C.S."]},{"key":"thesis:degree_name","label":"Degree Name","values":["MS in Computer Science (M.S.C.S.)"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of South Florida"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["player modeling","action prediction","NLP","prompt engineering","GPT","Computer Sciences"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://digitalcommons.usf.edu/etd/10641"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["As artificial intelligence (AI) surpasses human performance in more tasks, the interest in leveraging and collaborating with this technology for greater productivity continues to grow. However, the black-box nature of current AI can make it difficult to interpret and unsuitable to perform tasks that are more complex and require human intuition. This has led to the pursuit of AI systems that can model individual behavior. Chess offers an ideal environment to explore this task due to its complexity, structure, and the abundance of data containing unique human decision-making examples. Given that a chess game can be fully represented with text, and considering the prominence of state-of-the-art natural language processing techniques in reasoning tasks, this work investigates how well large language models can predict human chess moves compared to approaches that are specialized in chess. Additionally, I determine the extent to which prompt engineering affects the performance of large language models in predicting human chess moves. The results show that, while prompt engineering improves the accuracy of large language models, this technique falls short of matching the performance of chess-specific approaches."]},{"key":"dc:title","label":"Title","values":["Predicting Human Chess Moves with Large Language Models"]}]}],"canonical_facts":{"dc:contributor":["John Licato, Ph.D.","Gene Kim, Ph.D.","Seungbae Kim, Ph.D.","Tempestt Neal, Ph.D."],"dc:creator":["Kreiger, Benjamin"],"dc:date":["2024-11-01T07:00:00Z"],"dc:description":["As artificial intelligence (AI) surpasses human performance in more tasks, the interest in leveraging and collaborating with this technology for greater productivity continues to grow. However, the black-box nature of current AI can make it difficult to interpret and unsuitable to perform tasks that are more complex and require human intuition. This has led to the pursuit of AI systems that can model individual behavior. Chess offers an ideal environment to explore this task due to its complexity, structure, and the abundance of data containing unique human decision-making examples. Given that a chess game can be fully represented with text, and considering the prominence of state-of-the-art natural language processing techniques in reasoning tasks, this work investigates how well large language models can predict human chess moves compared to approaches that are specialized in chess. Additionally, I determine the extent to which prompt engineering affects the performance of large language models in predicting human chess moves. The results show that, while prompt engineering improves the accuracy of large language models, this technique falls short of matching the performance of chess-specific approaches."],"dc:identifier":["https://digitalcommons.usf.edu/etd/10641"],"dc:subject":["player modeling","action prediction","NLP","prompt engineering","GPT","Computer Sciences"],"dc:title":["Predicting Human Chess Moves with Large Language Models"],"thesis:degree_discipline":["Engineering"],"thesis:degree_level":["Thesis","M.S.C.S."],"thesis:degree_name":["MS in Computer Science (M.S.C.S.)"],"thesis:institution_name":["University of South Florida"]},"updated_at":"2026-11-19T08:50:05Z"}