Carleton University
How Do Novice Programmers Interact with ChatGPT while Solving Code -Tracing Problems?
Abstract
dc:description.abstractLarge Language Models (LLMs) like ChatGPT are generative AI tools that can answer questions and provide solutions to problems in various domains. To date, little is known about how students interact with LLM tools while problem solving. We recruited novice programmers (N = 21) and gave them a brief video-based lesson on the fundamentals. We then asked them to use ChatGPT version 4.0 (1) to learn about one additional construct, namely, for loops, and (2) to solve four problems that required specifying the output of a program with a for loop, with access to ChatGPT. Participants verbalized their thoughts as they worked, and these were transcribed and analyzed. We used a qualitative approach to identify how students reasoned and what strategies they employed while solving problems. We found substantially more independent problem solving than expected, given prior reports on students’ overreliance on LLMs.
Degree
thesis:*- Name thesis:degree_name
- Master of Human-Computer Interaction (M.H.C.I.)
- Level thesis:degree_level
- Master's
- Discipline thesis:degree_discipline
- Human-Computer Interaction
- Grantor dc:publisher
- Carleton University
- Year dc:date.issued
- 2025
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Adeeb, Elmira
Subjects
dc:subject × 1Rights
dc:rights- Statement dc:rights
-
- Copyright © 2025 the author(s). Theses may be used for non-commercial research, educational, or related academic purposes only. Such uses include personal study, distribution to students, research and scholarship. Theses may only be shared by linking to the Carleton University Institutional Repository and no part may be copied without proper attribution to the author; no part may be used for commercial purposes directly or indirectly via a for-profit platform; no adaptation or derivative works are permitted without consent from the copyright owner.
- Language dc:language.iso
- en