This thesis explores the support of learning through reflection, in the context of medical students and practitioners, working through a series of simulated consultations involving the diagnosis and management of chronic illness. A model of the medical consultative process was defined, on which a web-based patient simulation was developed. This simulation can be accessed over the Internet using commonly available web-browsers. It enables users to interact with a virtual patient by taking a history, examining the patient, requesting and reviewing investigations, and choosing appropriate management strategies. The virtual patient can be reviewed over a number of consultations, and the patient outcome is dependant on the management strategy selected by the user. A second model was also developed, that adds a layer of reflection over the consultative process. While interacting with the virtual patient users are asked to formulate and test their hypotheses. Simple tools are included to encourage users to record their observations and thoughts for further learning, as well as providing links to web-based library resources. At the end of each consultation, users are asked to review their actions and indicate whether they think their actions were critical, relevant, or not relevant to the diagnosis and management of the patient in light of their current knowledge. Users also have the opportunity to compare their activity to their peers or an expert in the case under study. Three formal cycles of evaluation were undertaken during the design and development of the software. A number of clinicians were involved in the initial design to ensure there was an appropriate structure that matched clinical practice. Formative evaluation was conducted to review the usability of the application, and based on user feedback a number of changes were made to the user interface and structure of the application. A third, end user, evaluation was undertaken using a single case concerning the diagnosis and management of hypertriglyceridaemia in the context of Type 1B Glycogen Storage Disease. This evaluation involved ten medical students, five general practitioners and two specialists. The evaluation involved observation using a simplified think-aloud, as well as administration of a questionnaire. Users were engaged by the simulation, and were able to use the application with only a short period of training. Usability issues still exist with respect to the processing of natural language input, especially when asking questions of the virtual patient. Until such time that natural language recognition is able to provide satisfactory performance, alternative, list-based, methods of interaction will be required. Evaluation involving medical students, general practitioners, and specialist medical practitioners demonstrated that reflection can be supported and encouraged by providing appropriate tools, as well as by judiciously interrupting the consultative process and providing time for reflection to take place. Reflection could have been further enhanced if users had been educated on reflection as a learning modality prior to using SIMPRAC. Further work is also required to improve the simulation environment, improve the interfaces for supporting reflection, and further define the benefits of using this approach for medical education and professional development with respect to learning outcomes and behavioural change.

This thesis explores the support of learning through reflection, in the context of medical students and practitioners, working through a series of simulated consultations involving the diagnosis and management of chronic illness. A model of the medical consultative process was defined, on which a web-based patient simulation was developed. This simulation can be accessed over the Internet using commonly available web-browsers. It enables users to interact with a virtual patient by taking a history, examining the patient, requesting and reviewing investigations, and choosing appropriate management strategies. The virtual patient can be reviewed over a number of consultations, and the patient outcome is dependant on the management strategy selected by the user. A second model was also developed, that adds a layer of reflection over the consultative process. While interacting with the virtual patient users are asked to formulate and test their hypotheses. Simple tools are included to encourage users to record their observations and thoughts for further learning, as well as providing links to web-based library resources. At the end of each consultation, users are asked to review their actions and indicate whether they think their actions were critical, relevant, or not relevant to the diagnosis and management of the patient in light of their current knowledge. Users also have the opportunity to compare their activity to their peers or an expert in the case under study. Three formal cycles of evaluation were undertaken during the design and development of the software. A number of clinicians were involved in the initial design to ensure there was an appropriate structure that matched clinical practice. Formative evaluation was conducted to review the usability of the application, and based on user feedback a number of changes were made to the user interface and structure of the application. A third, end user, evaluation was undertaken using a single case concerning the diagnosis and management of hypertriglyceridaemia in the context of Type 1B Glycogen Storage Disease. This evaluation involved ten medical students, five general practitioners and two specialists. The evaluation involved observation using a simplified think-aloud, as well as administration of a questionnaire. Users were engaged by the simulation, and were able to use the application with only a short period of training. Usability issues still exist with respect to the processing of natural language input, especially when asking questions of the virtual patient. Until such time that natural language recognition is able to provide satisfactory performance, alternative, list-based, methods of interaction will be required. Evaluation involving medical students, general practitioners, and specialist medical practitioners demonstrated that reflection can be supported and encouraged by providing appropriate tools, as well as by judiciously interrupting the consultative process and providing time for reflection to take place. Reflection could have been further enhanced if users had been educated on reflection as a learning modality prior to using SIMPRAC. Further work is also required to improve the simulation environment, improve the interfaces for supporting reflection, and further define the benefits of using this approach for medical education and professional development with respect to learning outcomes and behavioural change.

abstract: Virtual Patient Simulations (VPS) are web-based exercises involving simulated patients in virtual environments. This study investigates the utility of VPS for increasing medical student clinical reasoning skills, collaboration, and engagement. Many studies indicate that VPS provide medical students with essential practice in clinical decision making before they encounter real life patients. The utility of a recursive, inductive VPS for increasing clinical decision-making skills, collaboration, or engagement is unknown. Following a design-based methodology, VPS were implemented in two phases with two different cohorts of first year medical students: spring and fall of 2013. Participants were 108 medical students and six of their clinical faculty tutors. Students collaborated in teams of three to complete a series of virtual patient cases, submitting a ballpark diagnosis at the conclusion of each session. Student participants subsequently completed an electronic, 28-item Exit Survey. Finally, students participated in a randomized controlled trial comparing traditional (tutor-led) and VPS case instruction methods. This sequence of activities rendered quantitative and qualitative data that were triangulated during data analysis to increase the validity of findings. After practicing through four VPS cases, student triad teams selected accurate ballpark diagnosis 92 percent of the time. Pre-post test results revealed that PPT was significantly more effective than VPS after 20 minutes of instruction. PPT instruction resulted in significantly higher learning gains, but both modalities supported significant learning gains in clinical reasoning. Students collaborated well and held rich clinical discussions; the central phenomenon that emerged was "synthesizing evidence inductively to make clinical decisions." Using an inductive process, student teams collaborated to analyze patient data, and in nearly all instances successfully solved the case, while remaining cognitively engaged. This is the first design-based study regarding virtual patient simulation, reporting iterative phases of implementation and design improvement, culminating in local theories (petite generalizations) about VPS design. A thick, rich description of environment, process, and findings may benefit other researchers and institutions in designing and implementing effective VPS. / Dissertation/Thesis / Ed.D. Educational Leadership and Policy Studies 2014