No description available.

To provide quality assurance to various stakeholders, current foreign language program evaluation practices often incorporate learners' satisfaction of their language program experiences. Surprisingly, there is a lack of research investigating the multiple learner variables that potentially influence their satisfaction of the program, including foreign language proficiency, foreign language learning goals, and foreign language program grades. In order to address this issue, a study investigating the influences of various learner factors on program satisfaction was conducted with 440 learners enrolled in a two-year English as a foreign language program at a university in Japan. The results of a recursive path analysis indicated that program satisfaction, a construct comprised of questionnaire items related to the content and learners expectations as well as various aspects of the instructors, was influenced by their level of academic-vocational English language learning goals, grades in the English program courses, and gains in English language proficiency. While initial English proficiency did not have a direct effect on program satisfaction as hypothesized, it did have considerable indirect effects through its influence on other learner variables in the model, particularly the learners' grades. Importantly, further analyses also found significant differences between gender groups regarding the interrelationships of the learner factors to satisfaction, with proficiency gains having considerable effects for the male participants but almost no effect among the female participants. Furthermore, a comparison of the path models for each gender group showed that while the learner variables accounted for 17% of the variance in program satisfaction for the male learners, the same learner variables only accounted for 5% of satisfaction in the model for the female learners. Another important finding was an increase of 30% of variance accounting for program satisfaction between a path analysis that incorporated the learners' gains in English language proficiency based on pre- and post-program TOEFL scores and another path analysis that used the learners' self-perceived improvement in English language skills. Finally, a cross-validation of the path models revealed statistically significant differences on two variables, proficiency gain and English learning goals, between the two cohorts in the study, indicating a limitation in the longitudinal format utilized. / CITE/Language Arts

In recent years, foreign language program evaluation has gained greater attention among language educators, program administrators, and evaluators. Increased demands for demonstrated program performance, often motivated by external forces, such as accreditation pressures and decisions regarding the allocation of funding, have led to heightened focus on foreign language program evaluation practices, methodologies, and results. Despite this increased attention, there are few published evaluation studies within the field of foreign language learning that have examined foreign language program effectiveness over time. This longitudinal study was designed to quantitatively investigate the performance of one Japanese university English for Academic Purposes (EAP) program over the 20-year span of the program’s existence. Quantitative evaluation methodologies and advanced statistical procedures were utilized to examine changes in student English proficiency, as measured by the Institutional Test of English as a Foreign Language (TOEFL ITP) and English achievement, as measured by four semesters of EAP course grades, as students progressed through the two-year program. Twenty cohorts of students (cohort n-sizes ranging from approximately 250 to 550 students) were included in this study. The comprehensive data set included three repeated-measures of the TOEFL ITP and four English achievement grade point averages (GPAs) for each of the 20 cohorts. The research questions for this expansive longitudinal study addressed two levels of inquiry. First, at the program-global level, this study sought to investigate patterns of English proficiency change within and between cohorts across the life of the program, and the extent that programmatic events and external influences might have impacted those patterns. For this investigation, TOEFL ITP results for three proficiency domains—listening, grammar, and reading—were chronologically charted for the 20 cohorts and time-series analyses were conducted. The results indicated that all cohorts demonstrated significant gains in the three proficiency domains by the end of the two-year program. However, the overall trends across the program’s 20-year history revealed gradual negative trajectories for grammar and reading proficiency. Events that were hypothesized to have influenced proficiency patterns were tested, including (a) the addition of a new department specialization, (b) changes to department admissions, (c) the entrance of students who experienced new national reforms at the secondary education level, and (d) department expansion. While listening proficiency patterns were unaffected, grammar and reading proficiency trends were negatively impacted by the start of the new specialization and changes to admissions procedures. The entrance of students who had experienced secondary educational changes had an initial negative impact on the grammar trend, but positive grammar and reading proficiency trends emerged from that point onward. It was speculated that these events, as well as larger population trends impacting Japanese universities, led to gradual shifts in program student demographics, which contributed to the observed changes in proficiency patterns. Also of interest was an examination of the concept of English achievement coherence—or the extent that student English achievement, as measured by English course grade point averages (GPAs)—can be used to assess course interrelatedness. English course GPA data was used to statistically derive three rival achievement coherence metrics. These metrics were then tested separately, using hierarchical linear modeling techniques, to examine the extent that achievement coherence might serve to mediate any proficiency variation observed across the 20 cohorts. There were no significant findings for two of the metrics tested, while the third metric was found to have a significant negative effect for reading proficiency. This finding directly contradicted the hypothesized outcome that a greater amount of coherence would serve to facilitate proficiency development. Given the significant negative reading trend that emerged across the life of the program, this result might suggest that larger influences affecting student demographic changes could outweigh any potential facilitative effects of coherence on proficiency outcomes. Following the program-global analyses, the second level of inquiry was at the cohort-specific level. Individual cohorts that had demonstrated comparatively high and low listening and reading proficiency gains were selected for follow-up analyses. The aim was to examine if differences in coherence at the cohort level might account for the contrastive proficiency gains attained. For each target cohort, a recursive path model, including the program’s 16 English courses and final proficiency outcome, was tested to examine English achievement interrelatedness and contributions to the final proficiency outcome. A greater number of significant paths and larger final model R2 coefficient would suggest more coherence. Additionally, for each target cohort, grade residuals analyses using linear regression methods were conducted to investigate grading consistency at the course level. A greater number of outlying grade cases could indicate that the course assessment schemes were not followed, which would suggest less cohort coherence. The results of these analyses for the pairs of contrastive listening gain and reading gain cohorts were compared, but no significant differences were found. While these analytical methods were determined to be useful for ongoing formative evaluation processes, the resulting measures were likely too broad to capture any meaningful differences in coherence between cohorts at the program-global level. / Teaching & Learning

Donor country initiatives for the prevention and mitigation of HIV/AIDS are not a matter of simple burden sharing. Instead, they have brought in their wake many of the complexities and unforeseen effects that have long been associated with more general overseas development assistance. In the case of funding directed toward HIV/AIDS, these effects are by no means either secondary or easily calculable. It is widely acknowledged that there is no consensus framework on how these impacts may be defined, no framework/toolkit for the evaluation of impacts and no longitudinally significant data that could provide the substance for those evaluations. The subject of this study focuses not on the health outcomes of funding but on how donor-recipient relations could be better deliberated, negotiated and coordinated. We argue that effective leadership and governance of developing country health systems for HIV/AIDS work requires a reconfiguration of how donor-recipient relations are conceived and contracted, and for this purpose, we propose an adaptation of the Organisation for Economic Co-operation and Development Paris Declaration principles of aid effectiveness.

This paper explores the use of quantitative assessments typically used in research to evaluate experiences of cancer patients and survivors receiving group art therapy services. Literature exploring program evaluation as a methodology, how current research selects standardized measurement tools for the evaluation of art therapy interventions with adult cancer patients and survivors, and on the efficacy of art therapy with this population is reviewed. Quantitative and qualitative data were collected from four participants, who were clients in two eight-week art therapy groups. Quantitative data were collected in the form of pre- and post-test measurements using six commonly used standardized quality of life assessment tools. Qualitative data were collected via focus groups and art responses. Quantitative data were analyzed to identify general trends in the pre- and post-test measures, demonstrating that no significant positive shifts in symptoms or well-being were documented in the tests. Qualitative data were then analyzed to identify six prominent themes, including the impact of the COVID-19 pandemic on the participants’ experience of the tests, the participants’ perceived personal value of the tests, pre- and post-test measures as containment of experience, art responses as accurate representations of the benefits of art therapy, participants’ passion for art therapy, and participants’ feelings that standardized tests did not accurately capture their experience in the group. These findings were then examined in the context of the literature reviewed, and it was concluded that while standardized assessments have a valuable place in research, they do not effectively capture the lived experience of participants in art therapy groups. Furthermore, future research should continue to explore the value of qualitative research, including that which uses art-making, in evaluating art therapy programs and effectiveness.

A Food Behavior Checklist (FBC) was developed, validated, and pilot-tested with homemakers in Virginia's Expanded Food and Nutrition Education Program (EFNEP). The FBC was designed to measure nutrition-related practices that are taught in EFNEP, but cannot be measured by the 24-hour recall. During development, 20 EFNEP paraprofessionals in Virginia and 20 randomly selected state EFNEP coordinators helped to identify items that are most important in evaluating the overall effectiveness of EFNEP, and which could be used to establish content, face, and construct validity of a behavior assessment instrument. The Food Behavior Checklist contained 30 items, and responses were recorded on a Likert scale with four response levels: 0 = "never or seldom", 1 = "sometimes",2 = "usually", and 3 = "almost always". Cronbach-alpha revealed a reliability coefficient of 0.86. During the field test phase of this study, the FBC was used before and after EFNEP intervention to collect data on the nutrition-related practices of 147 low-income homemakers in three rural counties and one urban area in Virginia. In this phase, the experimental group, which consisted of 79 homemakers, received computer-aided feedback on their dietary practices, via a Diagnostic Report, which was used as a teaching tool. Paraprofessionals thoroughly explained the content of the diagnostic report to the homemaker at program entry and program exit. The control group, which consisted of 68 homemakers, did not receive computer-aided feedback on their dietary intakes, in that no mention was made of the computer print out to them. Results indicated that this instrument (FBC) may be useful in evaluating the overall effectiveness of EFNEP nationwide and may be useful in other nutrition programs. No significant differences were observed in the nutrient intake or Food Behavior Checklist practice change scores between the group who received computer-aided feedback and the group who did not received computer-aided feedback. The author concluded that the dietary analysis contained in the computer generated Diagnostic Report needs to be simplified if it is to become an effective tool with EFNEP homemakers. More research is needed on the use of computerized diet analysis as a teaching tool with low-income homemakers. / Ph. D.

Food insecurity refers to the lack of reliable access to nutritious and affordable foods for people of all backgrounds (Meenar and Hoover, 2012) and is a problem faced by approximately 50 million Americans (Smith, 2011) and thirteen percent of North Carolina households. Food security and poverty have been directly linked and North Carolina's poverty rate (14.3%) is above the national level (13%) (Curtis, 2010). Community gardens have been recognized globally by many experts including health professionals, community organizers, environmental activists, and policymakers, as an "important contributor to economic development, food security, and environmental management"(Baker, 2004). Together, these professionals use gardens as a means to educate the public about food production and nutrition. Empirical research has documented many community garden benefits, however, the examination of educational programs associated with these gardens is limited. The purpose of this case study was to examine the development and implementation of a beginner gardening program and its influence on program participants in an area known to be food insecure within North Carolina. The researcher utilized multiple means of qualitative methods including: 1) semi-structured pre- and post- interviews with program coordinators and participants, 2) content analysis, 3) a reflection journal used to observe the program, and the facilitation of a 4) focus group with program participants. The findings revealed the challenges program coordinators encountered throughout the development and implementation, as well as the effects of the beginner gardening program on program participants. / Master of Science in Life Sciences

Doctor of Philosophy / Curriculum and Instruction Programs / Thomas Vontz / Offering a high-quality education to English language learners (ELLs) is a challenge in schools across the United States. Yet, few studies have been conducted to investigate high school English as a second language (ESL) programs. This study provides insights into how a Kansas urban high school ESL program promotes access to the curriculum for ELLs by providing for their social, affective, linguistic, and academic needs. The purpose of this dissertation is to use the premise of educational equity and Catherine Walsh’s (1991) educational needs for ELL school success to explore how structural components of the ESL program in this study promote the access of ELLs to the curriculum. This study offers (1) insights into how urban school districts with high ELL populations might address the issue of access to the curriculum, (2) insights into various perceptions of participant groups—administrators, teachers, and students, and (3) insights into how ESL program components address the educational needs for ELLs to gain access to the curriculum. More specifically, this study emphasizes the following four structural components of the ESL program: (1) student placement, (2) sheltered content courses, (3) teaming, and (4) Spanish for native speakers courses. These structural components are used as a lens to view how social, affective, linguistic, and academic needs of ELLs are addressed. Although the results of this study cannot be generalized to other schools or districts, this study may help other districts, schools, and individual teachers make informed decisions. By demonstrating how four structural ESL program components meet the needs of ELLs in a high school setting, other educators might replicate components on their journey for educational equity within their own venues.

Thèse réalisée en cotutelle France- Québec / Les troubles cognitifs et comportementaux après une lésion cérébrale peuvent entraîner des limitations d’activité sévères et des restrictions de participation. Les personnes cérébrolésées acquises nécessitent une prise en charge adaptée et spécifique tant au niveau de la rééducation que de la réadaptation. Un programme de réadaptation a été développé dans le service de Médecine Physique et de Réadaptation de la Pitié-Salpêtrière, Paris, France. Le but de cette présente thèse est d’explorer l’efficacité de ce programme sur l’activité et la participation. Spécifiquement, les objectifs sont de : 1) définir et valider le programme de réadaptation par l’équipe multidisciplinaire; 2) mesurer les effets du programme de réadaptation sur l’activité et la participation des participants et 3) explorer des liens possibles entre le problème ciblé par le programme, ses interventions et les effets du programme sur l’activité et la participation. Pour répondre à l’objectif 1 de l’étude, un modèle logique (Champagne et al., 2009) est utilisé. Des entretiens semi-dirigés sont menés auprès de l’équipe multidisciplinaire. La documentation de chaque activité du programme est validée par des groupes d’experts. Pour répondre à l’objectif 2, une étude quasi expérimentale avec «cas uniques» et multiples mesures répétées est utilisée. Six mesures répétées sont effectuées : trois en pré-programme, puis trois en post-programme jusqu’à six mois. L’interprétation des résultats est réalisée à partir (i) de l’analyse visuelle de données graphiques représentant l’évolution du sujet dans le temps et (ii) d’analyse statistique. Au préalable de cette étude, une première étape a consisté à identifier les outils de mesure des déficiences, de l’activité et de la participation. Des outils de mesure situationnels fiables et valides sont choisis. Les critères de jugement principaux sont (i) le niveau d’activité évalué par le Cooking Task (Chevignard et al., 2000) et le Profil des Activités Instrumentales (PAI) (Bottari et al., 2009) et (ii) la participation évaluée par le PAI et la Mesure des Habitudes de vie (MHAVIE) (Noreau et al., 2002).   Pour répondre à l’objectif 3, l’analyse logique théorique s’appuie sur le modèle cognitif des fonctions exécutives de Lezak (1982) et sur la CIF. Les résultats de cette étude montrent que l’analyse logique théorique de l’activité cuisine valide cette activité au sein du programme de réadaptation. La mesure des effets du programme fait ressortir des différences significatives entre les périodes pré et post-programme au nombre total d’erreurs au Cooking Task (6/7 participants) et en besoin en aide (PAI) (6/7 participants). L’item « préparation de repas » de la MHAVIE suggère une amélioration pour 4/7 sujets. L’ensemble des résultats suggère une amélioration globale de l’activité « préparer un repas » qui se maintient dans le temps. L’identification des outils de mesure favorise un choix éclairé des outils à préconiser pour l’évaluation des programmes de réadaptation dédiés aux personnes cérébrolésées. Cette thèse contribue à l’avancement des connaissances en réadaptation. De fait, peu d’études sont allées aussi loin dans la documentation d’un programme de réadaptation multidisciplinaire et holistique et dans la compréhension des liens entre les processus de soins et les retombées du programme. / The cognitive and behavioral sequelae of brain injury can severely limit activities and restrict participation. People with acquired brain injury require adapted and specific reeducation and rehabilitation. To respond to these needs, a rehabilitation program was developed within the Physical and Rehabilitation Medicine Service of Pitié-Salpêtrière, Paris, France. This thesis seeks to explore the effectiveness of this program on participant’s levels of activity and participation. More specifically, the objectives were to: 1) define and validate the rehabilitation program with the multidisciplinary team; 2) measure the effects of the rehabilitation program on participant participation levels and 3) explore possible links between the problem, the interventions in the program, and the effects of the program on participant’s activity and participation levels. With respect to the first objective of documenting the rehabilitation program, we used the logic model of Champagne et al., 2009). Semi-structured interviews were carried out with members of the multi-disciplinary team. The documentation of each program activity was validated by groups of experts. For the second objective, a quasi-experimental study was carried out with ‘single-case’ multiple repeated measures. Six repeated measures were used: three pre-program and three post-program up until six months. Results were analyzed using (i) visual analysis of graphic data which represented the evolution of participants over time and (ii) statistical analyses. In the initial preparation phase, tools measuring body functions and structure, activity and participation were identified. The situational measurement tools chosen were reliable and valid. Principal outcomes were (i) participants’ activity level evaluated by the Cooking Task (Chevignard et al., 2000) and the Instrumental Activities of Daily Living Profile (IADL Profile) (Bottari et al., 2009) and (ii) participants’ participation level evaluated by the IADL Profile and the Life Habits assessment’ (LIFE-H) (Noreau et al., 2002). For the third objective, a logic theory analysis was based on the cognitive model of executive functions of Lezak (1982) and on the International Classification of Functioning, Disability and Health (ICF). This analysis demonstrates the validity of the cooking activity and thereby promotes the recognition of such activities within multidisciplinary rehabilitation programs. For the measurement of the effects of the rehabilitation program, significant differences in the total number of errors in the Cooking Task (for 6/7 participants) and in the need for help (IADL Profile) (6/7 participants) between the pre- and post-program phases were observed. On the LIFE-H assessment, some improvements were shown for the ‘preparation of meal’ item for 4/7 participants. The overall results of the Cooking Task, IADLP and LIFE-H scale suggest a global improvement for the activity ‘meal preparation’ after the rehabilitation program. This improvement is maintained over time. The identification of tools to measure limitations in activity and participation levels in real life situations assists informed decision-making in rehabilitation. This thesis contributes to the advancement of knowledge in rehabilitation. Few studies have gone this far in documenting a multidisciplinary and holistic rehabilitation program and in understanding the relation between its effects and care processes.

Le contexte familial influence probablement plus le succès scolaire des élèves de pays en voie de développement que ce que certaines recherches indiquaient jusqu’à présent (Nonoyama-Tarumi, 2008). Ce mémoire explore les relations entre le contexte familial et le parcours scolaire d’élèves Béninois dans le cadre d’une évaluation d’implantation et de processus du programme de bourses de la Fondation Sophie Lavigne (FSL). Au total 18 informateurs ont participé à la recherche. Les données ont fait l’objet d’analyses qualitatives. Les résultats montrent que le programme de bourses est mis en œuvre conformément à ce qui était attendu. Ce dernier facilite le parcours scolaire de toutes les participantes et parfois celui de leur fratrie. Par contre, les critères de renouvellement des bourses, en fonction de la réussite scolaire, ont peu d’influence positive sur leur parcours scolaire. Les causes d’échecs scolaires rapportées par les participants sont de deux ordres, (a) une accumulation de difficultés qui entravent l’étude et (b) un obstacle ponctuel important qui empêche la poursuite des études. Les familles interrogées valorisent grandement l’instruction. Dans la mesure de leurs moyens, elles tentent d’offrir les meilleures conditions de réussite scolaire possibles à leurs enfants. L’accès à du soutien scolaire tel des cours de rattrapage est nécessaire pour assurer des conditions d’étude optimales. À la lumière des résultats, la FSL aurait avantage à fournir plus de soutien scolaire aux étudiantes qu’elle accompagne et à revoir les critères de renouvellement de bourses. / One’s family background probably has a stronger influence on a student’s academic success in developing countries than many studies have shown up to now (Nonoyama-Tarumi, 2008). By means of an evaluation of both the implantation and processes of the Sophie Lavigne Foundation (FSL) scholarship program, this thesis deals with the relationships between Benin students’ family background and their academic trajectory. A total of 18 informants participated in the research project. The data was analyzed qualitatively. Generally speaking, the scholarship program has been established as was expected. Families that were interrogated greatly value education. To the very best of their abilities, they try to offer their children the greatest possible conditions for academic success. The scholarship program makes the academic trajectory of all participants easier and sometimes even positively affects their siblings’. However, the criteria for the renewal of the scholarships, which depend on academic success, have few positive effects on the participants’ academic trajectories. The causes for academic failures mentioned by the participants seem to be twofold: (a) an accumulation of difficulties that impair their academic trajectory (b) an important and specific obstacle that prevents a student from continuing her studies. It also appears that having access to academic support—remedial work for instance—is necessary in order to guarantee the best study conditions. The results of this research indicate that the FSL should provide students it accompanies with more academic support and reconsider the criteria for the renewal of the scholarships.