Evaluation is an integral part of instructional design. Formative evaluation, specifically, is a phase identified in many instructional design models and is recognized as an important step for program improvement and acceptance. Although evaluation has many models and approaches, very few deal specifically with formative evaluation. Further, no one set of guidelines has been found that provides a comprehensive set of procedures for planning and implementing a formative evaluation. Encapsulating such guidelines into a “tool” that automates the process was the author’s initial idea. The author’s intent in Chapter 2 was to find a model or checklist as a stepping off point for future formative evaluation tool development. In lieu of finding such a model, one was created (Chapter 3), pulling from several formative evaluation models and the author’s own experience. Chapter 3 also discusses the purpose behind developing a formative evaluation tool - to create an accessible, efficient, intuitive, and expedient way for instructional designers and developers to formatively evaluate their instruction or instructional materials. Chapter 4 focuses on the methodology selected to evaluate the tool, presented in prototype. Chapter 5 presents the results of the evaluation; comments received from the expert reviewers are presented and ideas for tool improvement are generated. Finally, the Appendices include the formative evaluation tool prototype as well as the documentation that accompanied the tool during its evaluation. The initial idea behind this developmental dissertation was the creation of a formative evaluation tool. The focus of the dissertation itself, however, was on the justification for such a tool, and the literature behind the making of the model and consequently the tool. The result of this developmental dissertation was the prototype of an evaluation tool that with improvements and modifications is deemed promising by the experts who reviewed it. Although designed with formative evaluation in mind, it was generally agreed that this tool could be utilized for both formative and summative evaluation. The expert review was successful not because the tool was without fault, but because the review truly achieved its purpose – to identify areas of strength, weakness, and to suggest improvements. / Ph. D.

Cette thèse traite de la problématique de l’évaluation de programmes de formation professionnelle agricole (FPA) élaborés selon l’approche par compétences (APC) au Maroc. À partir d’une analyse approfondie du contexte de leur implantation dans ce pays, elle met en lumière les méthodes actuellement utilisées pour apprécier leur efficacité, mais aussi les insatisfactions que celles-ci suscitent chez les acteurs concernés. La présente recherche repose sur l’hypothèse que l’implication de l’ensemble des parties prenantes dans la mise en œuvre d’une évaluation participative de quatrième génération (Guba et Lincoln,1989) aboutirait à des résultats davantage acceptables et plus utilisables pour améliorer la qualité de ces programmes. Concomitamment, elle vise à répondre à la question spécifique suivante : Comment se décline le processus de négociation à l’intérieur d’une démarche participative d’évaluation de programmes de formation visant à fois la reconnaissance et l’amélioration des pratiques évaluatives des parties prenantes, la coconstruction d’un cadre de référence d’évaluation concerté et utile, et la contribution à leur émancipation? Dans cette perspective, six objectifs sont poursuivis. Du côté scientifique, il s’agit : 1) d’affiner la compréhension des processus de déroulement de la démarche participative d’évaluation de programmes; 2) de décrire et analyser les modes de négociation qui se développent au cœur des dynamiques interactionnelles entres les participants dans un contexte de pluralité; et 3) d’identifier les apprentissages et les changements induits par la participation à l’évaluation de programmes. Du côté pratique, il s’agit : 1) de produire un cadre de référence d’évaluation concerté et utilisable en favorisant la collaboration entre les parties prenantes; 2) d’améliorer leurs capacités évaluatives à travers l’appropriation d’une démarche de mise en œuvre d’une évaluation participative; et 3) de promouvoir le développement et l’ancrage d’une culture d’évaluation participative dans leur milieu professionnel. Pour ce faire, une recherche-action de type communautaire (Stringer, 1999) et qui accorde une place centrale au savoir pratique et à une conception de l’acteur social compétent (Giddens, 1987) a été réalisée en collaboration avec 15 participants. La recherche s’est échelonnée sur plus de 9 mois, soit de l’automne 2019 à l’été 2020, et a impliqué les différentes parties prenantes chargées de la conception, de la gestion et de la mise en œuvre des programmes de FPA. Pour documenter le processus de sa réalisation, la démarche méthodologique adoptée s’est appuyée sur un journal de bord, sur des entretiens individuels et notamment sur des entretiens de groupe. Les données issues des entretiens de groupe ont été traitées à l’aide de l’analyse thématique, de l’analyse conversationnelle et de l’analyse des négociations conversationnelles. Sur le plan scientifique, les résultats de cette recherche ont mis en lumière la diversité de pratiques et de conceptions des parties prenantes par rapport à l’évaluation de programmes de FPA développés selon l’APC au Maroc (cf. chapitre IV), ainsi que le processus de négociation et les jeux de pouvoir qui sous-tendent les interactions entre les participants (cf. chapitre V). En outre, certains apprentissages et changements individuels et collectifs semblent induits par la démarche participative. Sur le plan pratique, le principal résultat est l’identification des composantes (objectifs, critères d’évaluation, méthodes de collecte de données, etc.) d’un cadre de référence d’évaluation des programmes concernés, composantes issues des besoins et des préoccupations des parties prenantes et auxquelles ils adhèrent du fait de leur implication dans le processus de leur détermination (annexe 12). / This thesis deals with the issue of the evaluation of agricultural vocational training (AVT) programs developed according to the competency-based approach (CBA) in Morocco. On the basis of an in-depth analysis of the context of their implementation in this country, it highlights the methods currently used to assess their effectiveness, but also the dissatisfaction that these generate among the actors concerned. This research is based on the assumption that the involvement of all stakeholders in conducting a fourth-generation participatory evaluation (Guba and Lincoln, 1989) would lead to more acceptable and usable results to improve the quality of these programs. Concomitantly, it aims to answer the following specific question: How does the negotiation process unfold within a participatory approach to the evaluation of training programs aimed at both the recognition and improvement of stakeholders' evaluative practices, the co-construction of a concerted and useful evaluation reference framework, and the contribution to their emancipation? In this perspective, six objectives are pursued. On the scientific side, it is about: 1) refine the understanding of the processes of conduct of the participatory approach to programs evaluation; 2) describe and analyze the modes of negotiation that develop at the heart of the interactional dynamics between participants in a context of plurality; and 3) identify learnings and changes induced by participation in programs evaluation. On the practical side, it is about: 1) produce a collaborative and usable evaluation framework by fostering collaboration among stakeholders; 2) improve their evaluative capacities through the appropriation of an approach to the implementation of a participatory evaluation; and 3) promote the development and anchoring of a culture of participatory evaluation in their professional environment. To do this, community-based action research (Stringer, 1999) which gives a central place to the practical knowledge and the conception of the competent social actor of Giddens (1987) is carried out in collaboration with 15 participants. The research spanned over 9 months, from fall 2019 to summer 2020, and involved the various stakeholders responsible for the design, management, and implementation of AVT programs. To document the process of its realization, the methodological approach adopted was based on a logbook, on individual interviews and in particular on group interviews. Data from group interviews were processed using thematic analysis, conversational analysis and conversational negotiation analysis. On a scientific level, the results of this research highlighted the diversity of practices and stakeholder views in relation to the evaluation of AVT programs developed according to the CBA in Morocco (chapter IV) as well as the negotiation process and power games that underlie the interactions between the participants (chapter V). In addition, some individual and collective learning and changes seem to be induced by the participatory process. On a practical level, the main result is the identification of the components (objectives, evaluation criteria, data collection methods, etc.) of a reference framework for the evaluation of the programs concerned, components resulting from the needs and concerns of the stakeholders and to which they adhere because of their involvement in the process of their determination (annex 12).