Reprint from: Allergology International 54(4), 2005, p.589-599

Treatment integrity is an important component of behavioural interventions, however few studies have examined methods to teach supervisors to evaluate the treatment integrity of such interventions applied by front-line staff. The purpose of the current study was to evaluate the effectiveness of a self-instructional package to teach individuals to evaluate the treatment integrity of discrete-trials teaching (DTT) sessions using the Discrete-Trials Teaching Evaluation Form (DTTEF). Participants consisted of six staff from the St.Amant Autism Programs. In a modified multiple-baseline design across a pair of participants, and replicated across two more pairs, at Baseline, a participant observed a confederate who role-played an instructor teaching three tasks to a confederate who role-played a child with autism spectrum disorder (ASD). Each participant was required to evaluate sessions taught with (a) low integrity, (b) moderate integrity, or (c) high integrity. During training, participants studied a self-instructional package. At Post-training, participants were assessed on the same tasks as during Baseline. During Generalization, participants were assessed evaluating the treatment integrity of three videos of an Autism Tutor administering DTT to a child with ASD. Finally, during a seven-month Follow-up, four participants were available and were assessed evaluating the treatment integrity of a confederate instructor teach a confederate child with low, moderate, and high integrity. Results demonstrated that after an average of 1 hour and 16 minutes of training, there was an immediate increase in accuracy across all participants. Specifically, mean accuracy increased from 47.6% in Baseline to 84.7% at the Post-training assessment (a 37.1% increase). All participants showed excellent generalization results, and three of the four participants who were available at the Follow-up assessment performed at a high level. These results suggest that the training package has potential to be used as an effective method to train staff who work with children with ASD to evaluate the treatment integrity of DTT sessions. / February 2016

This Master’s thesis deals with the process of employee evaluation in the company GEOtest, a.s. In the first part of the thesis are defined all the necessary theoretical findings needed to formulate proposals for the society. Practical part includes particular information about the company GEOtest, a.s. and the analysis of the current state of evaluation. Furthermore, the new concept of the system of evaluation in accordance with the corporate needs is presented, including the link up of the system and recommendation for its implementation.

Im Rahmen eines Dissertationsvorhabens am Albrecht Daniel Thaer-Institut für Agrar- und Gartenbauwissenschaften der Humboldt-Universität zu Berlin wurde die „Entwicklung beruflicher Handlungskompetenz in der gärtnerischen Berufsausbildung durch die Anwendung des Lernfeldkonzepts“ untersucht und in einem pädagogischen Unterrichtsexperiment an gartenbaulichen Berufsschulen in sechs Bundesländern durchgeführt. Damit eine durchgängige Kompetenz- und Outcome-Orientierung Berücksichtigung finden kann, erweiterte der Autor die Untersuchung zur Kompetenzentwicklung um die Aspekte Kompetenzmessung und Kompetenzbewertung. Basierend auf einer Arbeitsprozessanalyse zum Ausbildungsberuf Gärtner der Fachrichtung Garten- und Landschaftsbau wurden im Dialog mit dem Berufsstand Kriterien und Indikatoren beruflicher Handlungskompetenz von Landschaftsgärtnern definiert sowie berufliche Handlungsfelder (Tätigkeitsfelder) gebildet, aus denen Lernfelder abgeleitet und ein lernfeldstrukturierten Rahmenlehrplan für den berufsbezogenen Unterricht der Berufsschule konzipiert werden konnte. So war es möglich, handlungs- und kompetenzorientierte Lernaufgaben für den Berufsschulunterricht zu entwickeln, die sich an berufstypischen Arbeitssituationen orientieren. Durch die Bearbeitung dieser Lernaufgaben wurden bei den Versuchspersonen didaktisch begründete Lernhandlungen ausgelöst und angestrebte Kompetenzen entwickelt, die mittels eines standardisierten Bewertungsbogens durch Beobachtung (Fremdeinschätzung) und Befragung (Selbsteinschätzung) gemessen werden konnten. Die Bewertung ausgeprägter Kompetenzen erfolgte durch den Einsatz eines outcome-orientierten Abschlusstests „Virtuelle Kleinbaustelle“. Diese schriftliche Mehrfach-Situations-Aufgabe wurde nach Maßgabe eines systematischen Bewertungsrahmens unter Berücksichtigung der Anschlussfähigkeit an DQR und EQR ausgewertet, sodass auf den Erwerb beruflicher Handlungskompetenz in der Ausbildung zum Landschaftsgärtner geschlossen werden kann. / Within a PhD project at the Albrecht Daniel Thaer-Institute for Agricultural and Horticultural Sciences at Humboldt-Universität zu Berlin the “development of vocational action competencies regarding the training of gardeners based on the application of the concept of domains of learning” was studied in a teaching experiment at six horticultural vocational schools in six German states. To allow for a consistent focus on competencies and outcome, aspects of competencies measurement and competencies evaluation were included in the study of competency development. Based on an analysis of work processes in occupational training of landscape gardeners, criteria and indicators of vocational action competencies in this field were defined in collaboration with the gardening profession; furthermore, vocational fields of activities were developed. On their basis “domains of learning” (“Lernfelder”) could be derived and accordingly a framework curriculum could be developed for vocational lessons at vocational schools. In this manner it was possible to develop activity- and competence oriented learning tasks for lessons at vocational schools. These learning tasks focus on typical work situations in landscape gardening. When the test persons performed these learning tasks, didactically meaningful learning activities were initiated and the test persons developed the desired competencies. These competencies were measured by means of a standardized evaluation form by observation (external evaluation) and questioning (self-evaluation). The evaluation of profound competencies was carried out using an outcome-oriented final examination tool “small virtual building site”. This written multi-situation task was evaluated according to a systematic evaluation frame under consideration of compatibility with GQF and EQF, so that conclusions can be drawn regarding the acquisition of vocational action competencies during the training for landscape gardener.